Commit Graph

35501 Commits

Author SHA1 Message Date
Ignacio Vera 800f002e44
LUCENE-9820: PointTree#size() should handle the case of balanced tree in pre-8.6 indexes (#462)
Handle properly the case where trees are fully balanced for number of dimension > 1
2021-11-25 11:03:16 +01:00
Adrien Grand 8710252116 Fix test failures with testIndexUpgraderCommandLineArgs and ExtraFS. 2021-11-25 08:51:56 +01:00
Adrien Grand f80d816ce7
Speed up TestBackwardsCompatibility#testCommandLineArgs. (#467)
This test unzip files that we already unzipped. This commit copies the already
uncompressed files instead.
2021-11-24 08:25:22 +01:00
Adrien Grand 24fcd80a37
LUCENE-10168: Only test N-2 codecs on nightly runs. (#466)
In order for tests to keep running fast, this annotates all tests of N-2 codecs
with `@Nightly`. To keep good coverage of releases, the smoke tester is now
configured to run nightly tests.
2021-11-24 08:20:04 +01:00
Greg Miller 6ee69e06fb
LUCENE-10062: Switch to numeric doc values for encoding taxonomy ordinals (#264) 2021-11-23 06:00:11 -08:00
David Smiley 0fcf9c825f
Javadocs, Sorter impls (#426)
* Javadocs, Sorter impls
* clarify which sorts are stable/not
* link from utility methods to the primary Sorter implementations for further information
* describe when InPlaceMergeSorter is useful.  Fix incorrect statement that is uses insertion sort.

* Javadocs for Sorter
2021-11-23 07:13:40 -05:00
Tomoko Uchida 4193bcbc02 LUCENE-10200: fix luke lauch script. 2021-11-22 18:46:28 +09:00
Greg Miller 78ee53f837 Add missing CHANGES entry 2021-11-21 07:41:25 -08:00
Greg Miller 9d7e5ef388 Fixup TestCombinedFieldQuery to not (randomy) use numHits = 0 2021-11-21 07:38:28 -08:00
Andriy Redko 5993b9050a
LUCENE-10244: Please consider opening MultiCollector::getCollectors for public use (#455) 2021-11-21 07:36:54 -08:00
Adrien Grand 0902d803fd Add dash between `rev` and the git hash. 2021-11-20 08:09:42 +01:00
Quentin Pradet 1a869c185b
LUCENE-10085: Implement Weight#count on DocValuesFieldExistsQuery (#445)
Co-authored-by: Adrien Grand <jpountz@gmail.com>
2021-11-19 18:06:58 +01:00
Robert Muir af831d2810
LUCENE-10239: upgrade jflex (1.7.0 -> 1.8.2) (#452)
Upgrade jflex.

Change doesn't alter the behavior of any of the analyzers (unicode
version or grammar refactorings), just the minimal to get new tooling
working.
2021-11-19 09:24:27 -05:00
Ignacio Vera ad911df260
LUCENE-9820: Separate logic for reading the BKD index from logic to intersecting it (#7)
Extract BKD tree interface and move intersecting logic to the PointValues abstract class.
2021-11-19 08:28:01 +01:00
zacharymorn 07ee3ba83a
LUCENE-10236: Update field-weight used in CombinedFieldQuery scoring calculation (#444) 2021-11-18 21:36:38 -08:00
Andriy Redko 6bd5c14bf3
LUCENE-10242: The TopScoreDocCollector::createSharedManager should use ScoreDoc instead of FieldDoc (#450)
Signed-off-by: Andriy Redko <andriy.redko@aiven.io>
2021-11-18 16:35:59 +01:00
Patrick Zhai b4476e4318
LUCENE-10122 Use NumericDocValue to store taxonomy parent array instead of custom term positions (#451) 2021-11-17 19:32:34 -05:00
Dawid Weiss bae095ae48
LUCENE-10240: gradle regenerate fails on java 17 (#449) 2021-11-17 18:36:34 +01:00
Dawid Weiss 0eeba8d37c
LUCENE-10238: Update icu4j to 70.1. (#447) 2021-11-17 18:13:40 +01:00
Adrien Grand 556c7c5fb5 Add back-compat indices for 8.11.0. 2021-11-17 11:53:49 +01:00
Bruno Roustant c71cbac4f9
LUCENE-10225: Improve IntroSelector with 3-way partitioning. 2021-11-17 10:38:27 +01:00
Adrien Grand c0112dd2ff DOAP changes for release 8.11.0 2021-11-16 10:54:24 +01:00
Dawid Weiss f5e5cf008a
LUCENE-10234: Add automatic module name to JAR manifests. (#440) 2021-11-15 17:02:40 +01:00
Quentin Pradet 1e5e997880
LUCENE-10085: Rename DocValuesFieldExistsQuery test (#441)
FieldValueQuery got renamed to DocValuesFieldExistsQuery but the test
wasn't renamed.
2021-11-15 16:24:29 +01:00
Julie Tibshirani 3b914a4d73
LUCENE-10069: Document that kNN queries might not return all results (#434)
Performing a kNN search with very large k may return fewer than k documents.
This is due to the fact that the HNSW graph is not guaranteed to be connected.
This commit documents the behavior as part of a general warning that the results
of a kNN search may be approximate.
2021-11-12 14:19:20 -08:00
Julie Tibshirani 2a9adb81df LUCENE-10063: Fix score calculation in SimpleTextKnnVectorsFormat
The method VectorSimilarityFunction#convertToScore already reverses the
similarity, so we shouldn't reverse it again.
2021-11-11 11:22:03 -08:00
Dawid Weiss f725b27e12
LUCENE-10223: interval support in standard syntax parser (#429) 2021-11-11 08:54:59 +01:00
Julie Tibshirani 53586d4231
LUCENE-10228: Ensure PerFieldKnnVectorsFormat uses right format name (#432)
Before when creating a KnnVectorsWriter for merging, we consulted the existing
"PER_FIELD_SUFFIX_KEY" attribute to determine the format's per-field suffix.
This isn't correct since we could be using a new codec (that produces different
formats/ suffixes).

This commit modifies TestPerFieldDocValuesFormat#testMergeUsesNewFormat to
trigger the problem. Without the fix we it throws an error like
"java.nio.file.FileAlreadyExistsException: File
"_3_Lucene90HnswVectorsFormat_0.vem" was already written to."
2021-11-10 08:18:01 -08:00
Jim Ferenczi 94b66c0ed2
LUCENE-10208: Ensure that the minimum competitive score does not decrease in concurrent search (#431)
Co-authored-by: Adrien Grand <jpountz@gmail.com>
2021-11-09 11:04:17 +01:00
Dawid Weiss 263765a9b0 LUCENE-10226: test target creates a weird folder (lazy property). 2021-11-09 08:34:04 +01:00
Dawid Weiss ded77d8bfd LUCENE-10222: Enable github precommit check workflow on branch_9x 2021-11-05 09:04:10 +01:00
Dawid Weiss 32d7f52446
LUCENE-10220: Add an utility method to get IntervalSource from analyzed text (or token stream) (#427) 2021-11-05 08:57:48 +01:00
Dawid Weiss bec8eaef70 Add version 9.1.0 changes section on main too. 2021-11-04 15:29:31 +01:00
Dawid Weiss 4e047ab0d8 Tidy. 2021-11-04 15:21:08 +01:00
Adrien Grand ae29a3b326 Fix OOM during tests. 2021-11-04 10:46:41 +01:00
Dawid Weiss adec73dd28
LUCENE-10088: allow per-class override in HandleLimitFS. Bump the limit a bit for nightlies in TestIndexWriterMergePolicy. (#424) 2021-11-04 08:31:28 +01:00
Uwe Schindler 1ae6b2a6b9
UCENE-10218: Extend validateSourcePatterns task to scan for LTR/RTL unicode to catch "Trojan Source" source code attacks (#425)
Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
2021-11-03 17:19:24 +01:00
Adrien Grand f9be01d5cc Format javadocs of new versions in a way that Spotless is happy with. 2021-11-02 13:12:39 +01:00
Adrien Grand 1ddb01044a Fix backward-compatibility test and remove unnecessary backward compatibility. 2021-11-02 13:12:39 +01:00
Dawid Weiss 20c4a1466d Tidy. 2021-11-02 12:55:02 +01:00
Dawid Weiss a53d633bd9 LUCENE-10195: LUCENE-10195: Add gradle cache option and make some tasks
cacheable
2021-11-02 12:20:09 +01:00
Dawid Weiss d14ee2d01e Use a dumber offlineLinks map but expose more structured information to gradle. 2021-11-02 12:18:52 +01:00
Dawid Weiss dab6e8454a Add changes entry. 2021-11-02 12:18:52 +01:00
Dawid Weiss d819a2eec4 Cherry pick the validateSourcePatterns. Correct exclusion patterns (.gradle and .idea are only at the root project level). 2021-11-02 12:18:51 +01:00
Jerome Prinet d44e03b8b0 Make ratTask cacheable 2021-11-02 12:18:51 +01:00
Jerome Prinet b3e59232f5 Make checkBrokenLinks cacheable 2021-11-02 12:18:51 +01:00
Dawid Weiss 1a38cac68e LUCENE-10195: add commented-out org.gradle.caching=true to the generated local settings. 2021-11-02 12:18:51 +01:00
Adrien Grand 2a7dd4d7dc Add next major version 10.0.0 2021-11-02 11:47:19 +01:00
Adrien Grand cc2a31f2be LUCENE-10103: Move CHANGES entry to correct version. 2021-11-02 10:35:55 +01:00
Bruno Roustant 63b9e603e6
LUCENE-10196: Improve IntroSorter with 3-ways partitioning. 2021-11-01 10:55:44 +01:00