Apache
/
lucene
mirror of https://github.com/apache/lucene.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
35,477 Commits 27 Branches 467 Tags 738 MiB
Commit Graph

35477 Commits

Author SHA1 Message Date
Julie Tibshirani 3b914a4d73
LUCENE-10069: Document that kNN queries might not return all results (#434) 
Performing a kNN search with very large k may return fewer than k documents.
This is due to the fact that the HNSW graph is not guaranteed to be connected.
This commit documents the behavior as part of a general warning that the results
of a kNN search may be approximate.
 2021-11-12 14:19:20 -08:00
Julie Tibshirani 2a9adb81df LUCENE-10063: Fix score calculation in SimpleTextKnnVectorsFormat 
The method VectorSimilarityFunction#convertToScore already reverses the
similarity, so we shouldn't reverse it again.
 2021-11-11 11:22:03 -08:00
Dawid Weiss f725b27e12
LUCENE-10223: interval support in standard syntax parser (#429) 2021-11-11 08:54:59 +01:00
Julie Tibshirani 53586d4231
LUCENE-10228: Ensure PerFieldKnnVectorsFormat uses right format name (#432) 
Before when creating a KnnVectorsWriter for merging, we consulted the existing
"PER_FIELD_SUFFIX_KEY" attribute to determine the format's per-field suffix.
This isn't correct since we could be using a new codec (that produces different
formats/ suffixes).

This commit modifies TestPerFieldDocValuesFormat#testMergeUsesNewFormat to
trigger the problem. Without the fix we it throws an error like
"java.nio.file.FileAlreadyExistsException: File
"_3_Lucene90HnswVectorsFormat_0.vem" was already written to."
 2021-11-10 08:18:01 -08:00
Jim Ferenczi 94b66c0ed2
LUCENE-10208: Ensure that the minimum competitive score does not decrease in concurrent search (#431) 
Co-authored-by: Adrien Grand <jpountz@gmail.com>
 2021-11-09 11:04:17 +01:00
Dawid Weiss 263765a9b0 LUCENE-10226: test target creates a weird folder (lazy property). 2021-11-09 08:34:04 +01:00
Dawid Weiss ded77d8bfd LUCENE-10222: Enable github precommit check workflow on branch_9x 2021-11-05 09:04:10 +01:00
Dawid Weiss 32d7f52446
LUCENE-10220: Add an utility method to get IntervalSource from analyzed text (or token stream) (#427) 2021-11-05 08:57:48 +01:00
Dawid Weiss bec8eaef70 Add version 9.1.0 changes section on main too. 2021-11-04 15:29:31 +01:00
Dawid Weiss 4e047ab0d8 Tidy. 2021-11-04 15:21:08 +01:00
Adrien Grand ae29a3b326 Fix OOM during tests. 2021-11-04 10:46:41 +01:00
Dawid Weiss adec73dd28
LUCENE-10088: allow per-class override in HandleLimitFS. Bump the limit a bit for nightlies in TestIndexWriterMergePolicy. (#424) 2021-11-04 08:31:28 +01:00
Uwe Schindler 1ae6b2a6b9
UCENE-10218: Extend validateSourcePatterns task to scan for LTR/RTL unicode to catch "Trojan Source" source code attacks (#425) 
Co-authored-by: Dawid Weiss <dawid.weiss@carrotsearch.com>
 2021-11-03 17:19:24 +01:00
Adrien Grand f9be01d5cc Format javadocs of new versions in a way that Spotless is happy with. 2021-11-02 13:12:39 +01:00
Adrien Grand 1ddb01044a Fix backward-compatibility test and remove unnecessary backward compatibility. 2021-11-02 13:12:39 +01:00
Dawid Weiss 20c4a1466d Tidy. 2021-11-02 12:55:02 +01:00
Dawid Weiss a53d633bd9 LUCENE-10195: LUCENE-10195: Add gradle cache option and make some tasks 
cacheable
 2021-11-02 12:20:09 +01:00
Dawid Weiss d14ee2d01e Use a dumber offlineLinks map but expose more structured information to gradle. 2021-11-02 12:18:52 +01:00
Dawid Weiss dab6e8454a Add changes entry. 2021-11-02 12:18:52 +01:00
Dawid Weiss d819a2eec4 Cherry pick the validateSourcePatterns. Correct exclusion patterns (.gradle and .idea are only at the root project level). 2021-11-02 12:18:51 +01:00
Jerome Prinet d44e03b8b0 Make ratTask cacheable 2021-11-02 12:18:51 +01:00
Jerome Prinet b3e59232f5 Make checkBrokenLinks cacheable 2021-11-02 12:18:51 +01:00
Dawid Weiss 1a38cac68e LUCENE-10195: add commented-out org.gradle.caching=true to the generated local settings. 2021-11-02 12:18:51 +01:00
Adrien Grand 2a7dd4d7dc Add next major version 10.0.0 2021-11-02 11:47:19 +01:00
Adrien Grand cc2a31f2be LUCENE-10103: Move CHANGES entry to correct version. 2021-11-02 10:35:55 +01:00
Bruno Roustant 63b9e603e6
LUCENE-10196: Improve IntroSorter with 3-ways partitioning. 2021-11-01 10:55:44 +01:00
Dawid Weiss 0544819b78
LUCENE-10200: store git revision in the release folder and read it back from buildAndPushRelease (#419) 2021-11-01 09:29:06 +01:00
Dawid Weiss 1d152c5f67 LUCENE-10192: drop jars from binary distribution and an aggregate merge of related minor tasks. 2021-10-31 10:50:11 +01:00
Dawid Weiss 98b17952f9 LUCENE-10213: Use unicode escapes in message property files in Luke (remove hacks) 2021-10-31 10:41:54 +01:00
Dawid Weiss ded915b29b LUCENE-10192: Use modules instead of classpath for binary distribution testing. 2021-10-31 10:41:49 +01:00
Dawid Weiss 01839da593 LUCENE-10192: Adjust checks to the new binary file structure. 2021-10-31 10:41:42 +01:00
Dawid Weiss d23f37d02d LUCENE-10200: The branch does not have to be on origin remote. Replace this logic with a check whether the branch is up to date with the remote. 2021-10-31 10:41:32 +01:00
Dawid Weiss 6d8ea58ccd LUCENE-10200: Rename pddl-10.txt to reference glove. 2021-10-31 10:41:16 +01:00
Dawid Weiss 7f7007966e LUCENE-10192: No need for hacky classpath, add the log4j module to the root set. Automatic modules have access to all other modules by default. 2021-10-31 10:41:10 +01:00
Dawid Weiss 627ef4d469 LUCENE-9978: Integrate Luke with the binary release package. 2021-10-31 10:40:51 +01:00
Dawid Weiss 39d388330c LUCENE-10192: Move the test framework to a separate top-level folder. I'm not even sure it really needs to be in the binary distribution but it is distinctively different from the rest of the modules. 2021-10-31 10:40:45 +01:00
Dawid Weiss fda47a24f8 LUCENE-10192: Flatten the modules into a single jar folder to allow --module-path to be used. So much simpler.' 2021-10-31 10:40:23 +01:00
Dawid Weiss bcdfc4c8c9 LUCENE-10192: drop third party jars from the binary distribution. 2021-10-31 10:36:33 +01:00
Michael Sokolov 84a4797d14 Apply query score conversion to vector similarities in SimpleTextKnnVectorReader 2021-10-30 21:26:17 -04:00
David Smiley c2c215d3a8
LUCENE-10201: Upgrade Spatial4j to 0.8 (#409) 
Upgrading Spatial4j to 0.8 improving a varitety of minor things.
See release notes:
https://github.com/locationtech/spatial4j/releases/tag/spatial4j-0.8

Test-only dependency on JTS is upgraded to 1.17 as well
 2021-10-29 22:01:52 -04:00
Mike Drob 23256a30fa
Replace deprecated Gradle 7.2 properties (#417) 2021-10-29 09:59:47 -05:00
Adrien Grand 53b40e0fb7 LUCENE-10145: Revert change to computeMinMax. 
This part of the change would call `ArrayUtil#getUnsignedComparator` on a
length that is rarely 4 or 8. In such cases it's better to use
`Arrays#compareUnsigned`.
 2021-10-28 16:29:05 +02:00
Mike McCandless 512cad0e01 LUCENE-9673: fix IntBlockPool's slice allocator to actually grow properly with larger and larger slice-chained int[]; excise wasted RAM due to unused (overallocation) of int[] to track in-memory postings 2021-10-28 09:37:36 -04:00
Dawid Weiss 727c6b1e0b LUCENE-10209: Temporarily comment out gradle validation. 2021-10-27 21:12:14 +02:00
Dawid Weiss 62eb9a809e LUCENE-10200: remove unused dangling license exclusions. Add references to the remaining ones. 2021-10-27 20:40:39 +02:00
Julie Tibshirani abd5ec4ff0
LUCENE-9614: Fix KnnVectorQuery failure when numDocs is 0 (#413) 
When the reader has no live docs, `KnnVectorQuery` can error out. This happens
because `IndexReader#numDocs` is 0, and we end up passing an illegal value of
`k = 0` to the search method.

This commit removes the problematic optimization in `KnnVectorQuery` and
replaces with a lower-level based on the total number of vectors in the segment.
 2021-10-27 11:08:47 -07:00
Nik Everett 941df98c3f
LUCENE-10206 Implement O(1) count on query cache (#415) 
When we load a query into the query cache we always calculate the count
of matching documents. This uses that count to power the new `O(1)`
`Weight#count` method.
 2021-10-27 10:20:10 +02:00
Dawid Weiss 1613355149 LUCENE-10163: update smoke tester - README inside lucene/ is no longer there in the source release. 2021-10-26 21:58:20 +02:00
Dawid Weiss 4329450392 LUCENE-10198: remove debug statement that crept in. 2021-10-26 21:33:19 +02:00
Dawid Weiss fb6aaa7b2c
LUCENE-10199: drop binary .zip artifact. (#407) 2021-10-26 21:21:30 +02:00