Apache
/
lucene
mirror of https://github.com/apache/lucene.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Apache Lucene open-source search software
35,914 Commits 29 Branches 469 Tags 819 MiB
Java 97.7%
HTML 1%
Python 0.9%
Lex 0.3%
Go to file
Mayya Sharipova dc6a7f9468
LUCENE-9848 Sort HNSW graph neighbors for construction (#862) 
* LUCENE-9848 Sort HNSW graph neighbors for construction

Sort HNSW graph neighbors when applying diversity criterion

During HNSW graph construction, when a node has already a number of
connections larger than maximum allowed (maxConn), we need to prune
its connections using a diversity criteria to limit the number of
connections to maxConn.

Currently when we add reverse connections to already existing nodes,
we don't keep them sorted. Thus later, when we apply diversity criteria
we may prune not the worst most distant non-diverse nodes.

This patch makes sure that neighbours connections are always sorted
from best (closest) to worst (distant), and during the application
of diversity criteria processes nodes from worst to best.

This path does the following:
- enhance NeighborArray to always keep neighbour nodes sorted according
  to their scores (in desc or asc order). Make NeighborArray aware in
  which order the nodes should be sorted.
- make OnHeapHnswGraph aware of the order of similarity function
- make HnswGraphBuilder apply diversity criteria from worst to
  best nodes
- create Lucene90NeighborArray to keep the previous logic of
  NeighborArray for Lucene90Codec
 		2022-05-04 14:15:14 -04:00
.github Allow to link to github PR from changes (#854) 2022-05-02 23:06:39 +09:00
.muse SOLR-14883 Add a Muse (Continuous assurance platform) configuration (#1901) 2020-09-23 17:42:19 -07:00
buildSrc fail clearly on too-new JDK (#819) 2022-04-21 09:22:26 -04:00
dev-docs Add documentation on file formats. (#598) 2022-01-11 15:16:05 +01:00
dev-tools Add release wizard step around build failures (#789) 2022-04-06 14:03:52 -07:00
gradle Allow to link to github PR from changes (#854) 2022-05-02 23:06:39 +09:00
help LUCENE-10528: use Xvfb in test to avoid messing up user's desktop (#828) 2022-04-23 08:00:33 -04:00
lucene LUCENE-9848 Sort HNSW graph neighbors for construction (#862) 2022-05-04 14:15:14 -04:00
.asf.yaml titles for github 2021-03-10 12:51:06 +01:00
.dir-locals.el LUCENE-9322: Add Lucene90 codec, including VectorFormat 2020-10-18 07:49:36 -04:00
.git-blame-ignore-revs LUCENE-9570: code reformatting [record rev]. 2021-01-05 13:44:42 +01:00
.gitattributes LUCENE-10305: Ensure line endings of versions.props is LF 2021-12-11 10:10:44 +09:00
.gitignore LUCENE-9920: Remove binary gradle-wrapper.jar from the repository 2021-04-10 16:08:39 +02:00
.hgignore LUCENE-2792: add FST impl 2010-12-12 15:36:08 +00:00
CONTRIBUTING.md LUCENE-10524 Add benchmark suite details to CONTRIBUTING.md (#853) 2022-05-03 12:53:20 +09:00
LICENSE.txt LUCENE-10163 Move LICENSE and NOTICE file to top level (#388) 2021-10-18 01:24:11 +02:00
NOTICE.txt LUCENE-10416: Update Korean Dictionary to mecab-ko-dic-2.1.1-20180720 for Nori 2022-02-20 21:39:03 +09:00
README.md Fix incorrect docs in README.md: it must be java 17 exactly, java 18 does not work (#818) 2022-04-20 11:07:24 -04:00
build.gradle LUCENE-10535: upgrade com.palantir.consistent-versions to 2.10.0 2022-04-26 08:31:15 +02:00
gradlew fail clearly on too-new JDK (#819) 2022-04-21 09:22:26 -04:00
gradlew.bat Fix JVM error branch logic. (#835) 2022-04-25 14:33:56 +02:00
settings.gradle LUCENE-10328: Module path for compiling and running tests is wrong (#571) 2022-01-05 20:42:02 +01:00
versions.lock LUCENE-8930: script testing in the distribution (#550) 2022-01-20 00:09:15 +09:00
versions.props LUCENE-8930: script testing in the distribution (#550) 2022-01-20 00:09:15 +09:00

README.md

Apache Lucene

Lucene Logo

Apache Lucene is a high-performance, full-featured text search engine library written in Java.

Build Status

Online Documentation

This README file only contains basic setup instructions. For more comprehensive documentation, visit:

Building

Basic steps:

  1. Install OpenJDK 17 (exactly this version).
  2. Clone Lucene's git repository (or download the source distribution).
  3. Run gradle launcher script (gradlew).

We'll assume that you know how to get and set up the JDK - if you don't, then we suggest starting at https://jdk.java.net/ and learning more about Java, before returning to this README.

See Contributing Guide for details.

Contributing

Bug fixes, improvements and new features are always welcome! Please review the Contributing to Lucene Guide for information on contributing.

Discussion and Support