Commit Graph

35 Commits

Author SHA1 Message Date
Heemin Kim cc5c60393d
Add documentation for nested search in knn (#6237)
* Add documentation for nested search in knn

Signed-off-by: Heemin Kim <heemin@amazon.com>

* Doc review

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Heemin Kim <heemin@amazon.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2024-02-01 11:08:20 -08:00
Junqiu Lei 80fbd210a1
Updated k-NN lucene engine dimension max count to 16k (#5875)
* Updated k-NN lucene engine dimension max count to 16k

Signed-off-by: Junqiu Lei <junqiu@amazon.com>

* Update _search-plugins/knn/approximate-knn.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Junqiu Lei <junqiu@amazon.com>

* Update _search-plugins/knn/approximate-knn.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Junqiu Lei <junqiu@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2024-02-01 11:03:01 -08:00
kolchfa-aws a258d7951a
Correct heading level for approximate k-NN (#6239)
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2024-01-22 15:45:32 -05:00
kolchfa-aws 247d88814a
Update approximate-knn.md (#6030)
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
2024-01-02 19:43:42 -05:00
Madhan 3ccd28064e
Update approximate-knn.md (#6011)
* Update approximate-knn.md

Updated a sentence.

Signed-off-by: Madhan <45423614+madhankb@users.noreply.github.com>

* Update _search-plugins/knn/approximate-knn.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Madhan <45423614+madhankb@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2024-01-02 19:20:14 -05:00
kolchfa-aws f999e0a8a8
Add an overview of search methods and pages for each search method (#5636)
* Restructuring TOC

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Resolve merge conflicts

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* More foundational rewrites of ML

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* TOC restructure

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rename and rewrite search pages and add keyword search

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Small wording change

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Small wording change

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Updated response

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Small rewording

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Move neural search to top of vector search list

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Change terminology

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Reorganize search methods list

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rename links

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* More link renames

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-11-29 15:28:20 -05:00
kolchfa-aws 6bece563ea
Add k-NN vector field type (#4850)
* Add k-NN vector field type

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rename topic

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-08-22 13:27:31 -04:00
kolchfa-aws 6c83dfd87c
Add k-NN Faiss filtering documentation (#4476)
* Add k-NN Faiss filtering documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Move the note

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add faiss and a filter table

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Refactor boolean filtering section

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Clarified that Faiss works with hnsw only

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add more Faiss filtering information

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _search-plugins/knn/filter-search-knn.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented one more editorial comment

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-07-18 10:57:53 -04:00
Seyed Alireza Fatemi Jahromi 8d394f5726
[Doc] Fix cosinesimil OpenSearch Score and Distance Function formula (#4138) (#4139)
Signed-off-by: Alireza Fatemi <seyedalirezafatemijahromi@gmail.com>
2023-05-25 12:45:55 -04:00
kolchfa-aws ade705e9f5
Refactor k-NN filter search (#3613)
* Refactor k-NN filter search

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented doc review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>

* One more editorial review comment

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-04-05 10:30:24 -04:00
kolchfa-aws 4a46a24abf
Fix an error in building an index from a model (#3615)
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-03-29 16:01:57 -04:00
Caroline 5d2deede9e
Update vector size in Approximate KNN doc (#3515)
* Updated vector size.

Signed-off-by: carolxob <carolxob@amazon.com>

* Incorporated feedback.

Signed-off-by: carolxob <carolxob@amazon.com>

* Minor edits.

Signed-off-by: carolxob <carolxob@amazon.com>

* Minor update.

Signed-off-by: carolxob <carolxob@amazon.com>

* Minor edits for accuracy and clarity.

Signed-off-by: carolxob <carolxob@amazon.com>

* Update _search-plugins/knn/approximate-knn.md

Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: carolxob <carolxob@amazon.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
2023-03-20 10:34:21 -06:00
kolchfa-aws 0f44dc3a9e
Remove GPU reference from approximate k-NN (#3263)
* Remove GPU reference from approximate k-NN

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Incorporated tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-03-16 11:50:23 -04:00
Yi-Lin Tsai a2f3890754
format JSON. (#2870) 2023-02-23 10:36:45 -06:00
Mauricio Scheffer 2320a4b281
Fix description of cosinesimil distance function (#2214)
Signed-off-by: Mauricio Scheffer <mauricioscheffer@gmail.com>

Signed-off-by: Mauricio Scheffer <mauricioscheffer@gmail.com>
2022-12-16 13:22:32 -06:00
Alice Williams 253ae34bd8
Search with k-NN filters (#1814)
* new file for knn filter searches

Signed-off-by: alicejw <alicejw@amazon.com>

* for knn filter queries

Signed-off-by: alicejw <alicejw@amazon.com>

* more details and include graphic

Signed-off-by: alicejw <alicejw@amazon.com>

* add graph of filtered doc set

Signed-off-by: alicejw <alicejw@amazon.com>

* add release label

Signed-off-by: alicejw <alicejw@amazon.com>

* filters are defined by Query DSL

Signed-off-by: alicejw <alicejw@amazon.com>

* more details about how the algorithm works and how to specify lucene as the search engine

Signed-off-by: alicejw <alicejw@amazon.com>

* more refining sentences

Signed-off-by: alicejw <alicejw@amazon.com>

* for response samples

Signed-off-by: alicejw <alicejw@amazon.com>

* reorg heading levels

Signed-off-by: alicejw <alicejw@amazon.com>

* more rewrites for clarity

Signed-off-by: alicejw <alicejw@amazon.com>

* to add the complex filter query

Signed-off-by: alicejw <alicejw@amazon.com>

* update response for complex query

Signed-off-by: alicejw <alicejw@amazon.com>

* for typo

Signed-off-by: alicejw <alicejw@amazon.com>

* for rewrites to overview

Signed-off-by: alicejw <alicejw@amazon.com>

* to add better request/response for the complex filter example

Signed-off-by: alicejw <alicejw@amazon.com>

* for eng review update

Signed-off-by: alicejw <alicejw@amazon.com>

* format fix for example

Signed-off-by: alicejw <alicejw@amazon.com>

* for filter selectiveness use case section

Signed-off-by: alicejw <alicejw@amazon.com>

* for new workflow diagram and description

Signed-off-by: alicejw <alicejw@amazon.com>

* update section headings

Signed-off-by: alicejw <alicejw@amazon.com>

* add image for algorithm workflow diagram

Signed-off-by: alicejw <alicejw@amazon.com>

* reorg sections to make more concise

Signed-off-by: alicejw <alicejw@amazon.com>

* explain selectiveness percentage

Signed-off-by: alicejw <alicejw@amazon.com>

* more rewrites to complex query description

Signed-off-by: alicejw <alicejw@amazon.com>

* define complex query

Signed-off-by: alicejw <alicejw@amazon.com>

* more rewrites

Signed-off-by: alicejw <alicejw@amazon.com>

* for tech review feedback and add new information

Signed-off-by: alicejw <alicejw@amazon.com>

* to blend new Boolean query example into filter approaches section

Signed-off-by: alicejw <alicejw@amazon.com>

* for complex query description clarity

Signed-off-by: alicejw <alicejw@amazon.com>

* more rewrites

Signed-off-by: alicejw <alicejw@amazon.com>

* typo

Signed-off-by: alicejw <alicejw@amazon.com>

* eng review updates

Signed-off-by: alicejw <alicejw@amazon.com>

* nit for grammar

Signed-off-by: alicejw <alicejw@amazon.com>

* to fix incorrect descriptions of restrictive filters

Signed-off-by: alicejw <alicejw@amazon.com>

* to fix incorrect descriptions of restrictive filters

Signed-off-by: alicejw <alicejw@amazon.com>

* for doc review feedback updates

Signed-off-by: alicejw <alicejw@amazon.com>

* minor grammar change

Signed-off-by: alicejw <alicejw@amazon.com>

* removed figure and table titles, per AWS Style Guide

Signed-off-by: alicejw <alicejw@amazon.com>

* remove table title per style guide

Signed-off-by: alicejw <alicejw@amazon.com>

* update nav orders for all pages to give space for new topics in multiples of 5, and add links to other knn topics where appropriate

Signed-off-by: alicejw <alicejw@amazon.com>

* small rewrite

Signed-off-by: alicejw <alicejw@amazon.com>

* for second doc review comments

Signed-off-by: alicejw <alicejw@amazon.com>

* Update _search-plugins/knn/filter-search-knn.md

Co-authored-by: Nate Bower <nbower@amazon.com>

* Update _search-plugins/knn/filter-search-knn.md

Co-authored-by: Nate Bower <nbower@amazon.com>

* for editorial review updates

Signed-off-by: alicejw <alicejw@amazon.com>

* for editorial review updates

Signed-off-by: alicejw <alicejw@amazon.com>

* fix cross-ref link

Signed-off-by: alicejw <alicejw@amazon.com>

* fix undone commit suggestions

Signed-off-by: alicejw <alicejw@amazon.com>

Signed-off-by: alicejw <alicejw@amazon.com>
Co-authored-by: Nate Bower <nbower@amazon.com>
2022-11-11 11:23:45 -08:00
kolchfa-aws 2c7494309a
Fixed KNN search formulas (#1447)
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2022-10-05 16:40:50 -04:00
cwillum b6bcce916c
“fixfor#791_k-NN-ANN” (#837)
* “fixfor#791_k-NN-ANN”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fixfor#791_k-NN-ANN”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fixfor#791_k-NN-ANN”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fix#829-PreAgg-field_doc_count”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fix#829-PreAgg-field_doc_count”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fixfor#791_k-NN-ANN”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fixfor#791_k-NN-ANN”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fixfor#791_k-NN-ANN”

Signed-off-by: cwillum <cwmmoore@amazon.com>

* “fixfor#791_k-NN-ANN”

Signed-off-by: cwillum <cwmmoore@amazon.com>

Signed-off-by: cwillum <cwmmoore@amazon.com>
2022-08-11 16:07:03 -04:00
keithhc2 10d0c8efbd Fixed endpoint
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-03-14 13:42:56 -07:00
keithhc2 789c1e921d Language tweaks
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-01-25 14:54:58 -08:00
Keith Chan eecaeab15f
Merge branch 'main' into index-apis 2022-01-06 11:28:06 -08:00
keithhc2 a6a6cf1965 Perhaps this will fix the conflict
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-01-06 11:23:30 -08:00
keithhc2 8177d12233 Fixed Lucene link
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-01-06 11:12:08 -08:00
John Mazanec 066efc1e15 Complete v1 of faiss feature docs
Signed-off-by: John Mazanec <jmazane@amazon.com>
2021-11-16 15:08:02 -08:00
aetter 211da242d6 Update approximate-knn.md 2021-10-19 11:42:46 -07:00
aetter ecea83707d Adds Lucene version variable, minor improvements to REST API and query DSL 2021-09-01 11:37:54 -07:00
aetter 6f32dce469 Merge branch 'main' into remove-redirects 2021-08-12 14:50:28 -07:00
Miki 634db90e9b Link checker plugin and some fixes to URLs
Signed-off-by: Miki <mehranb@amazon.com>
2021-08-12 14:45:04 -07:00
aetter 0d58bcf854 Remove outdated redirects 2021-08-12 14:34:31 -07:00
Miki ba5bfa429f Fix paths in `redirect_from` data
Signed-off-by: Miki <mehranb@amazon.com>
2021-08-04 11:16:37 -07:00
aetter 9ea68d488a No more relative links 2021-06-09 19:15:41 -07:00
aetter ce0ebe1948 Redirects for the plugins 2021-05-28 15:20:24 -07:00
aetter fc998e3956 Merge branch 'main' into layout-changes 2021-05-28 13:54:29 -07:00
aetter 2f8ef915a7 Merge KNN changes 2021-05-28 12:52:57 -07:00
aetter 264a950b6c More top-level sections 2021-05-28 12:43:12 -07:00