afeb360679
Add cross-encoder models and refactor pretrained model section ( #6507 )
...
* Add cross-encoder models to pretrained section and refactor the section
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Fix link
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add model task type parameter options
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Update _ml-commons-plugin/custom-local-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2024-02-28 16:28:42 -05:00
76c2ed03fc
Add unsupported warning for local models ( #6489 )
...
* Add unsupported warning for local models
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Reword to be more generic
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2024-02-23 14:45:25 -05:00
3f7468b504
Add agent framework/throttling/hidden model/OS assistant and update conversational search documentation ( #6354 )
...
* Add agent framework documentation
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add hidden model and API updates
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Vale error
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Updated field names
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add updating credentials
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added tools table
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add OpenSearch forum thread for OS Assistant
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add tech review for conv search
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Fix links
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add tools
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add links to tools
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* More info about tools
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Tool parameters
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Update cat-index-tool.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Parameter clarification
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Tech review feedback
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Typo fix
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* More tech review feedback: RAG tool
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Tech review feedback: memory APis
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Update _ml-commons-plugin/agents-tools/index.md
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/agents-tools/tools/neural-sparse-tool.md
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/agents-tools/tools/neural-sparse-tool.md
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/agents-tools/tools/neural-sparse-tool.md
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/opensearch-assistant.md
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/agents-tools/tools/ppl-tool.md
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Separated search and get APIs and add conversational flow agent
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* More parameters for PPL tool
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added more parameters
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Tech review feedback: PPL tool
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Rename to automating configurations
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Editorial comments on the new text
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add parameter to PPl tool
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Changed link to configurations
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Rate limiter feedback and added warning
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2024-02-20 12:09:31 -05:00
e76ec7c0c7
Add cross-encoder model documentation ( #6357 )
...
* Add cross-ranking model documentation
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Model id format
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Move to custom models
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Update _search-plugins/search-relevance/reranking-search-results.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/custom-local-models.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Tech review and doc review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2024-02-16 08:44:29 -05:00
e893208cb9
Fix link to all-MiniLM-L12-v2 Torch model config - use Torch config file rather than ONNX ( #6227 )
...
Signed-off-by: Arran Dengate <arran@netapp.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
2024-01-19 10:11:13 -05:00
10c55354d2
Update sparse encoding models for 2.11.1 ( #5841 )
...
* Update sparse encoding models for 2.11.1
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Rewording
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Updated model URLs
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change model version to 1.0.2 and remove duplicate table line
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-12-13 12:37:23 -05:00
d943297d3a
Update version for MS Marco Distilbert model ( #5795 )
...
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-12-05 18:19:19 -05:00
47204cf4e8
Add model redeploy tip ( #5764 )
...
* Add model redeploy tip
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change to active voice
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Fix link
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-12-01 15:48:10 -05:00
f524e6891f
Change terminology from sparse to neural sparse ( #5714 )
...
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-11-30 10:43:12 -05:00
a8bd47e07b
Add redirects from old links to ML documentation ( #5707 )
...
* Add redirects from old links to ML documentation
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Rename links
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-11-29 16:26:35 -05:00
f999e0a8a8
Add an overview of search methods and pages for each search method ( #5636 )
...
* Restructuring TOC
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Resolve merge conflicts
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* More foundational rewrites of ML
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* TOC restructure
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Rename and rewrite search pages and add keyword search
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Small wording change
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Small wording change
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Updated response
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Small rewording
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Move neural search to top of vector search list
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change terminology
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Reorganize search methods list
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Rename links
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* More link renames
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Implemented editorial comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-11-29 15:28:20 -05:00
826e6771ed
Refactor ML section - local and remote models ( #5609 )
...
* Refactor ML section - local and remote models
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added command to calculate checksum
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add ONNX format to register API
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add sparse encoding predict example
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add API section
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Refactor the API section
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Typo
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Implemented Vale comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add get connector API
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Reword heading
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Addressed tech review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
2023-11-17 15:59:27 -05:00
3dbcc34670
Add custom pre and post processor functions ( #5300 )
...
* Add custom pre and post processor functions
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Uniform placeholder format
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add custom pre and post processor blueprint
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add a pretrained model
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Update _ml-commons-plugin/extensibility/blueprints.md
Co-authored-by: Yaliang Wu <ylwu@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Implemented tech review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add two more models
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Specify json code highlighter
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Yaliang Wu <ylwu@amazon.com>
2023-11-08 09:30:11 -05:00
242c35db59
add pretrained model description and saving disk description ( #5383 )
...
* add description and saving disk
Signed-off-by: xinyual <xinyual@amazon.com>
* update
Signed-off-by: xinyual <xinyual@amazon.com>
* update
Signed-off-by: xinyual <xinyual@amazon.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _query-dsl/specialized/neural-sparse.md
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _search-plugins/neural-sparse-search.md
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _search-plugins/neural-sparse-search.md
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _search-plugins/neural-sparse-search.md
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Moved recommended model choice options outside the table
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add a link for more info
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-10-25 11:59:49 -04:00
abe43ce3a5
Add pretrained model information for neural sparse ( #5355 )
...
* add pretrained model for neural sparse
Signed-off-by: xinyual <xinyual@amazon.com>
* change typo error
Signed-off-by: xinyual <xinyual@amazon.com>
* Apply suggestions from code review
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/ml-framework.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/ml-framework.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _ml-commons-plugin/ml-framework.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _search-plugins/neural-sparse-search.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/ml-framework.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update pretrained-models.md
Change description and name in the sparse encoding doc model example
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
* Update _search-plugins/neural-sparse-search.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Update _ml-commons-plugin/pretrained-models.md
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
---------
Signed-off-by: xinyual <xinyual@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: xinyual <74362153+xinyual@users.noreply.github.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-10-23 09:34:09 -04:00
a97c719591
Add multimodal search/sparse search/pre- and post-processing function documentation ( #5168 )
...
* Add multimodal search documentation
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Text image embedding processor
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add prerequisite
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change query text
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added bedrock connector tutorial and renamed ML TOC
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Name changes and rewording
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change connector link
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change link
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Implemented tech review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Link fix and field name fix
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add default text embedding preprocessing and post-processing functions
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add sparse search documentation
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Fix links
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Pre/post processing function tech review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Fix link
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Sparse search tech review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Implemented doc review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add actual test sparse pipeline response
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added tested examples
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added model choice for sparse search
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Remove Bedrock connector
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Implemented tech review feedback
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add that the model must be deployed to neural search
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Link fix
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add session token to sagemaker blueprint
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Formatted bullet points the same way
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Specified both model types in neural sparse query
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added more explanation for default pre/post-processing functions
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Remove framework and extensibility references
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Minor rewording
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-10-16 10:45:35 -04:00
f5b8ff79fd
Add score normalization and combination documentation ( #4985 )
...
* Add search phase results processor
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add hybrid query
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Normalization processor additions
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add more details
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Continue writing
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add more query then fetch details and diagram
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Small rewording
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Leaner left nav headers
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Tech review feedback
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add semantic search tutorial
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Reworded prerequisites
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Removed comma
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Rewording advanced prerequisites
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Changed searching for ML model to shorter request
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Update task type in register model response
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Changing example
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added huggingface prefix to model names
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change example responses
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added note about huggingface prefix
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Update _ml-commons-plugin/semantic-search.md
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Implemented doc review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* List weights under parameters
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Remove one-shard warning for normalization processor
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
* Implemented editorial comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change links
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* More editorial feedback
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Change model-serving framework to ML framework
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Use get model API to check model status
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Implemented tech review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Added neural search description and diagram
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* More editorial comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Add link to profile API
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Addressed more tech review comments
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Implemented editorial comments on changes
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
---------
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-22 17:29:58 -04:00
95d117ffb0
Add Connectors and ML updates for 2.9 ( #4554 )
...
* Add Connectors and ML updates for 2.9
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix code block
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add Connectors and ML updates for 2.9
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix code block
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add connector settings and examples
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add GA warning
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add final experimental warning
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Address tech review. Fix typos
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix bad link. Add next steps section
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix typo
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Update cluster-settings.md
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Apply suggestions from code review
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Apply suggestions from code review
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Apply suggestions from code review
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Update _ml-commons-plugin/connectors.md
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Change cluster values for boolean. Fix typo.
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Fix cluser settings
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add missing config options. More technical feedback.
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Adjust cluster setting description.
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add updated ChatGPT example
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add info and example for internal connector.
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* One last adjustment.
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Apply suggestions from code review
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
* Fix dead link
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix one last comment.
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* change ordered list to numbered.
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
---------
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-07-19 16:35:46 -07:00
08a4128b5d
Add auto-truncation to pretrained models ( #3756 )
...
* Add auto-truncation to pretrained models
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix review feedback
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
---------
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2023-04-13 11:21:54 -05:00
b5e4dba463
Add newly approved pre-built models ( #3444 )
...
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2023-03-13 14:34:43 -05:00
4004030bca
Add Hugging Face link to ML documentation ( #3134 )
...
* Add Hugging Face link to ML documentation
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix links
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Fix a couple more links
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
---------
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2023-03-03 10:22:53 -06:00
ffac9d794a
Add 2.6 prebuilt models to Machine Learning ( #2988 )
...
* Add 2.6 prebuilt models
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add supported prebuilt models
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Quick formatting tweak
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add Jeff's feedback
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add some light editorial feedback
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
* Update _ml-commons-plugin/pretrained-models.md
Co-authored-by: Nathan Bower <nbower@amazon.com>
* Add editorial feedback
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add experimental label. Use same as model-serving framework
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add example API call
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Add one last piece of feedback
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
---------
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-02-28 13:02:30 -06:00
kolchfa-aws
Arran Dengate
xinyual
Naarcha-AWS