76c2ed03fc
* Add unsupported warning for local models Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> * Reword to be more generic Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> --------- Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
28 lines
1.3 KiB
Markdown
28 lines
1.3 KiB
Markdown
---
|
|
layout: default
|
|
title: Using ML models within OpenSearch
|
|
parent: Integrating ML models
|
|
has_children: true
|
|
nav_order: 50
|
|
redirect_from:
|
|
- /ml-commons-plugin/model-serving-framework/
|
|
- /ml-commons-plugin/ml-framework/
|
|
---
|
|
|
|
# Using ML models within OpenSearch
|
|
**Generally available 2.9**
|
|
{: .label .label-purple }
|
|
|
|
To integrate machine learning (ML) models into your OpenSearch cluster, you can upload and serve them locally. Choose one of the following options:
|
|
|
|
- **Pretrained models provided by OpenSearch**: To learn more, see [OpenSearch-provided pretrained models]({{site.url}}{{site.baseurl}}/ml-commons-plugin/pretrained-models/). For a list of supported models, see [Supported pretrained models]({{site.url}}{{site.baseurl}}/ml-commons-plugin/pretrained-models/#supported-pretrained-models).
|
|
|
|
- **Custom models** such as PyTorch deep learning models: To learn more, see [Custom models]({{site.url}}{{site.baseurl}}/ml-commons-plugin/custom-local-models/).
|
|
|
|
Running local models on the CentOS 7 operating system is not supported. Moreover, not all local models can run on all hardware and operating systems.
|
|
{: .important}
|
|
|
|
## GPU acceleration
|
|
|
|
For better performance, you can take advantage of GPU acceleration on your ML node. For more information, see [GPU acceleration]({{site.url}}{{site.baseurl}}/ml-commons-plugin/gpu-acceleration/).
|