mirror of
https://github.com/honeymoose/OpenSearch.git
synced 2025-02-06 04:58:50 +00:00
c6b73239ae
Add an index level setting `index.analyze.max_token_count` to control the number of generated tokens in the _analyze endpoint. Defaults to 10000. Throw an error if the number of generated tokens exceeds this limit. Closes #27038
15 lines
595 B
Plaintext
15 lines
595 B
Plaintext
[[breaking_70_analysis_changes]]
|
|
=== Analysis changes
|
|
|
|
==== The `delimited_payload_filter` is renamed
|
|
|
|
The `delimited_payload_filter` is renamed to `delimited_payload`, the old name is
|
|
deprecated and will be removed at some point, so it should be replaced by
|
|
`delimited_payload`.
|
|
|
|
|
|
==== Limiting the number of tokens produced by _analyze
|
|
|
|
To safeguard against out of memory errors, the number of tokens that can be produced
|
|
using the `_analyze` endpoint has been limited to 10000. This default limit can be changed
|
|
for a particular index with the index setting `index.analyze.max_token_count`. |