mirror of
https://github.com/honeymoose/OpenSearch.git
synced 2025-02-09 06:25:07 +00:00
[DOCS] Add doc for delimited payload token filter
This commit is contained in:
parent
719d1e0318
commit
c3ab79a10e
@ -69,3 +69,4 @@ include::tokenfilters/common-grams-tokenfilter.asciidoc[]
|
|||||||
|
|
||||||
include::tokenfilters/normalization-tokenfilter.asciidoc[]
|
include::tokenfilters/normalization-tokenfilter.asciidoc[]
|
||||||
|
|
||||||
|
include::tokenfilters/delimited-payload-tokenfilter.asciidoc[]
|
||||||
|
@ -0,0 +1,16 @@
|
|||||||
|
[[analysis-delimited-payload-tokenfilter]]
|
||||||
|
=== Delimited Payload Token Filter
|
||||||
|
|
||||||
|
Named `delimited_payload_filter`. Splits tokens into tokens and payload whenever a delimiter character is found.
|
||||||
|
|
||||||
|
Example: "the|1 quick|2 fox|3" is split per default int to tokens `fox`, `quick` and `the` with payloads `1`, `2` and `3` respectively.
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
Parameters:
|
||||||
|
|
||||||
|
`delimiter`::
|
||||||
|
Character used for splitting the tokens. Default is `|`.
|
||||||
|
|
||||||
|
`encoding`::
|
||||||
|
The type of the payload. `int` for integer, `float` for float and `identity` for characters. Default is `float`.
|
Loading…
x
Reference in New Issue
Block a user