OpenSearch/docs/reference/analysis/tokenizers
Andrei Balici 19a336e8d3 Add `max_token_length` setting to the CharGroupTokenizer (#56860)
Adds `max_token_length` option to the CharGroupTokenizer.
Updates documentation as well to reflect the changes.

Closes #56676
2020-05-20 14:28:40 +02:00
..
chargroup-tokenizer.asciidoc Add `max_token_length` setting to the CharGroupTokenizer (#56860) 2020-05-20 14:28:40 +02:00
classic-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
edgengram-tokenizer.asciidoc [DOCS] Fix edge n-gram tokenizer nav 2019-11-22 15:54:07 -05:00
keyword-tokenizer.asciidoc [DOCS] Add a lowercase email example to keyword tokenizer docs (#53257) 2020-03-30 09:06:04 -04:00
letter-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
lowercase-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
ngram-tokenizer.asciidoc [DOCS] Reformat n-gram token filter docs (#49438) 2019-11-22 10:38:50 -05:00
pathhierarchy-tokenizer-examples.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
pathhierarchy-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
pattern-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
simplepattern-tokenizer.asciidoc Removes old Lucene's experimental flag from analyzer documentations (#53217) 2020-03-12 21:18:19 +01:00
simplepatternsplit-tokenizer.asciidoc Removes old Lucene's experimental flag from analyzer documentations (#53217) 2020-03-12 21:18:19 +01:00
standard-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
thai-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
uaxurlemail-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00
whitespace-tokenizer.asciidoc [DOCS] [2 of 5] Change // CONSOLE comments to [source,console] (#46353) (#46502) 2019-09-09 13:38:14 -04:00