OpenSearch/plugins/analysis-kuromoji/src
Jim Ferenczi fe2a7523ec Add support for inlined user dictionary in the Kuromoji plugin (#45489)
This change adds a new option called user_dictionary_rules to
Kuromoji's tokenizer. It can be used to set additional tokenization rules
to the Japanese tokenizer directly in the settings (instead of using a file).
This commit also adds a check that no rules are duplicated since this is not allowed
in the UserDictionary.

Closes #25343
2019-08-21 16:28:30 +02:00
..
main/java/org/elasticsearch Add support for inlined user dictionary in the Kuromoji plugin (#45489) 2019-08-21 16:28:30 +02:00
test Add support for inlined user dictionary in the Kuromoji plugin (#45489) 2019-08-21 16:28:30 +02:00