SOLR-14295: Add the parameter description about 'discardCompoundToken' for JapaneseTokenizer in RefGuide

This commit is contained in:
Tomoko Uchida 2020-02-29 17:43:25 +09:00
parent c929b65c81
commit 5f9bf6b707
1 changed files with 2 additions and 0 deletions

View File

@ -1869,6 +1869,8 @@ For some applications it might be good to use `search` mode for indexing and `no
`discardPunctuation`:: set to `false` to keep punctuation, `true` to discard (the default)
`discardCompoundToken`:: set to `false` to keep original compound tokens with the `search` mode, `true` to discard.
==== Japanese Base Form Filter
Replaces original terms' text with the corresponding base form (lemma). (`JapaneseTokenizer` annotates each term with its base form.)