mirror of https://github.com/apache/lucene.git
SOLR-14295: Add the parameter description about 'discardCompoundToken' for JapaneseTokenizer in RefGuide
This commit is contained in:
parent
c929b65c81
commit
5f9bf6b707
|
@ -1869,6 +1869,8 @@ For some applications it might be good to use `search` mode for indexing and `no
|
|||
|
||||
`discardPunctuation`:: set to `false` to keep punctuation, `true` to discard (the default)
|
||||
|
||||
`discardCompoundToken`:: set to `false` to keep original compound tokens with the `search` mode, `true` to discard.
|
||||
|
||||
==== Japanese Base Form Filter
|
||||
|
||||
Replaces original terms' text with the corresponding base form (lemma). (`JapaneseTokenizer` annotates each term with its base form.)
|
||||
|
|
Loading…
Reference in New Issue