2011-10-05 16:21:59 -04:00
|
|
|
Apache Solr Language Identifier
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Introduction
|
|
|
|
|
------------
|
|
|
|
|
This module is intended to be used while indexing documents.
|
|
|
|
|
It is implemented as an UpdateProcessor to be placed in an UpdateChain.
|
|
|
|
|
Its purpose is to identify language from documents and tag the document with language code.
|
|
|
|
|
The module can optionally map field names to their language specific counterpart,
|
|
|
|
|
e.g. if the input is "title" and language is detected as "en", map to "title_en".
|
|
|
|
|
Language may be detected globally for the document, and/or individually per field.
|
2012-04-08 19:05:52 -04:00
|
|
|
Language detector implementations are pluggable.
|
2011-10-05 16:21:59 -04:00
|
|
|
|
|
|
|
|
Getting Started
|
|
|
|
|
---------------
|
|
|
|
|
Please refer to the module documentation at http://wiki.apache.org/solr/LanguageDetection
|
|
|
|
|
|
|
|
|
|
Dependencies
|
|
|
|
|
------------
|
2012-04-08 19:05:52 -04:00
|
|
|
The Tika detector depends on Tika Core (which is part of extraction contrib)
|
2018-01-17 11:29:17 -05:00
|
|
|
The Langdetect detector depends on LangDetect library
|
|
|
|
|
The OpenNLP detector depends on OpenNLP tools and requires a previously trained user-supplied model
|
