-SmartChineseAnalyzer Hidden Markov Model package
+SmartChineseAnalyzer Hidden Markov Model package.
-WARNING: The status of the analyzers/smartcn analysis.cn package is experimental. The APIs
+WARNING: The status of the analyzers/smartcn analysis.cn.smart package is experimental. The APIs
and file formats introduced here might change in the future and will not be supported anymore
in such a case.
diff --git a/contrib/analyzers/smartcn/src/java/org/apache/lucene/analysis/cn/smart/package.html b/contrib/analyzers/smartcn/src/java/org/apache/lucene/analysis/cn/smart/package.html
index 881d31905bc..bd6b6322e1c 100644
--- a/contrib/analyzers/smartcn/src/java/org/apache/lucene/analysis/cn/smart/package.html
+++ b/contrib/analyzers/smartcn/src/java/org/apache/lucene/analysis/cn/smart/package.html
@@ -15,17 +15,36 @@
See the License for the specific language governing permissions and
limitations under the License.
-->
-
+
+
+
+
-SmartChineseAnalyzer Tokenizers and TokenFilters
+Analyzer for Simplified Chinese, which indexes words.
-WARNING: The status of the analyzers/smartcn analysis.cn package is experimental. The APIs
+WARNING: The status of the analyzers/smartcn analysis.cn.smart package is experimental. The APIs
and file formats introduced here might change in the future and will not be supported anymore
in such a case.
+
+Three analyzers are provided for Chinese, each of which treats Chinese text in a different way.
+
+ - ChineseAnalyzer (in the analyzers/cn package): Index unigrams (individual Chinese characters) as a token.
+
- CJKAnalyzer (in the analyzers/cjk package): Index bigrams (overlapping groups of two adjacent Chinese characters) as tokens.
+
- SmartChineseAnalyzer (in this package): Index words (attempt to segment Chinese text into words) as tokens.
+
+
+Example phrase： "我是中国人"
+
+ - ChineseAnalyzer: 我－是－中－国－人
+ - CJKAnalyzer: 我是－是中－中国－国人
+ - SmartChineseAnalyzer: 我－是－中国－人
+
+
+