lucene/modules/analysis
Robert Muir bef6e3664d LUCENE-3726: additional tests
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1240760 13f79535-47bb-0310-9956-ffa450edef68
2012-02-05 16:16:02 +00:00
..
common [LUCENE-3744] - applied patch for whiteList usage in TypeTokenFilter 2012-02-03 09:13:17 +00:00
icu LUCENE-3717: add better offsets testing to BaseTokenStreamTestCase, fix offsets bugs in ThaiWordFilter and ICUTokenizer 2012-01-23 00:08:52 +00:00
kuromoji LUCENE-3726: additional tests 2012-02-05 16:16:02 +00:00
morfologik LUCENE-3717: add checkRandomData to more analyzers and fix more offsets bugs 2012-01-23 15:19:58 +00:00
phonetic LUCENE-3720: add warning+experimental and disable test 2012-01-26 18:26:07 +00:00
smartcn LUCENE-3642: fix invalid offsets from CharTokenizer, [Edge]NGramFilters, SmartChinese, add sanity check to BaseTokenStreamTestCase 2011-12-12 17:28:09 +00:00
stempel LUCENE-2564: Cut over WordListLoader to CharArrayMap/Set and use CharSetDecoder to detect encoding problems early 2011-11-10 01:21:25 +00:00
CHANGES.txt cleanups to 4.x CHANGES 2012-01-14 18:24:48 +00:00
LICENSE.txt LUCENE-2341: integrating morfologik (Polish stemming/ morphosyntactic dictionary) as an analysis module. 2011-06-30 19:12:54 +00:00
NOTICE.txt LUCENE-3305: add Kuromoji Japanese morphological analyzer 2012-01-12 20:10:48 +00:00
README.txt LUCENE-3305: add Kuromoji Japanese morphological analyzer 2012-01-12 20:10:48 +00:00
build.xml LUCENE-3305: add Kuromoji Japanese morphological analyzer 2012-01-12 20:10:48 +00:00

README.txt

Analysis README file

INTRODUCTION

The Analysis Module provides analysis capabilities to Lucene and Solr
applications.

The Lucene web site is at:
  http://lucene.apache.org/

Please join the Lucene-User mailing list by sending a message to:
  java-user-subscribe@lucene.apache.org

FILES

lucene-analyzers-common-XX.jar
  The primary analysis module library, containing general-purpose analysis
  components and support for various languages.

lucene-analyzers-icu-XX.jar
  An add-on analysis library that provides improved Unicode support via
  International Components for Unicode (ICU). Note: this module depends on
  the ICU4j jar file (version >= 4.6.0)

lucene-analyzers-kuromoji-XX.jar
  An analyzer with morphological analysis for Japanese.

lucene-analyzers-morfologik-XX.jar
  An analyzer using the Morfologik stemming library.

lucene-analyzers-phonetic-XX.jar
  An add-on analysis library that provides phonetic encoders via Apache
  Commons-Codec. Note: this module depends on the commons-codec jar 
  file (version >= 1.4)
  
lucene-analyzers-smartcn-XX.jar
  An add-on analysis library that provides word segmentation for Simplified
  Chinese.

lucene-analyzers-stempel-XX.jar
  An add-on analysis library that contains a universal algorithmic stemmer,
  including tables for the Polish language.

common/src/java
icu/src/java
kuromoji/src/java
morfologik/src/java
phonetic/src/java
smartcn/src/java
stempel/src/java
  The source code for the libraries.

common/src/test
icu/src/test
kuromoji/src/test
morfologik/src/test
phonetic/src/test
smartcn/src/test
stempel/src/test
  Unit tests for the libraries.