Simon Willnauer
|
67eea7215c
|
LUCENE-1817: Marked analyzers/smartcn as experimental in order to warn users that this API might change in the future due to major refactorings.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808170 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-26 20:21:50 +00:00 |
Uwe Schindler
|
367b35f0cb
|
LUCENE-1843: Update contrib tests to conform to onlyUseNewAPI; refactored assertAnalyzesTo and others into the new BaseTokenStreamTestCase class; Rewrote TestMappingCharFilter to use the new assert functions, too; performance improvements of Token.copyTo(); new impl of SingleTokenTokenStream
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@807190 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-24 12:44:13 +00:00 |
Michael Busch
|
64ed5f39a5
|
LUCENE-1826: Add constructors that take AttributeSource and AttributeFactory to all Tokenizer implementations.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806942 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-23 08:34:22 +00:00 |
Robert Muir
|
8e4e7e17d0
|
LUCENE-1834: Remove unused code in SmartChineseAnalyzer hmm pkg
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806891 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-22 21:03:08 +00:00 |
|
Robert Muir
|
3887cf9419
|
LUCENE-1692: Additional tests and javadocs for contrib/analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805400 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-18 12:55:26 +00:00 |
|
Robert Muir
|
d2af6ef0bd
|
LUCENE-1794: Implement TokenStream reuse for contrib Analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804680 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-16 12:37:05 +00:00 |
|
Uwe Schindler
|
b16e0aa31b
|
LUCENE-1801: All Tokenizers/TokenStreams that are source of tokens call AttributeSource.clearAttributes() first. Made Token.clear() consistent to AttributeImpl (clear everything)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804392 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-14 22:01:42 +00:00 |
Michael McCandless
|
ab0de2448a
|
fix smartcn to be JDK 1.4 only
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802085 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-07 16:48:09 +00:00 |
|
Michael Busch
|
1743081b07
|
LUCENE-1460: Changed TokenStreams/TokenFilters in contrib to use the new TokenStream API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@799953 13f79535-47bb-0310-9956-ffa450edef68
|
2009-08-01 22:52:32 +00:00 |
|
Simon Willnauer
|
999f6157c7
|
LUCENE-1728: Splitted contrib/analyzers into common and smartcn. Smartcn depends on a large dictionary that causes the analyzers jar to grow up to 3MB compressed size.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@797150 13f79535-47bb-0310-9956-ffa450edef68
|
2009-07-23 17:11:22 +00:00 |