Commit Graph

34 Commits

Author SHA1 Message Date
Simon Willnauer 6c0c318218 LUCENE-2100: Marked all contrib Analyzer subclasses as final. Analyzers should be only act as a composition of TokenStreams, users should compose their own analyzers instead of subclassing existing ones.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@888799 13f79535-47bb-0310-9956-ffa450edef68
2009-12-09 13:32:32 +00:00
Uwe Schindler 9edfb3b66a LUCENE-2094: Prepare CharArraySet for Unicode 4.0
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@885592 13f79535-47bb-0310-9956-ffa450edef68
2009-11-30 21:49:21 +00:00
Uwe Schindler 5b83cc59b2 LUCENE-1257: Generics: *heavy* Robert Muir & mine patch
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@834847 13f79535-47bb-0310-9956-ffa450edef68
2009-11-11 12:18:34 +00:00
Robert Muir 786eb6ce0d LUCENE-2012: add remaining @overrides (contrib,demo)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@833867 13f79535-47bb-0310-9956-ffa450edef68
2009-11-08 12:45:12 +00:00
Robert Muir 9b0c42a9c1 fix confusing smartcn javadoc bug
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@831913 13f79535-47bb-0310-9956-ffa450edef68
2009-11-02 15:08:42 +00:00
Robert Muir 19e55ea991 LUCENE-1257: port smartchineseanalyzer to java 5
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@831121 13f79535-47bb-0310-9956-ffa450edef68
2009-10-29 22:29:50 +00:00
Robert Muir 1b38f9c24d LUCENE-2014: SmartChineseAnalyzer position increment bug
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@830871 13f79535-47bb-0310-9956-ffa450edef68
2009-10-29 09:22:37 +00:00
Michael McCandless aaddac8992 LUCENE-2002: add Version to QueryParser & contrib analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@829206 13f79535-47bb-0310-9956-ffa450edef68
2009-10-23 20:25:17 +00:00
Simon Willnauer 05b7822170 LUCENE-1965: Lazy Atomic Loading Stopwords in SmartCN
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@823285 13f79535-47bb-0310-9956-ffa450edef68
2009-10-08 19:21:36 +00:00
Robert Muir 8da43c4bb8 LUCENE-1916: smartcn hhmm doc translation
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@821325 13f79535-47bb-0310-9956-ffa450edef68
2009-10-03 14:24:45 +00:00
Uwe Schindler 835de0b44d LUCENE-1833: Change all new Number() ctors to Number.valueOf()
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@821186 13f79535-47bb-0310-9956-ffa450edef68
2009-10-02 22:16:44 +00:00
Uwe Schindler af0e97fd72 LUCENE-1257: Replace StringBuffer by StringBuilder where possible
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@821185 13f79535-47bb-0310-9956-ffa450edef68
2009-10-02 22:11:10 +00:00
Uwe Schindler ec90bc2202 LUCENE-1855: Change AttributeSource API to use generics
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@820553 13f79535-47bb-0310-9956-ffa450edef68
2009-10-01 07:53:43 +00:00
Uwe Schindler 4666489857 LUCENE-1906: Fix backwards problems with CharStream and Tokenizers with custom reset(Reader) method.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@813671 13f79535-47bb-0310-9956-ffa450edef68
2009-09-11 06:12:13 +00:00
Chris M. Hostetter c56f4c224f LUCENE-1884: massive javadoc and comment cleanup -- primarily dealing with typos
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@811070 13f79535-47bb-0310-9956-ffa450edef68
2009-09-03 18:31:41 +00:00
Chris M. Hostetter 29e6be94c3 LUCENE-1882: improved package level docs for smartcn
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@810247 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 21:31:18 +00:00
Chris M. Hostetter e5cb7f668a LUCENE-1882: move SmartChineseAnalyzer to the 'correct' package ... this commit is based on a sequence of svn commands and a patch provided by Robert Muir in LUCENE-1862
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@810208 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 20:10:33 +00:00
Chris M. Hostetter 566aaf28e7 fix eol inconsistencies in some package.html files
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@810191 13f79535-47bb-0310-9956-ffa450edef68
2009-09-01 19:30:59 +00:00
Robert Muir 5d05bbfd59 LUCENE-1817: Warn that file formats for smartcn might change in the future, and do not encourage custom dictionary use in the meantime
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808570 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 19:01:54 +00:00
Mark Robert Miller 26c5af3a33 LUCENE-1865 Add a ton of missing license headers throughout test/demo/contrib
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808567 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 18:48:16 +00:00
Chris M. Hostetter 6c3d17a399 fix numerous javadoc errors, many of which only show up at the private level
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808459 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 15:34:23 +00:00
Chris M. Hostetter 2e87fb12f1 incorrect javadoc syntax
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808428 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 14:29:43 +00:00
Chris M. Hostetter 6b2eae0b5a javadoc is historicly very finicky about relative names in @link tags when the name doesn't resolve in the class hierarchy at the current accesse level (ie: even if a class is in the same package, an @link to it's short namewon't resolve if it's not actaully part of a signature for a method/field being documented)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808427 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 14:28:22 +00:00
Mark Robert Miller 56985e3136 add overview.html stubs for contrib to avoid error messages when building javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808233 13f79535-47bb-0310-9956-ffa450edef68
2009-08-27 00:23:09 +00:00
Simon Willnauer 67eea7215c LUCENE-1817: Marked analyzers/smartcn as experimental in order to warn users that this API might change in the future due to major refactorings.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@808170 13f79535-47bb-0310-9956-ffa450edef68
2009-08-26 20:21:50 +00:00
Uwe Schindler 367b35f0cb LUCENE-1843: Update contrib tests to conform to onlyUseNewAPI; refactored assertAnalyzesTo and others into the new BaseTokenStreamTestCase class; Rewrote TestMappingCharFilter to use the new assert functions, too; performance improvements of Token.copyTo(); new impl of SingleTokenTokenStream
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@807190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 12:44:13 +00:00
Michael Busch 64ed5f39a5 LUCENE-1826: Add constructors that take AttributeSource and AttributeFactory to all Tokenizer implementations.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806942 13f79535-47bb-0310-9956-ffa450edef68
2009-08-23 08:34:22 +00:00
Robert Muir 8e4e7e17d0 LUCENE-1834: Remove unused code in SmartChineseAnalyzer hmm pkg
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806891 13f79535-47bb-0310-9956-ffa450edef68
2009-08-22 21:03:08 +00:00
Robert Muir 3887cf9419 LUCENE-1692: Additional tests and javadocs for contrib/analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805400 13f79535-47bb-0310-9956-ffa450edef68
2009-08-18 12:55:26 +00:00
Robert Muir d2af6ef0bd LUCENE-1794: Implement TokenStream reuse for contrib Analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804680 13f79535-47bb-0310-9956-ffa450edef68
2009-08-16 12:37:05 +00:00
Uwe Schindler b16e0aa31b LUCENE-1801: All Tokenizers/TokenStreams that are source of tokens call AttributeSource.clearAttributes() first. Made Token.clear() consistent to AttributeImpl (clear everything)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804392 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 22:01:42 +00:00
Michael McCandless ab0de2448a fix smartcn to be JDK 1.4 only
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802085 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 16:48:09 +00:00
Michael Busch 1743081b07 LUCENE-1460: Changed TokenStreams/TokenFilters in contrib to use the new TokenStream API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@799953 13f79535-47bb-0310-9956-ffa450edef68
2009-08-01 22:52:32 +00:00
Simon Willnauer 999f6157c7 LUCENE-1728: Splitted contrib/analyzers into common and smartcn. Smartcn depends on a large dictionary that causes the analyzers jar to grow up to 3MB compressed size.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@797150 13f79535-47bb-0310-9956-ffa450edef68
2009-07-23 17:11:22 +00:00