Uwe Schindler
367b35f0cb
LUCENE-1843: Update contrib tests to conform to onlyUseNewAPI; refactored assertAnalyzesTo and others into the new BaseTokenStreamTestCase class; Rewrote TestMappingCharFilter to use the new assert functions, too; performance improvements of Token.copyTo(); new impl of SingleTokenTokenStream
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@807190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 12:44:13 +00:00
Uwe Schindler
23d976abbd
LUCENE-1825: Incorrect usage of AttributeSource.addAttribute/getAttribute leads to failures when onlyUseNewAPI=true
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806844 13f79535-47bb-0310-9956-ffa450edef68
2009-08-22 12:04:35 +00:00
Michael Busch
5a40767d67
LUCENE-1828: Fix MemoryIndex to call TokenStream.reset() and TokenStream.end().
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806444 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 08:02:40 +00:00
Robert Muir
3887cf9419
LUCENE-1692: Additional tests and javadocs for contrib/analyzers
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805400 13f79535-47bb-0310-9956-ffa450edef68
2009-08-18 12:55:26 +00:00
Robert Muir
d2af6ef0bd
LUCENE-1794: Implement TokenStream reuse for contrib Analyzers
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804680 13f79535-47bb-0310-9956-ffa450edef68
2009-08-16 12:37:05 +00:00
Uwe Schindler
b16e0aa31b
LUCENE-1801: All Tokenizers/TokenStreams that are source of tokens call AttributeSource.clearAttributes() first. Made Token.clear() consistent to AttributeImpl (clear everything)
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804392 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 22:01:42 +00:00
Uwe Schindler
911df49bcb
LUCENE-1607: Change some more String.intern() in contrib
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802095 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:19:53 +00:00
Michael Busch
537aeb24e0
LUCENE-1759: Set final offset correctly in contrib TokenStreams.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@799968 13f79535-47bb-0310-9956-ffa450edef68
2009-08-02 02:10:46 +00:00
Michael Busch
1743081b07
LUCENE-1460: Changed TokenStreams/TokenFilters in contrib to use the new TokenStream API.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@799953 13f79535-47bb-0310-9956-ffa450edef68
2009-08-01 22:52:32 +00:00
Mark Robert Miller
ea7e4ad344
LUCENE-1688: Deprecate static final String stop word array in and StopAnalzyer and replace it with an immutable implementation of CharArraySet.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@794078 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 21:39:22 +00:00
Michael McCandless
ec8088654d
bulk fix svn:eol-style to native for text files
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@787424 13f79535-47bb-0310-9956-ffa450edef68
2009-06-22 22:18:56 +00:00
Michael McCandless
c6f6f01643
LUCENE-1316: don't call synchronized IndexReader.isDeleted when scoring MatchAllDocsQuery
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@737513 13f79535-47bb-0310-9956-ffa450edef68
2009-01-25 14:38:43 +00:00
Michael McCandless
7abe0311bc
LUCENE-1444: fix broken site links in javadocs
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@728262 13f79535-47bb-0310-9956-ffa450edef68
2008-12-20 09:43:06 +00:00
Michael McCandless
24d76157a0
LUCENE-1420: let Similarity.computeNorm compute the norm; add option to discount overlap tokens when computing lengthNorm
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@710117 13f79535-47bb-0310-9956-ffa450edef68
2008-11-03 18:03:58 +00:00
Otis Gospodnetic
0195fcd03d
LUCENE-1378 - Removed the remaining 199 @author references
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@695514 13f79535-47bb-0310-9956-ffa450edef68
2008-09-15 15:42:11 +00:00
Michael McCandless
4218996230
LUCENE-1366: rename Field.Index.* options
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@694004 13f79535-47bb-0310-9956-ffa450edef68
2008-09-10 21:38:52 +00:00
Michael McCandless
d5a40278bc
LUCENE-1369: switch from Hashtable to HashMap and from Vector to List, when possible
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@692921 13f79535-47bb-0310-9956-ffa450edef68
2008-09-07 19:22:40 +00:00
Michael McCandless
bb6b711718
LUCENE-1333: improvements to Token reuse API and full cutover to reuse API for all core and contrib analyzers
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@687357 13f79535-47bb-0310-9956-ffa450edef68
2008-08-20 14:38:07 +00:00
Michael McCandless
e31a9da835
LUCENE-1334: add Term(String fieldName) constructor that sets term text to empty string
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@687014 13f79535-47bb-0310-9956-ffa450edef68
2008-08-19 10:40:39 +00:00
Erik Hatcher
3c80f97f7c
MemoryIndex implements Serializable
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@671579 13f79535-47bb-0310-9956-ffa450edef68
2008-06-25 15:18:29 +00:00
Michael McCandless
fc4bc1f5af
LUCENE-1084: fix more test cases to use user-defined MaxFieldLength ctor for IndexWriter
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@619637 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 21:07:35 +00:00
Michael Busch
1abb04580f
Disable verbose standard output in MemoryIndexTest by default.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@596000 13f79535-47bb-0310-9956-ffa450edef68
2007-11-17 20:19:17 +00:00
Michael Busch
9c2a036db3
- LUCENE-908: Improvements and simplifications for how the MANIFEST file and the META-INF dir are created.
...
- LUCENE-935: Various improvements for the maven artifacts. Now the artifacts also include the sources as .jar files.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@568766 13f79535-47bb-0310-9956-ffa450edef68
2007-08-22 23:16:48 +00:00
Grant Ingersoll
e97d5830ce
LUCENE-868: New Term Vector access mechanism. Allows for applications to define how they access term vector information instead of having to pack/unpack the TV info returned by the old way.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@558592 13f79535-47bb-0310-9956-ffa450edef68
2007-07-23 03:17:25 +00:00
Michael Busch
d955a970b6
LUCENE-622: Add ant target and pom.xml files for building maven artifacts of the Lucene core and the contrib modules.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@547860 13f79535-47bb-0310-9956-ffa450edef68
2007-06-16 04:45:13 +00:00
Michael Busch
df0a188415
LUCENE-931: adding missing license headers to various files
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@545696 13f79535-47bb-0310-9956-ffa450edef68
2007-06-09 06:09:46 +00:00
Chris M. Hostetter
cb38e0c06c
LUCENE-885: include contribs in 'ant test' ... includes fixes for several contribs to make tests run cleanly regardless of what working directory they are run in
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@542769 13f79535-47bb-0310-9956-ffa450edef68
2007-05-30 07:18:29 +00:00
Doron Cohen
8ed11daae0
javadoc warnings and errors solved (except for gdata).
...
build.xml "javadocs" target will now fail if there are
javadoc warnings/errors under jdk1.4.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@535448 13f79535-47bb-0310-9956-ffa450edef68
2007-05-05 05:36:49 +00:00
Doron Cohen
bcd57a9af0
implement isPayloadAvailable (just return false, payloads unimplemented here), b/c it desn't compile without it.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@535361 13f79535-47bb-0310-9956-ffa450edef68
2007-05-04 19:40:14 +00:00
Michael Busch
b9edb2867f
Make contrib/db and contrib/memory compile with changes from LUCENE-755
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@518792 13f79535-47bb-0310-9956-ffa450edef68
2007-03-15 22:35:52 +00:00
Wolfgang Hoschek
0695150949
javadoc cosmetics
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@504229 13f79535-47bb-0310-9956-ffa450edef68
2007-02-06 18:09:19 +00:00
Wolfgang Hoschek
f620d56554
find/replace tab --> space
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@480343 13f79535-47bb-0310-9956-ffa450edef68
2006-11-29 02:35:43 +00:00
Wolfgang Hoschek
06a9b2e22a
better estimation of memory consumption
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@480339 13f79535-47bb-0310-9956-ffa450edef68
2006-11-29 02:29:19 +00:00
Wolfgang Hoschek
8dc26ad30e
javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479895 13f79535-47bb-0310-9956-ffa450edef68
2006-11-28 04:36:41 +00:00
Wolfgang Hoschek
64d4421321
cosmetics
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479755 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:36:29 +00:00
Wolfgang Hoschek
06b36cb004
For repeatable exceptions, store into cache only if child.tokenStream(fieldName, reader) does not throw an exception
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479754 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:34:45 +00:00
Wolfgang Hoschek
deb74c1dfb
javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479751 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:30:52 +00:00
Wolfgang Hoschek
8ab762aef2
Reverting back because of:
...
"Actually, now I'm considering reverting back to the version without a public clear() method. The rationale is that this would be less complex and more consistent with the AnalyzerUtil design (simple methods generating simple anonymous analyzer wrappers). If desired, you can still (re)use a single static "child" analyzer instance. It's cheap and easy to create a new caching analyzer on top of the static analyzer, and to do so before each document. The old one will simply be gc'd."
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479749 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:25:32 +00:00
Wolfgang Hoschek
ad49369d3d
added clear() method to TokenCachingAnalyzer, changed anonymous class to public class
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479699 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 17:37:26 +00:00
Wolfgang Hoschek
f76157f560
javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478407 13f79535-47bb-0310-9956-ffa450edef68
2006-11-23 00:27:36 +00:00
Wolfgang Hoschek
b8387ec241
javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478406 13f79535-47bb-0310-9956-ffa450edef68
2006-11-23 00:25:53 +00:00
Wolfgang Hoschek
8ccee0c870
hashing on a pair isn't necessary and overly complicates semantics. So taking Pair logic out.
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478378 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:29:42 +00:00
Wolfgang Hoschek
d33f53c109
javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478377 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:22:56 +00:00
Wolfgang Hoschek
ae6846798d
cosmetics
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478368 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:12:19 +00:00
Wolfgang Hoschek
e7cde622d9
cosmetics
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478366 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:10:12 +00:00
Wolfgang Hoschek
aeb9723407
javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478361 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 22:57:59 +00:00
Wolfgang Hoschek
cdb3440645
added getTokenCachingAnalyzer()
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478360 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 22:55:01 +00:00
Wolfgang Hoschek
4002514600
reverting update to non-deprecated method as it was not backwards compatible with lucene-2.0
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478303 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 19:48:24 +00:00
Wolfgang Hoschek
e7ed9203c0
clarified javadoc
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478302 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 19:42:25 +00:00
Wolfgang Hoschek
b797db9788
cosmetics
...
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478102 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 09:48:09 +00:00