Commit Graph

87 Commits

Author SHA1 Message Date
Uwe Schindler 367b35f0cb LUCENE-1843: Update contrib tests to conform to onlyUseNewAPI; refactored assertAnalyzesTo and others into the new BaseTokenStreamTestCase class; Rewrote TestMappingCharFilter to use the new assert functions, too; performance improvements of Token.copyTo(); new impl of SingleTokenTokenStream
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@807190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 12:44:13 +00:00
Uwe Schindler 23d976abbd LUCENE-1825: Incorrect usage of AttributeSource.addAttribute/getAttribute leads to failures when onlyUseNewAPI=true
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806844 13f79535-47bb-0310-9956-ffa450edef68
2009-08-22 12:04:35 +00:00
Michael Busch 5a40767d67 LUCENE-1828: Fix MemoryIndex to call TokenStream.reset() and TokenStream.end().
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806444 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 08:02:40 +00:00
Robert Muir 3887cf9419 LUCENE-1692: Additional tests and javadocs for contrib/analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805400 13f79535-47bb-0310-9956-ffa450edef68
2009-08-18 12:55:26 +00:00
Robert Muir d2af6ef0bd LUCENE-1794: Implement TokenStream reuse for contrib Analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804680 13f79535-47bb-0310-9956-ffa450edef68
2009-08-16 12:37:05 +00:00
Uwe Schindler b16e0aa31b LUCENE-1801: All Tokenizers/TokenStreams that are source of tokens call AttributeSource.clearAttributes() first. Made Token.clear() consistent to AttributeImpl (clear everything)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804392 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 22:01:42 +00:00
Uwe Schindler 911df49bcb LUCENE-1607: Change some more String.intern() in contrib
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802095 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:19:53 +00:00
Michael Busch 537aeb24e0 LUCENE-1759: Set final offset correctly in contrib TokenStreams.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@799968 13f79535-47bb-0310-9956-ffa450edef68
2009-08-02 02:10:46 +00:00
Michael Busch 1743081b07 LUCENE-1460: Changed TokenStreams/TokenFilters in contrib to use the new TokenStream API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@799953 13f79535-47bb-0310-9956-ffa450edef68
2009-08-01 22:52:32 +00:00
Mark Robert Miller ea7e4ad344 LUCENE-1688: Deprecate static final String stop word array in and StopAnalzyer and replace it with an immutable implementation of CharArraySet.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@794078 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 21:39:22 +00:00
Michael McCandless ec8088654d bulk fix svn:eol-style to native for text files
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@787424 13f79535-47bb-0310-9956-ffa450edef68
2009-06-22 22:18:56 +00:00
Michael McCandless c6f6f01643 LUCENE-1316: don't call synchronized IndexReader.isDeleted when scoring MatchAllDocsQuery
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@737513 13f79535-47bb-0310-9956-ffa450edef68
2009-01-25 14:38:43 +00:00
Michael McCandless 7abe0311bc LUCENE-1444: fix broken site links in javadocs
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@728262 13f79535-47bb-0310-9956-ffa450edef68
2008-12-20 09:43:06 +00:00
Michael McCandless 24d76157a0 LUCENE-1420: let Similarity.computeNorm compute the norm; add option to discount overlap tokens when computing lengthNorm
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@710117 13f79535-47bb-0310-9956-ffa450edef68
2008-11-03 18:03:58 +00:00
Otis Gospodnetic 0195fcd03d LUCENE-1378 - Removed the remaining 199 @author references
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@695514 13f79535-47bb-0310-9956-ffa450edef68
2008-09-15 15:42:11 +00:00
Michael McCandless 4218996230 LUCENE-1366: rename Field.Index.* options
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@694004 13f79535-47bb-0310-9956-ffa450edef68
2008-09-10 21:38:52 +00:00
Michael McCandless d5a40278bc LUCENE-1369: switch from Hashtable to HashMap and from Vector to List, when possible
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@692921 13f79535-47bb-0310-9956-ffa450edef68
2008-09-07 19:22:40 +00:00
Michael McCandless bb6b711718 LUCENE-1333: improvements to Token reuse API and full cutover to reuse API for all core and contrib analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@687357 13f79535-47bb-0310-9956-ffa450edef68
2008-08-20 14:38:07 +00:00
Michael McCandless e31a9da835 LUCENE-1334: add Term(String fieldName) constructor that sets term text to empty string
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@687014 13f79535-47bb-0310-9956-ffa450edef68
2008-08-19 10:40:39 +00:00
Erik Hatcher 3c80f97f7c MemoryIndex implements Serializable
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@671579 13f79535-47bb-0310-9956-ffa450edef68
2008-06-25 15:18:29 +00:00
Michael McCandless fc4bc1f5af LUCENE-1084: fix more test cases to use user-defined MaxFieldLength ctor for IndexWriter
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@619637 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 21:07:35 +00:00
Michael Busch 1abb04580f Disable verbose standard output in MemoryIndexTest by default.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@596000 13f79535-47bb-0310-9956-ffa450edef68
2007-11-17 20:19:17 +00:00
Michael Busch 9c2a036db3 - LUCENE-908: Improvements and simplifications for how the MANIFEST file and the META-INF dir are created.
- LUCENE-935: Various improvements for the maven artifacts. Now the artifacts also include the sources as .jar files. 

git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@568766 13f79535-47bb-0310-9956-ffa450edef68
2007-08-22 23:16:48 +00:00
Grant Ingersoll e97d5830ce LUCENE-868: New Term Vector access mechanism. Allows for applications to define how they access term vector information instead of having to pack/unpack the TV info returned by the old way.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@558592 13f79535-47bb-0310-9956-ffa450edef68
2007-07-23 03:17:25 +00:00
Michael Busch d955a970b6 LUCENE-622: Add ant target and pom.xml files for building maven artifacts of the Lucene core and the contrib modules.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@547860 13f79535-47bb-0310-9956-ffa450edef68
2007-06-16 04:45:13 +00:00
Michael Busch df0a188415 LUCENE-931: adding missing license headers to various files
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@545696 13f79535-47bb-0310-9956-ffa450edef68
2007-06-09 06:09:46 +00:00
Chris M. Hostetter cb38e0c06c LUCENE-885: include contribs in 'ant test' ... includes fixes for several contribs to make tests run cleanly regardless of what working directory they are run in
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@542769 13f79535-47bb-0310-9956-ffa450edef68
2007-05-30 07:18:29 +00:00
Doron Cohen 8ed11daae0 javadoc warnings and errors solved (except for gdata).
build.xml "javadocs" target will now fail if there are 
javadoc warnings/errors under jdk1.4.


git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@535448 13f79535-47bb-0310-9956-ffa450edef68
2007-05-05 05:36:49 +00:00
Doron Cohen bcd57a9af0 implement isPayloadAvailable (just return false, payloads unimplemented here), b/c it desn't compile without it.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@535361 13f79535-47bb-0310-9956-ffa450edef68
2007-05-04 19:40:14 +00:00
Michael Busch b9edb2867f Make contrib/db and contrib/memory compile with changes from LUCENE-755
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@518792 13f79535-47bb-0310-9956-ffa450edef68
2007-03-15 22:35:52 +00:00
Wolfgang Hoschek 0695150949 javadoc cosmetics
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@504229 13f79535-47bb-0310-9956-ffa450edef68
2007-02-06 18:09:19 +00:00
Wolfgang Hoschek f620d56554 find/replace tab --> space
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@480343 13f79535-47bb-0310-9956-ffa450edef68
2006-11-29 02:35:43 +00:00
Wolfgang Hoschek 06a9b2e22a better estimation of memory consumption
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@480339 13f79535-47bb-0310-9956-ffa450edef68
2006-11-29 02:29:19 +00:00
Wolfgang Hoschek 8dc26ad30e javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479895 13f79535-47bb-0310-9956-ffa450edef68
2006-11-28 04:36:41 +00:00
Wolfgang Hoschek 64d4421321 cosmetics
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479755 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:36:29 +00:00
Wolfgang Hoschek 06b36cb004 For repeatable exceptions, store into cache only if child.tokenStream(fieldName, reader) does not throw an exception
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479754 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:34:45 +00:00
Wolfgang Hoschek deb74c1dfb javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479751 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:30:52 +00:00
Wolfgang Hoschek 8ab762aef2 Reverting back because of:
"Actually, now I'm considering reverting back to the version without a public clear() method. The rationale is that this would be less complex and more consistent with the AnalyzerUtil design (simple methods generating simple anonymous analyzer wrappers). If desired, you can still (re)use a single static "child" analyzer instance. It's cheap and easy to create a new caching analyzer on top of the static analyzer, and to do so before each document. The old one will simply be gc'd."


git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479749 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 20:25:32 +00:00
Wolfgang Hoschek ad49369d3d added clear() method to TokenCachingAnalyzer, changed anonymous class to public class
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@479699 13f79535-47bb-0310-9956-ffa450edef68
2006-11-27 17:37:26 +00:00
Wolfgang Hoschek f76157f560 javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478407 13f79535-47bb-0310-9956-ffa450edef68
2006-11-23 00:27:36 +00:00
Wolfgang Hoschek b8387ec241 javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478406 13f79535-47bb-0310-9956-ffa450edef68
2006-11-23 00:25:53 +00:00
Wolfgang Hoschek 8ccee0c870 hashing on a pair isn't necessary and overly complicates semantics. So taking Pair logic out.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478378 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:29:42 +00:00
Wolfgang Hoschek d33f53c109 javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478377 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:22:56 +00:00
Wolfgang Hoschek ae6846798d cosmetics
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478368 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:12:19 +00:00
Wolfgang Hoschek e7cde622d9 cosmetics
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478366 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 23:10:12 +00:00
Wolfgang Hoschek aeb9723407 javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478361 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 22:57:59 +00:00
Wolfgang Hoschek cdb3440645 added getTokenCachingAnalyzer()
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478360 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 22:55:01 +00:00
Wolfgang Hoschek 4002514600 reverting update to non-deprecated method as it was not backwards compatible with lucene-2.0
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478303 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 19:48:24 +00:00
Wolfgang Hoschek e7ed9203c0 clarified javadoc
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478302 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 19:42:25 +00:00
Wolfgang Hoschek b797db9788 cosmetics
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@478102 13f79535-47bb-0310-9956-ffa450edef68
2006-11-22 09:48:09 +00:00