Commit Graph

723 Commits

Author SHA1 Message Date
Uwe Schindler 367b35f0cb LUCENE-1843: Update contrib tests to conform to onlyUseNewAPI; refactored assertAnalyzesTo and others into the new BaseTokenStreamTestCase class; Rewrote TestMappingCharFilter to use the new assert functions, too; performance improvements of Token.copyTo(); new impl of SingleTokenTokenStream
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@807190 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 12:44:13 +00:00
Uwe Schindler 5dd1810b0c LUCENE-1846: Fix more Locale problems
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@807117 13f79535-47bb-0310-9956-ffa450edef68
2009-08-24 08:31:34 +00:00
Uwe Schindler 4745c8db05 LUCENE-1825: Another one :(
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806990 13f79535-47bb-0310-9956-ffa450edef68
2009-08-23 16:35:50 +00:00
Uwe Schindler c2f95d474b LUCENE-1825: Additional incorrect getAttribute usage
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806986 13f79535-47bb-0310-9956-ffa450edef68
2009-08-23 16:17:08 +00:00
Robert Muir 6847c0e2bd LUCENE-1826: the new tokenizer constructors should not allow deprecated charsets
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806961 13f79535-47bb-0310-9956-ffa450edef68
2009-08-23 12:39:28 +00:00
Michael Busch 64ed5f39a5 LUCENE-1826: Add constructors that take AttributeSource and AttributeFactory to all Tokenizer implementations.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806942 13f79535-47bb-0310-9956-ffa450edef68
2009-08-23 08:34:22 +00:00
Robert Muir 8e4e7e17d0 LUCENE-1834: Remove unused code in SmartChineseAnalyzer hmm pkg
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806891 13f79535-47bb-0310-9956-ffa450edef68
2009-08-22 21:03:08 +00:00
Robert Muir 1ebbe2abd1 LUCENE-1793: Deprecate custom encoding support in Greek and Russian analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806886 13f79535-47bb-0310-9956-ffa450edef68
2009-08-22 20:36:06 +00:00
Uwe Schindler 23d976abbd LUCENE-1825: Incorrect usage of AttributeSource.addAttribute/getAttribute leads to failures when onlyUseNewAPI=true
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806844 13f79535-47bb-0310-9956-ffa450edef68
2009-08-22 12:04:35 +00:00
Michael Busch f409117a6f LUCENE-1829: Fix contrib query parser to properly create javacc files.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806755 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 23:19:26 +00:00
Simon Willnauer 61a68fe46f Added the changes in LUCENE-1728 to the "Build" section of contrib/CHANGES.TXT
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806536 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 12:59:07 +00:00
Michael Busch 82c8a2ffc2 Fix if clause in MultiTermRewriteMethodProcessor
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806456 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 08:36:31 +00:00
Michael Busch 5a40767d67 LUCENE-1828: Fix MemoryIndex to call TokenStream.reset() and TokenStream.end().
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@806444 13f79535-47bb-0310-9956-ffa450edef68
2009-08-21 08:02:40 +00:00
Mark Robert Miller 66c2217a55 improve Highlighter javadocs
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805923 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 18:43:43 +00:00
Robert Muir 1d9a96c2fc LUCENE-1813: Add option to ReverseStringFilter to mark reversed tokens
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805769 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 12:07:15 +00:00
Robert Muir 58cd4a04d7 LUCENE-1794: Ensure analyzer options are applied immediately when using reusable token streams
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805766 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 11:56:31 +00:00
Mark Robert Miller 39ada16b9c fix some javadoc @returns
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805650 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 02:42:24 +00:00
Mark Robert Miller 124af950a6 Fix duplicate code and one version of getWeightedSpanTerms - should accept a TokenStream now rather than a CachingTokenStream.
Also fixes getWeightedSpanTermsWithScores to intern the fieldname.

git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805645 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 01:16:23 +00:00
Michael Busch e488bb0d5f LUCENE-1792: remove obsolete files.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805639 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 00:32:05 +00:00
Michael Busch 5864c5795c LUCENE-1792: remove obsolete files.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805638 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 00:31:05 +00:00
Michael Busch 565a6d22b5 LUCENE-1792: Fix new query parser to set rewrite method for multi-term queries.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805633 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 00:09:41 +00:00
Robert Muir 3887cf9419 LUCENE-1692: Additional tests and javadocs for contrib/analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805400 13f79535-47bb-0310-9956-ffa450edef68
2009-08-18 12:55:26 +00:00
Mark Robert Miller 20505fd0d5 LUCENE-1522 fix + test
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804786 13f79535-47bb-0310-9956-ffa450edef68
2009-08-16 21:56:51 +00:00
Robert Muir d2af6ef0bd LUCENE-1794: Implement TokenStream reuse for contrib Analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804680 13f79535-47bb-0310-9956-ffa450edef68
2009-08-16 12:37:05 +00:00
Mark Robert Miller 395c65ad08 change PositionCheckingMap to use an entry iterator in putAll rather than keyset - faster
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804516 13f79535-47bb-0310-9956-ffa450edef68
2009-08-15 19:09:34 +00:00
Michael McCandless 316ce42d99 LUCENE-1809: make highlihter vs vector highlighter comparison more fair
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804447 13f79535-47bb-0310-9956-ffa450edef68
2009-08-15 10:01:50 +00:00
Uwe Schindler b16e0aa31b LUCENE-1801: All Tokenizers/TokenStreams that are source of tokens call AttributeSource.clearAttributes() first. Made Token.clear() consistent to AttributeImpl (clear everything)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804392 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 22:01:42 +00:00
Michael McCandless e166d54f87 LUCENE-1802: undeprecate current QueryParser
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804016 13f79535-47bb-0310-9956-ffa450edef68
2009-08-13 20:08:58 +00:00
Chris M. Hostetter 2558c06120 LUCENE-1749: Addition of FieldCacheSanityChecker utility, and hooks to use it in all existing Lucene Tests.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@803676 13f79535-47bb-0310-9956-ffa450edef68
2009-08-12 19:31:38 +00:00
Mark Robert Miller 7fff5a7ea7 LUCENE-1771: QueryWight back to Weight, but as abstract class rather than interface - explain now takes a Searcher and passes the sub reader that contains the doc if a top level reader is a multi reader.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@803339 13f79535-47bb-0310-9956-ffa450edef68
2009-08-12 01:22:30 +00:00
Michael McCandless 7ac73cb0a6 LUCENE-1792: properly default rewrite method to CONSTANT_SCORE_AUTO for wildcard & prefix queries
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@803053 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 10:14:31 +00:00
Robert Muir 43a5bd6c19 LUCENE-1628: Add Persian Analyzer
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802955 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 23:29:27 +00:00
Michael McCandless 3aed0fd54b LUCENE-1797: don't over-increment positions when creating MultiPhraseQuery
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802893 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 18:46:39 +00:00
Michael McCandless 08c69caca6 LUCENE-1795: disable leading wildcard by default in new QueryParser, matching 2.4
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802794 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 13:54:06 +00:00
Michael McCandless 35ea5c1350 LUCENE-1786: make the patternsFileContent static, so we only load it once, not 4 times, when running this test
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802767 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 12:47:52 +00:00
Michael McCandless 2a195d3622 move QueryParserMessages.properties under src/resources
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802722 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 10:24:35 +00:00
Uwe Schindler 911df49bcb LUCENE-1607: Change some more String.intern() in contrib
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802095 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:19:53 +00:00
Michael McCandless ab0de2448a fix smartcn to be JDK 1.4 only
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802085 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 16:48:09 +00:00
Michael McCandless 0b6769aa11 LUCENE-1782: rename original -> standard in the new QueryParser
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801934 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 10:24:28 +00:00
Mark Robert Miller 835efd0d6c LUCENE-1788: cleanup Highlighter test class
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801856 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 01:30:45 +00:00
Michael McCandless fc369cdf2f add getDistanceFilter() since you need that in order to sort by the exact distances (previously distanceFilter attr was public)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801471 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 23:57:54 +00:00
Robert Muir 820620f3a7 LUCENE-1758: Update ArabicAnalyzer to light10 stemming, stopwords improvements, lowercase non-arabic text
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801348 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 18:22:22 +00:00
Yonik Seeley 7f1319fdf0 LUCENE-1607: String.intern() cache StringHelper.intern()
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801344 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 18:05:06 +00:00
Grant Ingersoll ab276a5ab9 Javadoc updates
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801219 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 13:17:20 +00:00
Grant Ingersoll c0d86a4e30 Javadoc updates
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801218 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 13:17:11 +00:00
Michael McCandless 1ab8d5ee6d LUCENE-1779: improve javadocs & remove unused args from unreleased sorting APIs
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801207 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 13:08:58 +00:00
Michael McCandless e82cc0079d remove extra print
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801166 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 12:13:02 +00:00
Michael McCandless c471e8e83c LUCENE-1773: fix highlighter test case; add contrib/memory as dependency to contrib/benchmark
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801160 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 12:09:48 +00:00
Mark Robert Miller 34ab27401c LUCENE-1770: Add EnwikiQueryMaker
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801043 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 01:39:22 +00:00
Michael McCandless d3fcafc53e LUCENE-1773: add FastVectorHighlighter tasks to contrib/benchmark
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800947 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 20:24:02 +00:00