Commit Graph

710 Commits

Author SHA1 Message Date
Mark Robert Miller 66c2217a55 improve Highlighter javadocs
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805923 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 18:43:43 +00:00
Robert Muir 1d9a96c2fc LUCENE-1813: Add option to ReverseStringFilter to mark reversed tokens
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805769 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 12:07:15 +00:00
Robert Muir 58cd4a04d7 LUCENE-1794: Ensure analyzer options are applied immediately when using reusable token streams
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805766 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 11:56:31 +00:00
Mark Robert Miller 39ada16b9c fix some javadoc @returns
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805650 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 02:42:24 +00:00
Mark Robert Miller 124af950a6 Fix duplicate code and one version of getWeightedSpanTerms - should accept a TokenStream now rather than a CachingTokenStream.
Also fixes getWeightedSpanTermsWithScores to intern the fieldname.

git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805645 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 01:16:23 +00:00
Michael Busch e488bb0d5f LUCENE-1792: remove obsolete files.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805639 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 00:32:05 +00:00
Michael Busch 5864c5795c LUCENE-1792: remove obsolete files.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805638 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 00:31:05 +00:00
Michael Busch 565a6d22b5 LUCENE-1792: Fix new query parser to set rewrite method for multi-term queries.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805633 13f79535-47bb-0310-9956-ffa450edef68
2009-08-19 00:09:41 +00:00
Robert Muir 3887cf9419 LUCENE-1692: Additional tests and javadocs for contrib/analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@805400 13f79535-47bb-0310-9956-ffa450edef68
2009-08-18 12:55:26 +00:00
Mark Robert Miller 20505fd0d5 LUCENE-1522 fix + test
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804786 13f79535-47bb-0310-9956-ffa450edef68
2009-08-16 21:56:51 +00:00
Robert Muir d2af6ef0bd LUCENE-1794: Implement TokenStream reuse for contrib Analyzers
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804680 13f79535-47bb-0310-9956-ffa450edef68
2009-08-16 12:37:05 +00:00
Mark Robert Miller 395c65ad08 change PositionCheckingMap to use an entry iterator in putAll rather than keyset - faster
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804516 13f79535-47bb-0310-9956-ffa450edef68
2009-08-15 19:09:34 +00:00
Michael McCandless 316ce42d99 LUCENE-1809: make highlihter vs vector highlighter comparison more fair
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804447 13f79535-47bb-0310-9956-ffa450edef68
2009-08-15 10:01:50 +00:00
Uwe Schindler b16e0aa31b LUCENE-1801: All Tokenizers/TokenStreams that are source of tokens call AttributeSource.clearAttributes() first. Made Token.clear() consistent to AttributeImpl (clear everything)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804392 13f79535-47bb-0310-9956-ffa450edef68
2009-08-14 22:01:42 +00:00
Michael McCandless e166d54f87 LUCENE-1802: undeprecate current QueryParser
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@804016 13f79535-47bb-0310-9956-ffa450edef68
2009-08-13 20:08:58 +00:00
Chris M. Hostetter 2558c06120 LUCENE-1749: Addition of FieldCacheSanityChecker utility, and hooks to use it in all existing Lucene Tests.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@803676 13f79535-47bb-0310-9956-ffa450edef68
2009-08-12 19:31:38 +00:00
Mark Robert Miller 7fff5a7ea7 LUCENE-1771: QueryWight back to Weight, but as abstract class rather than interface - explain now takes a Searcher and passes the sub reader that contains the doc if a top level reader is a multi reader.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@803339 13f79535-47bb-0310-9956-ffa450edef68
2009-08-12 01:22:30 +00:00
Michael McCandless 7ac73cb0a6 LUCENE-1792: properly default rewrite method to CONSTANT_SCORE_AUTO for wildcard & prefix queries
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@803053 13f79535-47bb-0310-9956-ffa450edef68
2009-08-11 10:14:31 +00:00
Robert Muir 43a5bd6c19 LUCENE-1628: Add Persian Analyzer
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802955 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 23:29:27 +00:00
Michael McCandless 3aed0fd54b LUCENE-1797: don't over-increment positions when creating MultiPhraseQuery
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802893 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 18:46:39 +00:00
Michael McCandless 08c69caca6 LUCENE-1795: disable leading wildcard by default in new QueryParser, matching 2.4
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802794 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 13:54:06 +00:00
Michael McCandless 35ea5c1350 LUCENE-1786: make the patternsFileContent static, so we only load it once, not 4 times, when running this test
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802767 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 12:47:52 +00:00
Michael McCandless 2a195d3622 move QueryParserMessages.properties under src/resources
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802722 13f79535-47bb-0310-9956-ffa450edef68
2009-08-10 10:24:35 +00:00
Uwe Schindler 911df49bcb LUCENE-1607: Change some more String.intern() in contrib
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802095 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 17:19:53 +00:00
Michael McCandless ab0de2448a fix smartcn to be JDK 1.4 only
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@802085 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 16:48:09 +00:00
Michael McCandless 0b6769aa11 LUCENE-1782: rename original -> standard in the new QueryParser
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801934 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 10:24:28 +00:00
Mark Robert Miller 835efd0d6c LUCENE-1788: cleanup Highlighter test class
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801856 13f79535-47bb-0310-9956-ffa450edef68
2009-08-07 01:30:45 +00:00
Michael McCandless fc369cdf2f add getDistanceFilter() since you need that in order to sort by the exact distances (previously distanceFilter attr was public)
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801471 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 23:57:54 +00:00
Robert Muir 820620f3a7 LUCENE-1758: Update ArabicAnalyzer to light10 stemming, stopwords improvements, lowercase non-arabic text
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801348 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 18:22:22 +00:00
Yonik Seeley 7f1319fdf0 LUCENE-1607: String.intern() cache StringHelper.intern()
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801344 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 18:05:06 +00:00
Grant Ingersoll ab276a5ab9 Javadoc updates
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801219 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 13:17:20 +00:00
Grant Ingersoll c0d86a4e30 Javadoc updates
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801218 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 13:17:11 +00:00
Michael McCandless 1ab8d5ee6d LUCENE-1779: improve javadocs & remove unused args from unreleased sorting APIs
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801207 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 13:08:58 +00:00
Michael McCandless e82cc0079d remove extra print
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801166 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 12:13:02 +00:00
Michael McCandless c471e8e83c LUCENE-1773: fix highlighter test case; add contrib/memory as dependency to contrib/benchmark
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801160 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 12:09:48 +00:00
Mark Robert Miller 34ab27401c LUCENE-1770: Add EnwikiQueryMaker
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@801043 13f79535-47bb-0310-9956-ffa450edef68
2009-08-05 01:39:22 +00:00
Michael McCandless d3fcafc53e LUCENE-1773: add FastVectorHighlighter tasks to contrib/benchmark
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800947 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 20:24:02 +00:00
Mark Robert Miller 5af69469e2 LUCENE-1748: LUCENE-1001 introduced PayloadSpans, but this was a back compat break and caused custom SpanQuery implementations to fail at runtime in a variety of ways. This issue attempts to remedy things by causing a compile time break on custom SpanQuery implementations and removing the PayloadSpans class, with its functionality now moved to Spans.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800925 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 19:10:02 +00:00
Michael McCandless d79a369414 LUCENE-1504: switch to DocIdSet API and FilteredDocIdSet for contrib/spatial
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800892 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 18:01:57 +00:00
Mark Robert Miller a4c2eae1d4 update javadoc for init(TokenStream) return
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800849 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 15:38:00 +00:00
Mark Robert Miller f0e54e31e6 LUCENE-1406 belongs in contrib CHANGES
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800832 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 15:05:34 +00:00
Mark Robert Miller b44ed588ac LUCENE-1685 should be in API changes, not new features
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800821 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 14:33:58 +00:00
Mark Robert Miller 10b41d2dce LUCENE-1685: The position aware SpanScorer has become the default scorer for Highlighting. The SpanScorer implementation has replaced QueryScorer and the old term highlighting QueryScorer has been renamed to QueryTermScorer. Multi-term queries are also now expanded by default. If you were previously rewritting the query for multi-term query highlighting, you should no longer do that (unless you switch to using QueryTermScorer). The SpanScorer API (now QueryScorer) has also been improved to more closely match the API of the previous QueryScorer implementation.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800796 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 13:56:11 +00:00
Mark Robert Miller b155258203 LUCENE-1778: Add support for log.step setting per task type. Perviously, if you included a log.step line in the .alg file, it had been applied to all tasks. Now, you can include a log.step.AddDoc, or log.step.DeleteDoc (for example) to control logging for just these tasks. If you want to ommit logging for any other task, include log.step=-1. The syntax is "log.step." together with the Task's 'short' name (i.e., without the 'Task' part).
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800768 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 13:05:03 +00:00
Mark Robert Miller 4054b4ebf3 move the web based xml demo from core changes to contrib changes - also fixes skipping # 34 in features
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800661 13f79535-47bb-0310-9956-ffa450edef68
2009-08-04 02:57:00 +00:00
Michael Busch c91651e4f2 LUCENE-1775: Change contrib tee/sink filters to use new TokenStream API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800606 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 22:45:27 +00:00
Michael Busch 457c29d31e LUCENE-1775: Change remaining contrib TokenFilters (shingle, prefix-suffix) to use the new TokenStream API.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800195 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 04:33:10 +00:00
Mark Robert Miller 5aaf5b0167 LUCENE-1486: Move ComplexPhraseQueryParser to contrib
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800193 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 04:06:22 +00:00
Michael Busch 343992fcbb LUCENE-1567: New flexible QueryParser framework.
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800191 13f79535-47bb-0310-9956-ffa450edef68
2009-08-03 03:38:44 +00:00
Michael McCandless 487278cf92 LUCENE-1522 turn on unit tests that had relied on LUCENE-1448 and LUCENE-1759
git-svn-id: https://svn.apache.org/repos/asf/lucene/java/trunk@800120 13f79535-47bb-0310-9956-ffa450edef68
2009-08-02 18:07:43 +00:00