Apache
/
lucene
mirror of https://github.com/apache/lucene.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
12,209 Commits 27 Branches 467 Tags 751 MiB
Commit Graph

235 Commits

Author SHA1 Message Date
Michael McCandless 60c36c24fb don't let prefix's output bleed into full string's output (potential/latent bug) 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1239658 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-02 15:01:13 +00:00
Robert Muir 995c5b9ef1 LUCENE-3730: improve Kuromoji search mode heuristics 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1239061 13f79535-47bb-0310-9956-ffa450edef68
 2012-02-01 11:03:17 +00:00
Michael McCandless 8e40ea5bf8 LUCENE-3742: fix token offset for hangs-off-end output in SynonymFilter 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1238851 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-31 23:01:55 +00:00
Uwe Schindler 10ba9abeb2 Reverse merged revision(s) from lucene/dev/trunk up to 1237502 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/branches/lucene2858@1237505 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-29 23:19:05 +00:00
Michael McCandless d1165b1972 LUCENE-3725: add optional packing to FSTs 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1237500 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-29 22:48:45 +00:00
Robert Muir d7fe56ddae LUCENE-2858: fix analyzer 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/branches/lucene2858@1237312 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-29 15:16:04 +00:00
Steven Rowe 97d62cc383 Fix offset array assertion off-by-one 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1236912 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-27 22:43:48 +00:00
Robert Muir f640687877 LUCENE-3720: add warning+experimental and disable test 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1236341 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-26 18:26:07 +00:00
Robert Muir 6edfe4f157 LUCENE-3717: add tests 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1235199 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 10:40:46 +00:00
Robert Muir 35a73d5f55 LUCENE-3717: fix broken offsets in ngramtokenizers, and check return value of Reader.read 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1235187 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-24 09:50:21 +00:00
Robert Muir 7fafdd3576 LUCENE-3717: add checkRandomData to more analyzers and fix more offsets bugs 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234850 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 15:19:58 +00:00
Steven Rowe 059410d424 LUCENE-3690: fix handling of unpaired numeric character entity UTF-16 surrogates to output U+FFFD REPLACEMENT CHARACTER; and add handling of properly paired numeric character entity UTF-16 surrogates, to output the corresponding pair of code units. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234687 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 07:36:38 +00:00
Robert Muir c754c1c9c8 LUCENE-3717: add better offsets testing to BaseTokenStreamTestCase, fix offsets bugs in ThaiWordFilter and ICUTokenizer 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234652 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-23 00:08:52 +00:00
Robert Muir a7cfee6b07 SOLR-2891: fix CompoundWordTokenFilter to not create invalid offsets when the length of the text was changed by a previous filter 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234546 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-22 16:41:06 +00:00
Steven Rowe f3a363708f LUCENE-3690: Re-implemented HTMLStripCharFilter as a JFlex-generated scanner. Fixes LUCENE-2208, SOLR-882, and SOLR-42. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234452 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-22 05:20:46 +00:00
Uwe Schindler af9b4d816f LUCENE-3671: Add TypeTokenFilter that filters tokens based on their TypeAttribute 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234396 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-21 19:02:44 +00:00
Robert Muir e869b1fbf7 LUCENE-3700: give enough ram so that you can build naist-jdic with java 5 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1232274 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 02:27:31 +00:00
Robert Muir f562a8a0dc LUCENE-3700: optionally support naist-jdic for kuromoji 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1232268 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 02:20:24 +00:00
Robert Muir 48c01e5a2b LUCENE-3699: share baseform with surface and flag if the reading can be computed from surface 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1232265 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 02:12:27 +00:00
Robert Muir c902f63125 unbreak clover/nightly builds until we do this right 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1232254 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-17 01:37:28 +00:00
Robert Muir 12c9b8b4bf LUCENE-3699: simplify dictionary access and reduce tokeninfodictionary 1.5MB 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1232120 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 19:19:48 +00:00
Robert Muir 354a3be78f LUCENE-3696: fix dictionary construction to work on java5 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1232012 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-16 14:50:09 +00:00
Michael McCandless 87bc4521c2 LUCENE-3695: move some confusing FST sugar out 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231795 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-15 23:25:38 +00:00
Michael McCandless 11f33ee521 LUCENE-3684: add offsets to postings APIs 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231794 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-15 23:17:45 +00:00
Robert Muir fbd34b4390 cleanups to 4.x CHANGES 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231552 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 18:24:48 +00:00
Yonik Seeley b2a0040e98 tests: silliness 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231526 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 16:59:36 +00:00
Michael McCandless 5ca66287ea woops 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231513 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 15:20:58 +00:00
Michael McCandless d584f6361d LUCENE-3685: add ToChildBlockJoinQuery, to join from parent to child 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231512 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-14 15:17:04 +00:00
Robert Muir 8b8c2b4dee LUCENE-3690: since this filter handles all kinds of bad partial and wierd input, this should be fine to enable 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231272 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 19:46:30 +00:00
Robert Muir 2ff4bdb04f enable assertions when executing various tools 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231013 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-13 11:36:50 +00:00
Robert Muir 05a65507af LUCENE-3305: optimization, don't retrieve the base form twice in this filter 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1230769 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 20:36:58 +00:00
Robert Muir 4ebdc0872a LUCENE-3305: sorry Mike (thanks for the help with the FST optimization) 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1230756 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 20:24:40 +00:00
Robert Muir cd372bdc83 LUCENE-3305: add Kuromoji Japanese morphological analyzer 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1230748 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-12 20:10:48 +00:00
Simon Willnauer 3b8458f6de use TEST_VERSION_CURRENT instead of 4_0 in test 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1229523 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 12:46:38 +00:00
Simon Willnauer f19317d318 SOLR-3020: Add KeywordAttribute support to HunspellStemFilter 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1229519 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-10 12:33:29 +00:00
Michael McCandless cdb2ee8a7b LUCENE-3679: replace IR.getFieldNames with IR.getFieldInfos 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1229401 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-09 22:29:40 +00:00
Michael McCandless defd51a11b fix syn test bug 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1228704 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 19:28:07 +00:00
Michael McCandless ed9f0fd5ef LUCENE-3668: if there's only 1 output for a synonym rule then set start/endOffset to match the full span of the input tokens 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1228650 13f79535-47bb-0310-9956-ffa450edef68
 2012-01-07 16:26:15 +00:00
Steven Rowe 76d1662cb7 - Added license declaration 
- Removed unused 'length' param to combine()

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1225615 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 18:53:10 +00:00
Robert Muir b2970db4bc LUCENE-2906: filter to process output of Standard/ICUTokenizer and create overlapping bigrams for CJK 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1225433 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-29 05:04:49 +00:00
Robert Muir e2f81e84f2 SOLR-2982: workaround bug in sun javadoc 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1225228 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 16:51:23 +00:00
Robert Muir f3869ef3ce SOLR-2982: add Beider-Morse phonetic filter 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1225211 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-28 16:00:52 +00:00
Robert Muir a55f511a77 LUCENE-3650: move o.a.l.index.codecs to o.a.l.codecs 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1215245 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 19:03:12 +00:00
Robert Muir 18febd69e4 LUCENE-2208: improve charfilter offset testing 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1215038 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-16 04:37:47 +00:00
Steven Rowe 60929a5adb LUCENE-3645: Remove unnecessary array wrapping when calling varargs methods 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1214413 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-14 19:15:47 +00:00
Robert Muir 7dc025bdce LUCENE-3642: fix invalid offsets from CharTokenizer, [Edge]NGramFilters, SmartChinese, add sanity check to BaseTokenStreamTestCase 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1213329 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 17:28:09 +00:00
Robert Muir 3899e18ca3 LUCENE-3640: Remove IndexSearcher.close 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1213117 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-12 00:21:40 +00:00
Uwe Schindler 905a0f211c LUCENE-3606: Make IndexReader really read-only 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1212292 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-09 09:13:39 +00:00
Robert Muir 9b15b1d3b0 consolidate assumes in ThaiAnalyzer test so we don't miss it for individual tests 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1212141 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-08 21:47:12 +00:00
Robert Muir 3843ac5b8b LUCENE-3606: fix more tests 
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/branches/lucene3606@1210308 13f79535-47bb-0310-9956-ffa450edef68
 2011-12-05 01:59:11 +00:00