Robert Muir
|
bca62a44d3
|
LUCENE-3929: add a test demonstrating this works
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1305870 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-27 15:16:42 +00:00 |
|
Robert Muir
|
ae0f44fcb9
|
remaining eol-style fixes to trunk, native except .sh (LF)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1305492 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-26 18:57:08 +00:00 |
|
Robert Muir
|
35705cc396
|
LUCENE-3919: fix czechstemmer aioobe on the empty term
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1305177 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-25 23:40:44 +00:00 |
Steven Rowe
|
fb33754168
|
LUCENE-3881: Added UAX29URLEmailAnalyzer
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1304975 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-25 01:20:55 +00:00 |
|
Steven Rowe
|
ada9780484
|
LUCENE-3913: Fix HTMLStripCharFilter invalid final offset for input containing </br>
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1304912 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-24 20:54:31 +00:00 |
|
Robert Muir
|
f597b9a1cc
|
LUCENE-3883: Irish Analyzer
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1304836 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-24 15:59:04 +00:00 |
Michael McCandless
|
7291d38535
|
LUCENE-3905: sometimes run real-ish content (from LineFileDocs) through the analyzers too; fix end() offset bugs in the ngram tokenizers/filters
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1304525 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-23 17:39:13 +00:00 |
|
Robert Muir
|
a6fd306dfb
|
add missing license headers
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303738 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-22 11:33:45 +00:00 |
|
Michael McCandless
|
1a191f4edc
|
LUCENE-3898: reset() was missing some state
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303441 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-21 15:22:28 +00:00 |
|
Michael McCandless
|
595744089a
|
LUCENE-3896: CharacterUtils.fill must call Reader.read again if it only got a single high surrogate char on the first read
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303374 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-21 12:53:27 +00:00 |
|
Robert Muir
|
f75d40dad5
|
LUCENE-3894: try toning down for this tokenizer (it builds lots of tokens from the input treated as a path)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303276 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-21 04:30:11 +00:00 |
|
Robert Muir
|
1156de050f
|
LUCENE-3894: add large docs tests for more tokenizers
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303273 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-21 03:59:14 +00:00 |
|
Robert Muir
|
3d73a3014e
|
LUCENE-3896: beef up TestDuelingAnalyzers for larger documents
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303253 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-21 01:52:22 +00:00 |
|
Michael McCandless
|
c20242721f
|
LUCENE-3894: some tokenizers weren't reading all input chars
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303193 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-20 23:02:37 +00:00 |
|
Robert Muir
|
b7a7e5a625
|
LUCENE-3889: remove unnecessary/unused base class
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1303026 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-20 17:28:26 +00:00 |
Jan Høydahl
|
5648222e86
|
SOLR-2764: Fix testcase for minimal stemmer
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1302872 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-20 13:12:39 +00:00 |
|
Jan Høydahl
|
54d48eb98b
|
SOLR-2764: Create a NorwegianLightStemmer and NorwegianMinimalStemmer
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1302833 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-20 10:57:50 +00:00 |
|
Robert Muir
|
790323780f
|
basic javadocs improvements, mostly simple descriptions where the class had nothing before
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1302752 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-20 02:09:25 +00:00 |
|
Robert Muir
|
4a2b1d974a
|
javadocs: add missing package.htmls
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1302713 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-19 23:20:25 +00:00 |
|
Steven Rowe
|
c4f72f61ac
|
LUCENE-3880: UAX29URLEmailTokenizer now recognizes emails when the mailto: scheme is prepended.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1302265 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-19 03:13:52 +00:00 |
|
Robert Muir
|
3d2d144f92
|
LUCENE-3848: don't produce tokenstreams that start with posinc=0
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1301478 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-16 13:06:30 +00:00 |
Uwe Schindler
|
3d8b22ffd0
|
LUCENE-3850: Fix rawtypes warnings for Java 7 compiler (#2)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1297162 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-05 18:48:04 +00:00 |
|
Uwe Schindler
|
989530e17e
|
LUCENE-3850: Fix rawtypes warnings for Java 7 compiler
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1297048 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-05 13:34:40 +00:00 |
Christian Moen
|
430365f7cc
|
Kuromoji now produces both compound words and the segmentation of those words in search mode (LUCENE-3767)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1296805 13f79535-47bb-0310-9956-ffa450edef68
|
2012-03-04 13:34:13 +00:00 |
Dawid Weiss
|
8c2e3cef8f
|
LUCENE-3820: limiting the amount of input for pattern matching to go past exponential time patterns, even if they happen. A nice catch from Mike too -- un-ignore testNastyPattern and look at processing time go wild with each additional input character...
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1294797 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-28 19:26:05 +00:00 |
|
Dawid Weiss
|
f3cc65733b
|
Sysout of the randomized pattern.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1294518 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-28 08:15:38 +00:00 |
|
Dawid Weiss
|
4d401ca87d
|
Test thread's name reflects the current seed.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1294514 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-28 08:04:42 +00:00 |
|
Dawid Weiss
|
493bd8b42f
|
LUCENE-3820: optimistic limit on running time for the randomized pattern test. This doesn't eliminate the possibility of hitting an exponential time pattern, but I re-run a few times and it seems to be pretty stbale.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1294322 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-27 20:50:24 +00:00 |
|
Dawid Weiss
|
7be5533989
|
LUCENE-3820: Wrong trailing index calculation in PatternReplaceCharFilter.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1294141 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-27 13:13:10 +00:00 |
|
Robert Muir
|
6a07201844
|
don't fail test due to jre bugs in String.toLowerCase
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1243415 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-13 04:50:12 +00:00 |
|
Robert Muir
|
590741dcfe
|
LUCENE-3766: Remove Tokenizer's default ctor
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1242890 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-10 19:12:35 +00:00 |
|
Robert Muir
|
8a50cefc6b
|
LUCENE-3748: EnglishPossessiveFilter did not work with a proper right quotation mark
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1242740 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-10 11:01:11 +00:00 |
|
Robert Muir
|
72ae3171be
|
LUCENE-3765: Trappy behavior with StopFilter/ignoreCase
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1242497 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-09 19:59:50 +00:00 |
|
Robert Muir
|
c0319d5928
|
SOLR-3056: document expectations in these files
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1241960 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-08 16:27:47 +00:00 |
|
Robert Muir
|
dac1b58277
|
SOLR-3097, SOLR-3105: add fieldtypes for different languages to the example
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1241878 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-08 12:07:52 +00:00 |
Tommaso Teofili
|
6d3bb736f3
|
[LUCENE-3744] - applied patch for whiteList usage in TypeTokenFilter
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1240034 13f79535-47bb-0310-9956-ffa450edef68
|
2012-02-03 09:13:17 +00:00 |
|
Michael McCandless
|
8e40ea5bf8
|
LUCENE-3742: fix token offset for hangs-off-end output in SynonymFilter
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1238851 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-31 23:01:55 +00:00 |
|
Uwe Schindler
|
10ba9abeb2
|
Reverse merged revision(s) from lucene/dev/trunk up to 1237502
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/branches/lucene2858@1237505 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-29 23:19:05 +00:00 |
|
Michael McCandless
|
d1165b1972
|
LUCENE-3725: add optional packing to FSTs
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1237500 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-29 22:48:45 +00:00 |
|
Robert Muir
|
d7fe56ddae
|
LUCENE-2858: fix analyzer
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/branches/lucene2858@1237312 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-29 15:16:04 +00:00 |
|
Steven Rowe
|
97d62cc383
|
Fix offset array assertion off-by-one
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1236912 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-27 22:43:48 +00:00 |
|
Robert Muir
|
6edfe4f157
|
LUCENE-3717: add tests
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1235199 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-24 10:40:46 +00:00 |
|
Robert Muir
|
35a73d5f55
|
LUCENE-3717: fix broken offsets in ngramtokenizers, and check return value of Reader.read
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1235187 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-24 09:50:21 +00:00 |
|
Robert Muir
|
7fafdd3576
|
LUCENE-3717: add checkRandomData to more analyzers and fix more offsets bugs
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234850 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-23 15:19:58 +00:00 |
|
Steven Rowe
|
059410d424
|
LUCENE-3690: fix handling of unpaired numeric character entity UTF-16 surrogates to output U+FFFD REPLACEMENT CHARACTER; and add handling of properly paired numeric character entity UTF-16 surrogates, to output the corresponding pair of code units.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234687 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-23 07:36:38 +00:00 |
|
Robert Muir
|
c754c1c9c8
|
LUCENE-3717: add better offsets testing to BaseTokenStreamTestCase, fix offsets bugs in ThaiWordFilter and ICUTokenizer
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234652 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-23 00:08:52 +00:00 |
|
Robert Muir
|
a7cfee6b07
|
SOLR-2891: fix CompoundWordTokenFilter to not create invalid offsets when the length of the text was changed by a previous filter
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234546 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-22 16:41:06 +00:00 |
|
Steven Rowe
|
f3a363708f
|
LUCENE-3690: Re-implemented HTMLStripCharFilter as a JFlex-generated scanner. Fixes LUCENE-2208, SOLR-882, and SOLR-42.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234452 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-22 05:20:46 +00:00 |
|
Uwe Schindler
|
af9b4d816f
|
LUCENE-3671: Add TypeTokenFilter that filters tokens based on their TypeAttribute
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1234396 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-21 19:02:44 +00:00 |
|
Michael McCandless
|
87bc4521c2
|
LUCENE-3695: move some confusing FST sugar out
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1231795 13f79535-47bb-0310-9956-ffa450edef68
|
2012-01-15 23:25:38 +00:00 |