Commit Graph

31156 Commits

Author SHA1 Message Date
Toke Eskildsen 58a7a8ada5 LUCENE-8374 part 1/4: Reduce reads for sparse DocValues
Offset and index jump-table for IndexedDISI blocks.
2018-12-03 14:23:11 +01:00
Christophe Bismuth 643ffc6f9f LUCENE-8548: The KoreanTokenizer no longer splits unknown words on combining diacritics and
detects script boundaries more accurately with Character#UnicodeScript#of.

Signed-off-by: Jim Ferenczi <jimczi@apache.org>
2018-12-03 10:57:22 +01:00
Gus Heck b6b9f9554e SOLR-12801 fix cut/paste oops in comment 2018-12-02 16:41:55 -05:00
Gus Heck cf4d749410 SOLR-12801 Revert breaking commit a3ec5b5fdf and improve test
to be more complete. Also, add comments to make it easier for
others to understand TimeRoutedAliasUpdateProcessorTest
2018-12-02 16:34:40 -05:00
Jason Gerlowski c951578fca SOLR-6117: Unify ReplicationHandler error handling
Prior to this commit, ReplicationHandler had a few inconsistencies
in how it reported errors:
  - Sometimes the 'status' field was used as an enum (e.g. 'success'
    v. 'failure'.  Elsewhere it is used to hold error messages.
  - Sometimes an explicit 'message' field was used, but often not.
  - Sometimes a stack trace was provided in place of an error message.

This commit tweaks the various error cases in ReplicationHandler to
report errors consistently.  'status' is always an enum-type value.  A
'message' field is provided for all errors, with an optional 'exception'
field.
2018-12-02 16:23:04 -05:00
markrmiller 16241f4484 LUCENE-8546: Fix ant beast to fail and succeed based on whether beasting actually fails or succeeds.
LUCENE-8541: Fix ant beast to not overwrite junit xml results for each beast.iters iteration.
2018-12-02 10:10:10 -06:00
Jason Gerlowski 6e4c9b3b58 SOLR-12555: Use `expectThrows` for expected exceptions
This commit replaces the `try { doX(); fail(); }` pattern with the
`expectThrows` test helper, which was created for this purpose.

This commit makes these changes in the core package:
`o.a.solr.core`.
2018-12-01 17:19:34 -05:00
markrmiller e5281ef3d5 SOLR-12801: Don't possibly block forever in this test in remaining spots. 2018-12-01 13:02:58 -06:00
markrmiller b294d8460f SOLR-12801: Don't possibly block forever in this test in another spot. 2018-12-01 12:55:05 -06:00
markrmiller b5a9cca168 SOLR-12801: Raise THREAD_POOL_MAX_IDLE_TIME_MS. 2018-12-01 12:42:28 -06:00
markrmiller cbe9f82202 SOLR-12801: Don't possibly block forever in this test. 2018-12-01 08:58:13 -06:00
markrmiller 755044b58f SOLR-12801: Wait for collection creation in test. 2018-12-01 08:09:03 -06:00
markrmiller 9b0b9032e2 SOLR-12801: Fix thread leak in test. 2018-12-01 00:53:12 -06:00
markrmiller 33c40a8da4 SOLR-13027: Change retries to work across JVM impls properly by looking for an IOException. 2018-12-01 00:26:15 -06:00
markrmiller 7f88bfa112 SOLR-12801: Wait for collections properly. 2018-12-01 00:26:03 -06:00
markrmiller a3ec5b5fdf SOLR-12801: Wait for executor to finish shutdown. 2018-12-01 00:26:03 -06:00
markrmiller d8f482f5fb SOLR-13030: Update executor usage to work correctly with Java 11 and update Mockito & HttpComponents to work with Java 11 and fix get remote info retry to work across jvms better. 2018-12-01 00:26:02 -06:00
markrmiller a01d0d9ef9 SOLR-13030: Close MetricsHistoryHandler inline. 2018-11-30 18:13:26 -06:00
Chris Hostetter 5dc988f5ee SOLR-12839: JSON 'terms' Faceting now supports a 'prelim_sort' option to use when initially selecting the top ranking buckets, prior to the final 'sort' option used after refinement. 2018-11-30 15:49:06 -07:00
Cassandra Targett 5c4ab188eb SOLR-13023: Ref Guide: Add section to blob store docs on how to delete blobs 2018-11-30 12:31:03 -06:00
David Smiley 0491623933 LUCENE-7875: CHANGES.txt: moved to API changes 2018-11-30 06:20:09 -08:00
javanna cf016f8987 LUCENE-8563: Remove k1+1 constant factor from BM25 formula numerator.
Signed-off-by: Adrien Grand <jpountz@gmail.com>
2018-11-30 09:42:49 +01:00
Namgyu Kim c2ab04775d LUCENE-8575: Improve toString() in SegmentInfo
Signed-off-by: Namgyu Kim <kng0828@gmail.com>
Signed-off-by: Adrien Grand <jpountz@gmail.com>
2018-11-30 09:42:49 +01:00
Adrien Grand c074b97e79 LUCENE-8579: Don't run bad apples when building a release. 2018-11-30 09:42:20 +01:00
markrmiller 75b1831967 SOLR-12801: Make massive improvements to the tests.
SOLR-12804: Remove static modifier from Overseer queue access.

SOLR-12896: Introduce more checks for shutdown and closed to improve clean close and shutdown. (Partial)

SOLR-12897: Introduce AlreadyClosedException to clean up silly close / shutdown logging. (Partial)

SOLR-12898: Replace cluster state polling with ZkStateReader#waitFor. (Partial)

SOLR-12923: The new AutoScaling tests are way too flaky and need special attention. (Partial)

SOLR-12932: ant test (without badapples=false) should pass easily for developers. (Partial)

SOLR-12933: Fix SolrCloud distributed commit.
2018-11-29 11:58:51 -06:00
Jim Ferenczi 81c092d826 LUCENE-8529: TopSuggestDocsCollector will now use the completion key to tiebreak completion
suggestions with identical scores.
2018-11-28 17:32:13 +01:00
David Smiley 2611c22b6b SOLR-12398: retroactively add CHANGES.txt back-compat break for 7.5 2018-11-28 07:21:34 -08:00
Christoph Büscher ecce083c50 LUCENE-8573: Use FutureArrays#mismatch in BKDWriter
Closes #510

Signed-off-by: Adrien Grand <jpountz@gmail.com>
2018-11-28 10:18:35 +01:00
Cassandra Targett 2715beb6df SOLR-12497: fix typo 2018-11-27 13:56:19 -06:00
Joel Bernstein c2cac88770 SOLR-12984: The search Streaming Expression should properly support and push down paging when using the /select handler 2018-11-27 11:22:02 -05:00
David Smiley 1534bbe4ae SOLR-5211: fix test 2018-11-27 07:50:01 -08:00
Michael Sokolov 6728f0c4f4 update comment after limiting number of debug tokens 2018-11-27 06:00:29 -05:00
Michael Sokolov 34ed01543a fixing javadoc; added docs for parameters of new method 2018-11-27 06:00:29 -05:00
Michael Sokolov 54907903e8 LUCENE-8517: do not wrap FixedShingleFilter with conditional in TestRandomChains 2018-11-27 06:00:29 -05:00
iverase 72ca4488d1 LUCENE-8562: Speed up merging segments of points with data dimensions by only sorting on the indexed dimensions 2018-11-27 10:26:49 +01:00
Cassandra Targett 68c0774458 SOLR-12740: revise migration docs for clarity and typos 2018-11-26 12:15:15 -06:00
David Smiley dc134be449 SOLR-5211: ignore temporarily pending moshe fixing 2018-11-26 10:11:21 -05:00
Moshe a346ba0d3c SOLR-5211: Always populate _root_ (if defined).
And, small refactor: Clarified how _version_ is transferred from root to children.
2018-11-25 21:47:49 -05:00
Mikhail Khludnev d7b878e90c SOLR-12546: Let csv response writer to handle docValues fields by default. 2018-11-25 11:26:39 +03:00
Jim Ferenczi 2da72ad05c LUCENE-8570: Fix possible NPE in the attribute reflection of the Nori's PartOfSpeechAttributeImpl 2018-11-23 10:31:28 +01:00
Alan Woodward 2459072286 SOLR-12775: Add deprecated versions of LowerCaseTokenizer and LowerCaseTokenizerFactory 2018-11-22 13:54:39 +00:00
Simon Willnauer f7fa25069e [TEST] Prevent merges in simple tests that compare doc stats from IW 2018-11-22 14:20:29 +01:00
Andrzej Bialecki 67cdd21996 SOLR-9856: Update the Ref Guide to no longer list this issue as unresolved. 2018-11-21 19:13:02 +01:00
Simon Willnauer 56cb42d200 LUCENE-8569: Never count soft-deletes if reader has no hard-deletes
Today we count the actual soft-deletes during a merge which is
unnecessary if there are no hard-deletes present. In this case, which
is considered to be the common case we can get accurate counts by substracting
the number of deleted docs in the wrapped reader from the number of soft-deletes
in that reader.
2018-11-21 14:29:00 +01:00
Simon Willnauer 5f8855ee0b LUCENE-8571: Don't block on FrozenBufferedUpdates#apply during IW#processEvents
While indexing we try to apply frozen deletes packages concurrently
on indexing threads if necessary. This is done in an opaque way via
IndexWriter#processEvents. Yet, when we commit or refresh we have to
ensure we apply all frozen update packages before we return.
Today we execute the apply method in a blocking fashion which is unncessary
when we are in a IndexWriter#processEvents context, we block indexing
threads while they could just continue since it's already being applied.
We also might wait in BufferedUpdatesStream when we apply all necessary updates
were we can continue with other work instead of waiting.
This change also tries to apply the packages that are not currently applied
first in order to not unnecessarily block.
2018-11-21 14:20:19 +01:00
Jim Ferenczi 08dd681f0f LUCENE-8216: improve error message when field weight is invalid 2018-11-21 10:27:51 +01:00
Jim Ferenczi fd96bc5ca6 LUCENE-8216: Added a new BM25FQuery in sandbox to blend statistics across several fields using the BM25F formula 2018-11-21 10:24:30 +01:00
Noble Paul 492c3440de SOLR-13006: ZkNodeProps to be able to load from both javabin and JSON 2018-11-21 18:20:03 +11:00
Christine Poerschke ea304a3a32 Remove excess <metrics> element in metrics-reporting.adoc file. 2018-11-20 18:50:25 +00:00
Cao Manh Dat 05167ed01d SOLR-12986: HttpPartitionTest reliably failing seed 2018-11-20 15:01:19 +00:00