Commit Graph

31326 Commits

Author SHA1 Message Date
markrmiller 38cfd0e259 SOLR-13040: Add AwaitsFix annotation to TestSQLHandler and improve exception information related to that test. 2018-12-05 19:34:13 -06:00
Simon Willnauer b0e6a92ede LUCENE-8590: Optimize DocValues update datastructures
Today we are using a LinkedHashMap to buffer doc-values updates in
BufferedUpdates. This on the one hand uses an Object based datastructure
and on the other requires re-encoding the data into a more compact representation
once the BufferedUpdates are frozen. This change uses a more compact represenation
for the updates already in the BufferedUpdates in a parallel-array like datastructure
that can be reused in FrozenBufferedDeletes. It also adds an much simpler to use
API to consume the updates and allows for internal memory optimization for common
case updates.
2018-12-05 17:22:40 +01:00
Cassandra Targett c81822e157 SOLR-12422: Add section on performance issues with Solr Cell; Overhaul and re-organize entire page 2018-12-04 15:08:22 -06:00
Cassandra Targett ad373ff36e Ref Guide: typo in "parameter" 2018-12-04 15:08:22 -06:00
Jason Gerlowski a5fb6f8adc Add 'prelim_sort' helper to SolrJ's TermsFacetMap 2018-12-04 14:29:29 -05:00
Chris Hostetter 868e005760 SOLR-13032: harden MaxSizeAutoCommitTest to eliminate race conditions and eliminate use of arbitrary sleep 2018-12-04 10:44:05 -07:00
Shai Erera ca4555ed93 close DirectoryReader in test 2018-12-04 16:37:35 +02:00
Shai Erera f637c50c11 fix typo 2018-12-04 16:36:14 +02:00
Jason Gerlowski f7faae075b SOLR-13019: Fix typo in MailEntityProcessor
Path provided by Tommy Marshment-Howell.

Closes #509
2018-12-04 08:49:58 -05:00
Alan Woodward c78429a554 LUCENE-8586: Fix infinite loop in Intervals.or() 2018-12-04 09:47:42 +00:00
Alan Woodward 75a053dd69 LUCENE-8509: WordDelimiterGraphFilter no longer adjusts offsets by default 2018-12-04 09:47:42 +00:00
Alan Woodward f5867a1413 LUCENE-8564: Add GraphTokenFilter 2018-12-04 09:47:42 +00:00
Toke Eskildsen 6c11161111 Pre-commit fixes for LUCENE-8374 (JavaDoc + arguments) 2018-12-04 10:05:09 +01:00
Gus Heck 59919b4ac0 SOLR-13036 Fix retry logic in JettySolrRunner 2018-12-03 21:54:34 -05:00
markrmiller e14432efd8 SOLR-12801: Wait for thread on close and add AwaitsFix annotation - most of these sim tests can fail to elect shard leaders. 2018-12-03 17:40:51 -06:00
markrmiller e3cbdd0505 SOLR-13032: Add @AwaitsFix annotation to test. 2018-12-03 11:07:40 -06:00
markrmiller 1408f5255f SOLR-12801: Disable TimeRoutedAliasUpdateProcessorTest because the feature leaks threads. 2018-12-03 09:07:27 -06:00
Toke Eskildsen e356d793ca LUCENE-8374 part 4/4: Reduce reads for sparse DocValues
Offset and index jump-table for norm blocks.
2018-12-03 14:30:30 +01:00
Toke Eskildsen 7949b98f80 LUCENE-8374 part 3/4: Reduce reads for sparse DocValues
Offset jump-table for variable bits per value blocks.
2018-12-03 14:29:54 +01:00
Toke Eskildsen 7ad027627a LUCENE-8374 part 2/4: Reduce reads for sparse DocValues
Index jump-table for DENSE indexedDISI blocks.
2018-12-03 14:24:40 +01:00
Toke Eskildsen 58a7a8ada5 LUCENE-8374 part 1/4: Reduce reads for sparse DocValues
Offset and index jump-table for IndexedDISI blocks.
2018-12-03 14:23:11 +01:00
Christophe Bismuth 643ffc6f9f LUCENE-8548: The KoreanTokenizer no longer splits unknown words on combining diacritics and
detects script boundaries more accurately with Character#UnicodeScript#of.

Signed-off-by: Jim Ferenczi <jimczi@apache.org>
2018-12-03 10:57:22 +01:00
Gus Heck b6b9f9554e SOLR-12801 fix cut/paste oops in comment 2018-12-02 16:41:55 -05:00
Gus Heck cf4d749410 SOLR-12801 Revert breaking commit a3ec5b5fdf and improve test
to be more complete. Also, add comments to make it easier for
others to understand TimeRoutedAliasUpdateProcessorTest
2018-12-02 16:34:40 -05:00
Jason Gerlowski c951578fca SOLR-6117: Unify ReplicationHandler error handling
Prior to this commit, ReplicationHandler had a few inconsistencies
in how it reported errors:
  - Sometimes the 'status' field was used as an enum (e.g. 'success'
    v. 'failure'.  Elsewhere it is used to hold error messages.
  - Sometimes an explicit 'message' field was used, but often not.
  - Sometimes a stack trace was provided in place of an error message.

This commit tweaks the various error cases in ReplicationHandler to
report errors consistently.  'status' is always an enum-type value.  A
'message' field is provided for all errors, with an optional 'exception'
field.
2018-12-02 16:23:04 -05:00
markrmiller 16241f4484 LUCENE-8546: Fix ant beast to fail and succeed based on whether beasting actually fails or succeeds.
LUCENE-8541: Fix ant beast to not overwrite junit xml results for each beast.iters iteration.
2018-12-02 10:10:10 -06:00
Jason Gerlowski 6e4c9b3b58 SOLR-12555: Use `expectThrows` for expected exceptions
This commit replaces the `try { doX(); fail(); }` pattern with the
`expectThrows` test helper, which was created for this purpose.

This commit makes these changes in the core package:
`o.a.solr.core`.
2018-12-01 17:19:34 -05:00
markrmiller e5281ef3d5 SOLR-12801: Don't possibly block forever in this test in remaining spots. 2018-12-01 13:02:58 -06:00
markrmiller b294d8460f SOLR-12801: Don't possibly block forever in this test in another spot. 2018-12-01 12:55:05 -06:00
markrmiller b5a9cca168 SOLR-12801: Raise THREAD_POOL_MAX_IDLE_TIME_MS. 2018-12-01 12:42:28 -06:00
markrmiller cbe9f82202 SOLR-12801: Don't possibly block forever in this test. 2018-12-01 08:58:13 -06:00
markrmiller 755044b58f SOLR-12801: Wait for collection creation in test. 2018-12-01 08:09:03 -06:00
markrmiller 9b0b9032e2 SOLR-12801: Fix thread leak in test. 2018-12-01 00:53:12 -06:00
markrmiller 33c40a8da4 SOLR-13027: Change retries to work across JVM impls properly by looking for an IOException. 2018-12-01 00:26:15 -06:00
markrmiller 7f88bfa112 SOLR-12801: Wait for collections properly. 2018-12-01 00:26:03 -06:00
markrmiller a3ec5b5fdf SOLR-12801: Wait for executor to finish shutdown. 2018-12-01 00:26:03 -06:00
markrmiller d8f482f5fb SOLR-13030: Update executor usage to work correctly with Java 11 and update Mockito & HttpComponents to work with Java 11 and fix get remote info retry to work across jvms better. 2018-12-01 00:26:02 -06:00
markrmiller a01d0d9ef9 SOLR-13030: Close MetricsHistoryHandler inline. 2018-11-30 18:13:26 -06:00
Chris Hostetter 5dc988f5ee SOLR-12839: JSON 'terms' Faceting now supports a 'prelim_sort' option to use when initially selecting the top ranking buckets, prior to the final 'sort' option used after refinement. 2018-11-30 15:49:06 -07:00
Cassandra Targett 5c4ab188eb SOLR-13023: Ref Guide: Add section to blob store docs on how to delete blobs 2018-11-30 12:31:03 -06:00
David Smiley 0491623933 LUCENE-7875: CHANGES.txt: moved to API changes 2018-11-30 06:20:09 -08:00
javanna cf016f8987 LUCENE-8563: Remove k1+1 constant factor from BM25 formula numerator.
Signed-off-by: Adrien Grand <jpountz@gmail.com>
2018-11-30 09:42:49 +01:00
Namgyu Kim c2ab04775d LUCENE-8575: Improve toString() in SegmentInfo
Signed-off-by: Namgyu Kim <kng0828@gmail.com>
Signed-off-by: Adrien Grand <jpountz@gmail.com>
2018-11-30 09:42:49 +01:00
Adrien Grand c074b97e79 LUCENE-8579: Don't run bad apples when building a release. 2018-11-30 09:42:20 +01:00
markrmiller 75b1831967 SOLR-12801: Make massive improvements to the tests.
SOLR-12804: Remove static modifier from Overseer queue access.

SOLR-12896: Introduce more checks for shutdown and closed to improve clean close and shutdown. (Partial)

SOLR-12897: Introduce AlreadyClosedException to clean up silly close / shutdown logging. (Partial)

SOLR-12898: Replace cluster state polling with ZkStateReader#waitFor. (Partial)

SOLR-12923: The new AutoScaling tests are way too flaky and need special attention. (Partial)

SOLR-12932: ant test (without badapples=false) should pass easily for developers. (Partial)

SOLR-12933: Fix SolrCloud distributed commit.
2018-11-29 11:58:51 -06:00
Jim Ferenczi 81c092d826 LUCENE-8529: TopSuggestDocsCollector will now use the completion key to tiebreak completion
suggestions with identical scores.
2018-11-28 17:32:13 +01:00
David Smiley 2611c22b6b SOLR-12398: retroactively add CHANGES.txt back-compat break for 7.5 2018-11-28 07:21:34 -08:00
Christoph Büscher ecce083c50 LUCENE-8573: Use FutureArrays#mismatch in BKDWriter
Closes #510

Signed-off-by: Adrien Grand <jpountz@gmail.com>
2018-11-28 10:18:35 +01:00
Cassandra Targett 2715beb6df SOLR-12497: fix typo 2018-11-27 13:56:19 -06:00
Joel Bernstein c2cac88770 SOLR-12984: The search Streaming Expression should properly support and push down paging when using the /select handler 2018-11-27 11:22:02 -05:00