Commit Graph

31796 Commits

Author SHA1 Message Date
Simon Willnauer 165d2d5ff5 LUCENE-8813: Ensure we never apply deletes from a closed DWPTDeleteQueue
Today we don't have a strong protection that we add and apply deletes / updates
on or from an already flushed delete queue. DWPTDeleteQueue instances are replaced
once we do a full flush in order to reopen an NRT reader or commit the IndexWriter.

In LUCENE-8813 we tripped an assert that used to protect us from such an situation
but it didn't take all cornercases from concurrent flushing into account. This change
adds a stronger protection and ensures that we neither apply a closed delete queue nor
add any updates or deletes to it.

This change also allows to speculativly freeze the global buffer that might return
null now if the queue has already been closed. This is now possible since we ensure that
we never see modifications to the queue after it's been closed and that happens right after
the last DWPT for the ongoing full flush is done flushing.
2019-05-28 16:44:34 +02:00
jimczi db334c792b LUCENE-8784: Restore the Korean's part of speech tag for NGRAM.
The part of speech tag for unigram has been changed inadvertenly in a previous commit (not released).
This change restores the original value that is also set on the serialized unkwnown dictionary.
2019-05-28 12:01:05 +02:00
Andrzej Bialecki 32ad372433 SOLR-12941: Fix IndexSizeTrigger to correctly work with "aboveBytes" and "splitMethod=link" parameters. 2019-05-28 11:34:57 +02:00
Simon Willnauer 171d7f131f LUCENE-8813: Count down latch in finally block.
This test hangs until it times-out when an assertion is tripped
in the indexing thread. Counting down the latch in a finally block
will cause the test to fail earlier.
2019-05-28 10:55:18 +02:00
Adrien Grand c252b92caa LUCENE-8135: Fix number of clauses randomization. 2019-05-28 09:53:58 +02:00
Noble Paul 6ac31c6db3
SOLR-13493: /autoscaling/suggestions to be able to filter by type (#686)
* SOLR-13493: /autoscaling/suggestions to be able to filter by type
2019-05-28 07:20:12 +10:00
Erick Erickson 57b64f2684 SOLR-12562: Reverting Clean up RealTimeGetComponent.toSolrDoc (sha 97e7d8a3d7 and 15aa9dfb3d) 2019-05-27 08:34:48 -07:00
Namgyu Kim a556925eb8 LUCENE-8784: The KoreanTokenizer now preserves punctuations if discardPunctuation is set to false (defaults to true).
Signed-off-by: Namgyu Kim <kng0828@gmail.com>
Signed-off-by: jimczi <jimczi@apache.org>
2019-05-27 15:15:24 +02:00
Erick Erickson 97e7d8a3d7 SOLR-12652: Clean up RealTimeGetComponent.toSolrDoc 2019-05-26 08:23:53 -07:00
Chris Hostetter af4e1d324a Fix TestCloudSearcherWarming to work around SOLR-13490
Also clean up some crufty System.out/System.err pollution
2019-05-25 08:40:04 -07:00
Colin Goodheart-Smithe 46060d88a2 LUCENE-8803: Provide a FieldComparator to allow sorting by a feature from a FeatureField (#680)
This change adds a SortField which allows a convenient way to sort search hits using a feature from a FeatureField.
2019-05-24 08:45:57 +02:00
Erick Erickson 379e6f64b8 SOLR-13454: Investigate ReindexCollectionTest failures 2019-05-23 08:43:34 -07:00
Nhat Nguyen 0435348b29 LUCENE-8809: Ensure release segment states
If refresh and rollback happen concurrently, then we can leave segment
states unreleased leads to leaking refCount of some SegmentReaders.
2019-05-23 11:25:28 -04:00
Noble Paul 123850d708 SOLR-13484: typo 2019-05-23 17:15:50 +10:00
Noble Paul c5e8fd3062
SOLR-13484: CHANGES.txt 2019-05-23 17:14:40 +10:00
Noble Paul e9d9f4dcc1 SOLR-13484: ref guide 2019-05-23 17:06:29 +10:00
Noble Paul 975a4f8f55 Merge remote-tracking branch 'origin/master' into jira/SOLR-13484 2019-05-23 16:59:14 +10:00
Noble Paul da5e46fc5a SOLR-13484: ref guide 2019-05-23 16:56:48 +10:00
Noble Paul a1c9f8f7db SOLR-13484: refactored code 2019-05-23 12:50:09 +10:00
Chris Hostetter 3ed31cfbc7 Fix TestStressCloudBlindAtomicUpdates to play nice with tests.dups 2019-05-22 11:22:52 -07:00
Adrien Grand 97046c7054 LUCENE-8757: Fix test bug. 2019-05-22 09:10:52 +02:00
noble 750a5fdd02 SOLR-13484:
autoscaling/diagnostics APIshould be able to give diagnostics output from config pasted as a payload
2019-05-22 16:22:20 +10:00
Atri Sharma 87e936f1bb LUCENE-8757: Improving Default Segments To Thread Mapping Algorithm
The current slicing algorithm assigns a thread per segment, which
can be detrimental to performance in case the distribution has
a large number of small segments. The patch introduces a slicing
algorithm which coalesces smaller segments to a single thread,
thus reducing the impact of context switching by limiting the
number of threads

Signed-off-by: Adrien Grand <jpountz@gmail.com>
2019-05-21 20:18:42 +02:00
Namgyu Kim 5a694ea26f LUCENE-8805: Parameter changes for stringField() in StoredFieldVisitor
Signed-off-by: Namgyu Kim <kng0828@gmail.com>
Signed-off-by: Adrien Grand <jpountz@gmail.com>
2019-05-21 20:18:42 +02:00
Cassandra Targett 644af43c12 Ref Guide: Upgrade notes for Solr 8.1 2019-05-21 12:51:43 -05:00
Cassandra Targett 359a436c40 SOLR-13361: Add major changes in 8.0 for Ref Guide 2019-05-21 12:51:43 -05:00
Uwe Schindler c756b50ae4 LUCENE-8807: Change all download URLs in build files to HTTPS 2019-05-21 17:06:00 +02:00
jimczi 4640a527a4 LUCENE:8770: BlockMaxConjunctionScorer now leverages two-phase iterators in order to avoid executing the second phase when scorers don't intersect 2019-05-21 11:35:44 +02:00
Jan Høydahl 0cb92993db SOLR-13363: Fix zk version in "Version of major components" 2019-05-21 09:03:51 +02:00
Adrien Grand ec6ac9756c LUCENE-8804: Forbid calls to putAttribute on frozen FieldType instances. 2019-05-20 20:23:08 +02:00
Andrzej Bialecki ed4b789bf4 Add new version number for 8.1.1 release. Move the SOLR-13475 entry to the correct section. 2019-05-20 20:14:21 +02:00
Chris Hostetter 6cc67e433e SOLR-13474: Fix "Search is temporarily disabled" logic to be consistent for entire request
SOLR-13469: Fix rejected requests during full disk full + IndexFetch to use 503 not 403
2019-05-20 10:24:02 -07:00
Andrzej Bialecki 93e57e63cd SOLR-13475: Null Pointer Exception when querying collection through collection alias. 2019-05-20 15:19:35 +02:00
Andrzej Bialecki 62f969403a SOLR-13437: Add a missing package description. 2019-05-20 12:57:54 +02:00
Stefan Billet 2ad39e972d SOLR-12584: Describe getting Prometheus metrics from a secure Solr (#662) 2019-05-20 10:54:06 +02:00
Jan Høydahl 18cb42ee80 SOLR-13479: Harden OverseerTaskQueueTest 2019-05-17 20:54:46 +02:00
Alessandro Benedetti b9db118ed3 SOLR-12304: MLT component now supports mlt.interestingTerms 2019-05-16 23:11:43 -04:00
Noble Paul 9d7c1923e4 SOLR-13468: remove license files 2019-05-17 05:28:11 +10:00
Noble Paul 1581d798b4 SOLR-13468: unused imports 2019-05-17 04:12:42 +10:00
Cassandra Targett c726ada1d9 SOLR-13468: fix ref guide build failures 2019-05-16 05:36:25 -05:00
Ishan Chattopadhyaya 04b61e3dee Updating DOAP for 8.1 release 2019-05-16 12:49:25 +05:30
David Smiley 3a88ab616c SOLR-13467: Include the S2 Geometry lib to make it simpler to use prefixTree="s2" on a Geo3D spatial field.
* Improved documentation on Geo3D.
* Better testing for Geo3D.
2019-05-15 22:15:13 -04:00
Noble Paul bd64ed6d2a
SOLR-13437: fork noggit code into Solr (#666)
* SOLR-13437: fork noggit code into Solr
2019-05-16 11:10:27 +10:00
Noble Paul 82ede903f6 SOLR-13468: added ref-guide 2019-05-16 08:33:08 +10:00
Noble Paul c464d8a719
SOLR-13468: autoscaling/suggestions should be able to give suggestions from config sent as a payload (#678)
* SOLR-13468: autoscaling/suggestions should be able to give suggestions from config sent as a payload
2019-05-16 07:31:08 +10:00
Erick Erickson 9ff5eb30af SOLR-11558: It would be nice if the Graph section of the Cloud tab in the Admin UI could give some more information about the replicas of a collection 2019-05-15 11:35:18 -07:00
Chris Hostetter 7ef5d5fe5f SOLR-13440: fix precommit failures 2019-05-14 13:35:59 -07:00
Chris Hostetter bf8c6ea435 SOLR-12999: Harden TestReplicationHandlerDiskOverFlow against sporadic timing failures
- ensure IndexFetcher injection is reset in @After method
 - replace System.out with Logger
 - Log and fail on any exceptions in any callbacks/threads
 - use CyclicBarrier (instead of CountdownLatch) to ensure the Query Thread loop doesn't monopolize
   CPU preventing IndexFetcher callback from ever being run

(Some of these improvements directly address jenkins failures we've been seeing)
2019-05-14 13:35:19 -07:00
Dawid Weiss 3764c727e5 SOLR-13462: Update dependency definitions to include Ukrainian dictionary. 2019-05-14 21:29:52 +02:00
Andrzej Bialecki de29d0d948 SOLR-13440: Fix occasional test failures by providing assert helpers aware of simulation
artifacts.
2019-05-14 19:03:02 +02:00