Commit Graph

8482 Commits

Author SHA1 Message Date
Atri Sharma b381595f55 Fix NPE in CB Config Resolution 2020-08-27 20:52:12 +05:30
Atri Sharma 6a7da3cd50
Update Circuit Breaker configured as a standard plugin (#1785) 2020-08-27 14:06:22 +05:30
Adrien Grand 741251b1c3 LUCENE-9447: Fix test failure. 2020-08-26 12:55:46 +02:00
Adrien Grand 913976dbf7
LUCENE-9447: Make BEST_COMPRESSION better with highly compressible data. (#1762)
This makes BEST_COMPRESSION split blocks into sub blocks and use preset
dictionaries to improve compression ratios.
2020-08-26 11:04:34 +02:00
Philipp Trulson f4c4fbcafc SOLR-14752: Fix error in Zookeeper status when Prometheus plugin is enabled in ZK
Signed-off-by: Jan Høydahl <janhoy@apache.org>
2020-08-26 10:03:42 +02:00
Simon Willnauer 8294e1ae20
LUCENE-8962: Merge segments on getReader (#1623)
Add IndexWriter merge-on-refresh feature to selectively merge 
small segments on getReader, subject to a configurable timeout, 
to improve search performance by reducing the number of small 
segments for searching.

Co-authored-by: Mike McCandless <mikemccand@apache.org>
2020-08-24 20:19:08 +02:00
Atri Sharma 96a853b200
SOLR-14772: Fix TestConfigOverlay (#1778) 2020-08-24 22:34:23 +05:30
noblepaul 1c8f4c988a SOLR-14750: use core id to avoid duplicate core reloads 2020-08-22 17:53:55 +10:00
Erick Erickson c9c75810c2 Revert "LUCENE-9433: Remove Ant support from trunk"
This reverts commit 37cd17dc
2020-08-21 16:57:58 -04:00
Anderson Dorow 66b6ce2cd0
SOLR-13438: on collection delete, also delete .AUTOCREATED config set (#1759)
Co-authored-by: Anderson Dorow <Anderson.Dorow@zooplus.com>
2020-08-21 14:43:16 -05:00
Erick Erickson 37cd17dcf5 LUCENE-9433: Remove Ant support from trunk 2020-08-21 15:19:52 -04:00
Atri Sharma 2f37f40171
SOLR-14615: Implement CPU Utilization Based Circuit Breaker (#1737)
This commit introduces CPU based circuit breaker. This circuit breaker
tracks the average CPU load per minute and triggers if the value exceeds
a configurable value.

This commit also adds a specific control flag for Memory Circuit Breaker
to allow enabling/disabling the same.
2020-08-20 13:21:26 +05:30
Noble Paul 8caf57d50b
SOLR-14750: TestBulkSchemaConcurrent fails often(#1760) 2020-08-19 10:52:12 +10:00
Ishan Chattopadhyaya 77a4d495cc SOLR-14731: Rename @SolrSingleThreaded to @SolrThreadUnsafe, mark DistribPackageStore with the annotation
Co-authored-by: Marcus <marcuseagan@gmail.com>
2020-08-18 16:21:38 +05:30
Atri Sharma 4fed9ff8d3 Move TestRequestRateLimiter to Nightly 2020-08-18 13:43:49 +05:30
Andrzej Bialecki d9fb14dec1 SOLR-13858: Remove no longer used field and getter. 2020-08-17 14:47:38 +02:00
David Smiley 0ce2d610c2
SOLR-14722: timeAllowed should track from req creation (#1726)
* set(long) instead of set(Long).
* Fix javadocs CommonParams.TIME_ALLOWED
2020-08-15 00:41:07 -04:00
Yuriy Koval 44c4e6ef31
SOLR-14703 Edismax parser replaces whitespace characters with spaces (#1713) 2020-08-14 14:12:53 -04:00
Noble Paul d517361bb1
SOLR-14680: Provide an implementation for the new SolrCluster API (#1730) 2020-08-13 13:34:24 +10:00
Jason Gerlowski a6515ca38f SOLR-14748: Correct condition on startup auth/ssl logging 2020-08-12 18:44:02 -04:00
andywebb1975 e72a0d66c6
SOLR-13751: add BooleanSimilarityFactory (#867) 2020-08-12 15:35:50 +01:00
Andrzej Bialecki a5543dfb51 SOLR-14470: Fix test failures by reducing the randomness of test data. 2020-08-12 13:45:25 +02:00
Atri Sharma 1d2749295b
Harden RequestRateLimiter Tests (#1736)
* Harden RequestRateLimiter Tests

This commit adds higher data size and load in the test path. Also improves
the asserts that are performed.
2020-08-11 22:42:53 +05:30
Jason Gerlowski 5887032e95
SOLR-14692: Allow 'method' specification on JSON Facet join domain transforms (#1707) 2020-08-11 08:21:07 -04:00
Cao Manh Dat 57b0160659
SOLR-14641: PeerSync, remove canHandleVersionRanges check (#1663) 2020-08-10 15:04:34 +07:00
Tomas Fernandez Lobbe bd1dd6bdfb SOLR-14582: Fix TestConfig 2020-08-07 16:01:11 -07:00
Gus Heck f827286a2c
SOLR-14582 - Broken test needs fix (#1727)
AwaitsFix for ConfigTest#testDefaults()
2020-08-07 18:49:04 -04:00
Atri Sharma a074418da0
SOLR-13528: Implement Request Rate Limiters (#1686)
This commit introduces two functionalities: request rate limiting and ability to identify requests based on type (indexing, search, admin). The default rate limiter rate limits query requests based on configurable parameters which can be set in web.xml. Note that this rate limiting works at a JVM level, not a core/collection level.
2020-08-08 01:36:06 +05:30
Tomas Fernandez Lobbe e6275d9970
SOLR-14582: Expose IWC.setMaxCommitMergeWaitMillis in Solr's index config (#1602) 2020-08-07 10:54:36 -07:00
noblepaul 321c4bbe1f SOLR-14654: clean up ref guide, CHANGES.txt 2020-08-06 16:46:12 +10:00
Noble Paul 6f2f1c3de2
SOLR-14654 Remove plugin loading from .system collection (for 9.0) (#1677) 2020-08-06 16:32:32 +10:00
Tomas Fernandez Lobbe 6752111be8 SOLR-14702: doFetch reads legacy parameters too 2020-08-05 14:53:50 -07:00
Marcus 7110118ad4
SOLR-14702: Remove oppressive language (part1) (#1711)
Replace references to "master" and "slave" with "leader" and "follower"
2020-08-05 14:52:48 -07:00
Ishan Chattopadhyaya bd21da6eca SOLR-14604: Add the ability to uninstall a package from with the Package CLI (#1710)
Co-authored-by: Marcus <marcuseagan@gmail.com>
2020-08-04 14:53:25 +05:30
Chris Hostetter a6c058a260 SOLR-14657: Improve error handling in IndexReader realted metrics that were causing scary ERROR logging if metrics were requested while Solr was in the process of closing/re-opening a new IndexReader 2020-08-03 09:58:16 -07:00
Munendra S N 07a89e7bf6 SOLR-14516: fix NPE is resp writer while writing docvalue only field
This issue occurs only while fetching uncommitted doc through /get.
Instead of directly calling stringValue() on IndexableField use
FieldType's toExtern() or toObject() to get the writable value for the field.
2020-07-31 20:05:41 +05:30
Marcus f443edebd2
SOLR-14681: Introduce ability to delete .jar stored in the Package Store (#1702) 2020-07-31 18:23:18 +10:00
Christine Poerschke 2f155aa0c3 SOLR-14489: remove ReplicationHandler's deprecated "master.commitReserveDuration" use (in favour of "commitReserveDuration") 2020-07-29 10:23:17 +01:00
Jan Høydahl ebb5219b1b
SOLR-14671: Parsing dynamic ZK config sometimes cause NuberFormatException (#1701) 2020-07-29 10:33:02 +02:00
David Smiley a3624029ad
SOLR-14651: Metrics History could disable better (#1672)
* SolrRrdBackendFactory should not be created if history is disabled
* Disable MetricsHistoryHandler by default in tests
* Await shutdown of all executors
2020-07-28 16:46:27 -04:00
Erick Erickson 6bf5f4a87f SOLR-11868: CloudSolrClient.setIdField is confusing, it's really the routing field. Should be deprecated. 2020-07-26 18:18:05 -04:00
David Smiley 5295007022
SOLR-14652: SolrCore should hold its own CoreDescriptor (#1675)
(minor refactoring)
Also:
* SolrCore's constructors don't need a "name" since it's guaranteed to always be the name in the coreDescriptor.  I checked.
* SolrCore's constructor shouldn't call coreContainer.solrCores.addCoreDescriptor(cd); because it's the container's responsibility to manage such things.  I made SolrCores.putCore ensure the descriptor is added, and this is called by CoreContainer.registerCore which is called after new SolrCore instances are created.
* solrCore.setName should only be called when we expect the name to change.  Furthermore that shouldn't ever happen in SolrCloud so I added checks.
* solrCore.setName calls coreMetricManager.afterCoreSetName() which is something that is really only related to a rename, not name initialization (from the constructor).  I renamed that method and further only call it if the name did change from non-null.
2020-07-25 01:08:23 -04:00
Erick Erickson 4b2e90b3aa SOLR-11656: TLOG replication doesn't work properly after rebalancing leaders. 2020-07-24 13:10:35 -04:00
Atri Sharma ec007c4bf2
Use FileSystem.newInstance instead of FileSystem.get in HDFSBackupRepository (#1682)
FileSystem.get can cause FileSystem closed exceptions, especially with S3.
2020-07-24 09:57:58 +05:30
Erick Erickson 67da34ac3b SOLR-14676: Update commons-collections to 4.4 and use it in Solr 2020-07-23 17:09:15 -04:00
Jason Gerlowski 48e92ba9c7 SOLR-13205: Improve empty-string handling in SolrQueryParserBase
Contributed-By: pramodkumar9
2020-07-20 09:51:28 -04:00
Ishan Chattopadhyaya cc0c111949 SOLR-14656: Removing Autoscaling Framework
The following were removed:
 *  Autoscaling policy, triggers etc.
 *  withCollection handling
 *  UTILIZENODE command
 *  Sim framework
 *  Suggestions tab in UI
 *  Reference guide pages for autoscaling
 *  autoAddReplicas feature
 *  UTILIZENODE
2020-07-20 17:47:01 +05:30
Erick Erickson 1a7db1c9f5 SOLR-14653: Replace usages of org.apache.hadoop.fs.Path that are used to construct Zookeeper paths 2020-07-17 16:18:21 -04:00
Noble Paul 03d658a7bc
SOLR-14151 Make schema components load from packages (#1669) 2020-07-16 16:05:24 +10:00
Erick Erickson 9c2e7819ee SOLR-13939: Extract any non-gradle related patches (deprecations, URL fixes, etc.) from gradle effort. Attmept to fix Windows disk full issues 2020-07-15 21:03:01 -04:00