14436 Commits

Author SHA1 Message Date
Atri Sharma
2f37f40171
SOLR-14615: Implement CPU Utilization Based Circuit Breaker (#1737)
This commit introduces CPU based circuit breaker. This circuit breaker
tracks the average CPU load per minute and triggers if the value exceeds
a configurable value.

This commit also adds a specific control flag for Memory Circuit Breaker
to allow enabling/disabling the same.
2020-08-20 13:21:26 +05:30
Noble Paul
8caf57d50b
SOLR-14750: TestBulkSchemaConcurrent fails often(#1760) 2020-08-19 10:52:12 +10:00
Christine Poerschke
16ab243759 Fix Zo[o]keeper typo in 'solr zk' usage description. 2020-08-18 16:41:35 +01:00
Ishan Chattopadhyaya
77a4d495cc SOLR-14731: Rename @SolrSingleThreaded to @SolrThreadUnsafe, mark DistribPackageStore with the annotation
Co-authored-by: Marcus <marcuseagan@gmail.com>
2020-08-18 16:21:38 +05:30
Atri Sharma
4fed9ff8d3 Move TestRequestRateLimiter to Nightly 2020-08-18 13:43:49 +05:30
Andrzej Bialecki
d9fb14dec1 SOLR-13858: Remove no longer used field and getter. 2020-08-17 14:47:38 +02:00
David Smiley
0ce2d610c2
SOLR-14722: timeAllowed should track from req creation (#1726)
* set(long) instead of set(Long).
* Fix javadocs CommonParams.TIME_ALLOWED
2020-08-15 00:41:07 -04:00
Jason Gerlowski
9de454d414 SOLR-14680: Add missing package-info to fix precommit 2020-08-15 09:53:26 +10:00
Houston Putman
c7b70267b8 Sync CHANGES for 8.6.1 2020-08-14 16:44:56 -04:00
David Smiley
e6a11f8c3a
SOLR prometheus: simplify concurrent collection (#1723)
No semantic difference in behavior.
2020-08-14 15:59:40 -04:00
Yuriy Koval
44c4e6ef31
SOLR-14703 Edismax parser replaces whitespace characters with spaces (#1713) 2020-08-14 14:12:53 -04:00
Jason Gerlowski
216aec03a6
SOLR-14677: Always close DIH EntityProcessor/DataSource (#1741)
Prior to this commit, the wrapup logic at the end of
DocBuilder.execute() closed out a series of DIH objects, but did so
in a way that an exception closing any of them resulted in the remainder
staying open.  This is especially problematic since Writer.close()
throws exceptions that DIH uses to determine the success/failure of the
run.

In practice this caused network errors sending DIH data to other Solr
nodes to result in leaked JDBC connections.

This commit changes DocBuilder's termination logic to handle exceptions
more gracefully, ensuring that errors closing a DIHWriter (for example)
don't prevent the closure of entity-processor and DataSource objects.
2020-08-13 21:21:31 -04:00
Jan Høydahl
bed3b8fbfb
SOLR-14751: Zookeeper Admin screen not working for old ZK versions 2020-08-14 01:32:28 +02:00
noblepaul
0b55c94ad6 SOLR-14680: make jdk 8 compatible 2020-08-13 13:53:05 +10:00
Noble Paul
d517361bb1
SOLR-14680: Provide an implementation for the new SolrCluster API (#1730) 2020-08-13 13:34:24 +10:00
Jason Gerlowski
a6515ca38f SOLR-14748: Correct condition on startup auth/ssl logging 2020-08-12 18:44:02 -04:00
andywebb1975
e72a0d66c6
SOLR-13751: add BooleanSimilarityFactory (#867) 2020-08-12 15:35:50 +01:00
Andrzej Bialecki
a5543dfb51 SOLR-14470: Fix test failures by reducing the randomness of test data. 2020-08-12 13:45:25 +02:00
Atri Sharma
1d2749295b
Harden RequestRateLimiter Tests (#1736)
* Harden RequestRateLimiter Tests

This commit adds higher data size and load in the test path. Also improves
the asserts that are performed.
2020-08-11 22:42:53 +05:30
Jason Gerlowski
5887032e95
SOLR-14692: Allow 'method' specification on JSON Facet join domain transforms (#1707) 2020-08-11 08:21:07 -04:00
Dawid Weiss
5375a2d2ad
LUCENE-9454: upgrade hamcrest to version 2.2. (#1738) 2020-08-11 11:55:52 +02:00
Noble Paul
15ae014c59
SOLR-14680: Provide simple interfaces to our cloud classes (only API) (#1694) 2020-08-11 15:05:14 +10:00
Cassandra Targett
424a9a6cfc SOLR-13528: fix heading levels 2020-08-10 16:36:40 -05:00
Cao Manh Dat
9b1aeb3c62 SOLR-14641: Update CHANGES.txt 2020-08-10 15:35:55 +07:00
Cao Manh Dat
57b0160659
SOLR-14641: PeerSync, remove canHandleVersionRanges check (#1663) 2020-08-10 15:04:34 +07:00
Eric Pugh
35771c3cfe
SOLR-14581 Document the way auto commits work in SolrCloud (#1692)
* provide some detail on eventually consistent code

* small tweak to language

* respond to comments and word smithing
2020-08-09 08:35:00 -04:00
Tomas Fernandez Lobbe
bd1dd6bdfb SOLR-14582: Fix TestConfig 2020-08-07 16:01:11 -07:00
Gus Heck
f827286a2c
SOLR-14582 - Broken test needs fix (#1727)
AwaitsFix for ConfigTest#testDefaults()
2020-08-07 18:49:04 -04:00
Atri Sharma
a074418da0
SOLR-13528: Implement Request Rate Limiters (#1686)
This commit introduces two functionalities: request rate limiting and ability to identify requests based on type (indexing, search, admin). The default rate limiter rate limits query requests based on configurable parameters which can be set in web.xml. Note that this rate limiting works at a JVM level, not a core/collection level.
2020-08-08 01:36:06 +05:30
Tomas Fernandez Lobbe
e6275d9970
SOLR-14582: Expose IWC.setMaxCommitMergeWaitMillis in Solr's index config (#1602) 2020-08-07 10:54:36 -07:00
Tomas Fernandez Lobbe
2bf092b8dd
SOLR-14702: Add Upgrade Notes and CHANGES entry (#1718) 2020-08-07 10:09:40 -07:00
Cassandra Targett
35bf1785ec SOLR-14654: actually fix the Ref Guide build failure 2020-08-06 10:15:06 -05:00
noblepaul
ddbe9495fc SOLR-14654: ref-guide build failure 2020-08-06 23:30:05 +10:00
noblepaul
321c4bbe1f SOLR-14654: clean up ref guide, CHANGES.txt 2020-08-06 16:46:12 +10:00
Noble Paul
6f2f1c3de2
SOLR-14654 Remove plugin loading from .system collection (for 9.0) (#1677) 2020-08-06 16:32:32 +10:00
Tomas Fernandez Lobbe
6752111be8 SOLR-14702: doFetch reads legacy parameters too 2020-08-05 14:53:50 -07:00
Marcus
7110118ad4
SOLR-14702: Remove oppressive language (part1) (#1711)
Replace references to "master" and "slave" with "leader" and "follower"
2020-08-05 14:52:48 -07:00
Ishan Chattopadhyaya
bd21da6eca SOLR-14604: Add the ability to uninstall a package from with the Package CLI (#1710)
Co-authored-by: Marcus <marcuseagan@gmail.com>
2020-08-04 14:53:25 +05:30
Chris Hostetter
a6c058a260 SOLR-14657: Improve error handling in IndexReader realted metrics that were causing scary ERROR logging if metrics were requested while Solr was in the process of closing/re-opening a new IndexReader 2020-08-03 09:58:16 -07:00
Munendra S N
07a89e7bf6 SOLR-14516: fix NPE is resp writer while writing docvalue only field
This issue occurs only while fetching uncommitted doc through /get.
Instead of directly calling stringValue() on IndexableField use
FieldType's toExtern() or toObject() to get the writable value for the field.
2020-07-31 20:05:41 +05:30
Munendra S N
80c6251651 SOLR-11262: reword changes entry 2020-07-31 19:52:04 +05:30
Noble Paul
44865c5220
moved SOLR-14681 from 9.0section to 8.7 2020-07-31 18:45:01 +10:00
Marcus
f443edebd2
SOLR-14681: Introduce ability to delete .jar stored in the Package Store (#1702) 2020-07-31 18:23:18 +10:00
Christine Poerschke
2f155aa0c3 SOLR-14489: remove ReplicationHandler's deprecated "master.commitReserveDuration" use (in favour of "commitReserveDuration") 2020-07-29 10:23:17 +01:00
Jan Høydahl
ebb5219b1b
SOLR-14671: Parsing dynamic ZK config sometimes cause NuberFormatException (#1701) 2020-07-29 10:33:02 +02:00
David Smiley
a3624029ad
SOLR-14651: Metrics History could disable better (#1672)
* SolrRrdBackendFactory should not be created if history is disabled
* Disable MetricsHistoryHandler by default in tests
* Await shutdown of all executors
2020-07-28 16:46:27 -04:00
Erick Erickson
6bf5f4a87f SOLR-11868: CloudSolrClient.setIdField is confusing, it's really the routing field. Should be deprecated. 2020-07-26 18:18:05 -04:00
David Smiley
5295007022
SOLR-14652: SolrCore should hold its own CoreDescriptor (#1675)
(minor refactoring)
Also:
* SolrCore's constructors don't need a "name" since it's guaranteed to always be the name in the coreDescriptor.  I checked.
* SolrCore's constructor shouldn't call coreContainer.solrCores.addCoreDescriptor(cd); because it's the container's responsibility to manage such things.  I made SolrCores.putCore ensure the descriptor is added, and this is called by CoreContainer.registerCore which is called after new SolrCore instances are created.
* solrCore.setName should only be called when we expect the name to change.  Furthermore that shouldn't ever happen in SolrCloud so I added checks.
* solrCore.setName calls coreMetricManager.afterCoreSetName() which is something that is really only related to a rename, not name initialization (from the constructor).  I renamed that method and further only call it if the name did change from non-null.
2020-07-25 01:08:23 -04:00
Erick Erickson
4b2e90b3aa SOLR-11656: TLOG replication doesn't work properly after rebalancing leaders. 2020-07-24 13:10:35 -04:00
Atri Sharma
ec007c4bf2
Use FileSystem.newInstance instead of FileSystem.get in HDFSBackupRepository (#1682)
FileSystem.get can cause FileSystem closed exceptions, especially with S3.
2020-07-24 09:57:58 +05:30