2418 Commits

Author SHA1 Message Date
Erick Erickson
e890980311 SOLR-8346: Upgrade Zookeeper to version 3.5.5
(cherry picked from commit 7ebeab71f4b56d008835f0040468a07632024950)
2019-06-03 17:59:01 -07:00
markrmiller
96f000334c SOLR-13489: Stop the leader from trying to rejoin the election on session expiration and harden our zk reconnect code path.
# Conflicts:
#	solr/core/src/test/org/apache/solr/cloud/OverseerTest.java
2019-06-03 11:11:12 -05:00
Noble Paul
5c677f8f46 SOLR-13504: In autoscaling policies, use an explicit 'put : on-each' to specify the the rules is applied on each node (#694)
SOLR-13504: In autoscaling policies, use an explicit 'put : on-each' to specify the the rules is applied on each node
2019-06-03 18:41:10 +10:00
Noble Paul
b3caaffd6e SOLR-13504 improve autoscaling syntax by adding a nodeset attribute (#693)
* SOLR-13504:  more checks and tests
2019-06-03 18:40:42 +10:00
Noble Paul
dbbab57398 SOLR-13504: improve autoscaling syntax by adding a nodeset attribute (#691)
SOLR-13504: In autoscaling policies, use an explicit 'nodeset' attribute for filtering nodes instead of using them directly at the toplevel
2019-06-03 18:40:15 +10:00
Gus Heck
f0d1f9cc90 SOLR-13491 - SolrZkClient's watch wrapper no longer allows zookeeper
to hold the same watch object multiple times.

(cherry picked from commit d0c1c36c9162b557a0684c9a3cc4879c7e0cd348)
2019-05-30 09:59:16 -04:00
Chris Hostetter
753dfc43d6 Fix all solr tests to pass w/ -Dtests.dups=2 -Dtests.jvms=1
(cherry picked from commit c2b92f3015d44a48abc7cc5f7c972298ea317a07)
2019-05-29 10:27:40 -07:00
Joel Bernstein
91de31e5af SOLR-13494: Add DeepRandomStream implementation 2019-05-29 12:54:14 -04:00
Cao Manh Dat
190b633b7e SOLR-13450: Backport the fix from CloudHttp2SolrClientTest 2019-05-29 16:56:52 +01:00
Noble Paul
c445ad4c75 SOLR-13493: /autoscaling/suggestions to be able to filter by type (#686)
* SOLR-13493: /autoscaling/suggestions to be able to filter by type
2019-05-28 07:58:39 +10:00
Noble Paul
e1fa16c324 SOLR-13484: autoscaling/diagnostics APIshould be able to give diagnostics output from config pasted as a payload 2019-05-24 08:06:21 +10:00
Noble Paul
794f99f0c6 SOLR-13484: backporting 2019-05-24 08:03:20 +10:00
Andrzej Bialecki
4591f67390 SOLR-13475: Clean up empty alias lists. Fix the ordering or operations in the test. 2019-05-20 14:17:08 +02:00
Andrzej Bialecki
97d0d46db6 SOLR-13475: Null Pointer Exception when querying collection through collection alias. 2019-05-20 13:35:00 +02:00
Andrzej Bialecki
3756c7116a SOLR-13437: Add a missing package description. 2019-05-20 13:12:49 +02:00
Noble Paul
0f67df40b6 SOLR-13437: fork noggit code into Solr (#666)
* SOLR-13437: fork noggit code into Solr
2019-05-16 12:02:50 +10:00
Andrzej Bialecki
12957fcd22 SOLR-13454: Fix the method's behavior which caused test failures due to collections disappearing during iteration. 2019-05-14 16:16:27 +02:00
Andrzej Bialecki
33b4b6c14b SOLR-13440: Support saving/restoring autoscaling state for repeatable simulations. 2019-05-13 19:20:12 +02:00
Joel Bernstein
51d6c7292b SOLR-13047: Fix Pre-commit 2019-05-10 16:20:30 -04:00
Joel Bernstein
30c50d095c SOLR-13047: Add facet2D Streaming Expression
Co-authored-by: Joel Bernstein <jbernste@apache.org>
Co-authored-by: Nazerke Seidan <seinaz1997@gmail.com>
2019-05-10 16:20:10 -04:00
Cao Manh Dat
8a1b966165 SOLR-13445: Preferred replicas on nodes with same system properties as the query master 2019-05-08 17:59:33 +01:00
Cao Manh Dat
8569fb6f8b SOLR-13276: Improving CloudHttp2SolrClientTest 2019-05-07 10:09:51 +01:00
Cao Manh Dat
79fb96854c SOLR-13449: SolrClientNodeStateProvider always retries on requesting metrics from other nodes 2019-05-07 09:42:51 +01:00
noble
8cde22ba01 SOLR-13320 : add an update param failOnVersionConflicts=false to updates not fail when there is a version conflict 2019-05-07 15:22:57 +10:00
Jason Gerlowski
919b085444 SOLR-13318: Fix casting issues in BucketBasedJsonFacet 2019-05-06 00:01:04 -04:00
noble
9952c2a24f SOLR-13441: Refactor code to minimize direct use of noggit 2019-05-03 07:22:13 +10:00
Andrzej Bialecki
44efae15a9 SOLR-13427: Support simulating the execution of autoscaling suggestions. 2019-04-30 00:23:03 +02:00
Noble Paul
94b9f7ed1c SOLR-13429: HashBasedRouter logs the entire state.json when a slice is not found 2019-04-30 06:09:15 +10:00
Andrzej Bialecki
72230b69b3 SOLR-13407: Fix NPE and be consistent about returning empty instead of null properties. 2019-04-29 12:20:52 +02:00
Mikhail Khludnev
13be0b1af2 SOLR-13081: Let in-place update work with route.field 2019-04-25 10:01:13 +03:00
Erick Erickson
f08ddbc713 SOLR-13268: Clean up any test failures resulting from defaulting to async logging
(cherry picked from commit 48dc020ddaf0b0911012b4d9b77d859b2af3d3ae)
2019-04-24 10:54:31 -07:00
Gus Heck
0cfd85baef SOLR-13418 - safer synchronization and zk version checking for collection properties
(cherry picked from commit 80d3ac8709c6d93c4e4634dc7c10ef667a029cb1)
2019-04-23 12:43:34 -04:00
Andrzej Bialecki
667ccbc16f SOLR-13407: Reject update requests sent to non-routed multi collection aliases. 2019-04-18 14:55:00 +02:00
erick
ca1cc248e0 SOLR-13408: Cannot start/stop DaemonStream repeatedly, other API improvements
(cherry picked from commit a9771a58495b319b36b32381c786d9d9801e64ea)
2019-04-17 16:08:39 -07:00
Chris Hostetter
59a3c45d9c SOLR-13336: add maxBooleanClauses (default to 1024) setting to solr.xml, reverting previous effective value of Integer.MAX_VALUE-1, to restrict risk of pathalogical query expansion.
(cherry picked from commit d90034f0d61cd1525e10d07cf064a8647dc08cc9)
2019-04-15 10:27:29 -07:00
Christine Poerschke
cae323629e SOLR-13366: Clarify 'Invalid stage name' warning logging in AutoScalingConfig 2019-04-12 16:15:34 +01:00
Joel Bernstein
4f6e78282f SOLR-13391: Add variance and standard deviation stream evaluators
Squashed commit of the following:

commit 406d4b959a42e4830ac1c52836ccbcfc1b614b46
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:03:34 2019 +0200

    added missing package

commit 32c239687c39c5da3e4f2d0f25df73127331fa99
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:03:14 2019 +0200

    added package

commit 7b3f9bd415002969a4ec5d87a9ffbfd6fcff6e92
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:02:28 2019 +0200

    added var and stddev functions

commit 77c4f9fdd9f111862a55b645aad960457291414c
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:00:59 2019 +0200

    added test for the variance and standard deviation stream evaluators

commit 2d9692c178590b65e46cfd9e04ca0384c7d39ec5
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:50:30 2019 +0200

    added var and stddev new evaluators

commit d265225747bce9a0eabd713994ddd4990dbbbfa2
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:49:23 2019 +0200

    variance streaming evaluator

commit a3330064bb62b5723b9125334ef1d61fc3b098d3
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:49:02 2019 +0200

    standard deviation streaming evaluator
2019-04-12 09:58:16 -04:00
Chris Hostetter
c58787d045 SOLR-13393: Fixed ZkClientClusterStateProvider to prevent risk of leaking ZkStateReader/threads when processing concurrent requests during shutdown.
This primarily affected tests, but may have also caused odd errors/delays when restart/shutting down solr nodes.

(cherry picked from commit 980fd7d5c56349570b2202dedcf7b454216a61b8)
2019-04-11 14:23:14 -07:00
Andrzej Bialecki
f83098752c SOLR-13262: Add collection RENAME command and support using aliases in most collection admin commands. 2019-04-10 18:57:16 +02:00
Joel Bernstein
e87514909b SOLR-13374: Add fetchSize parameter to the jdbc Streaming Expression 2019-04-05 08:54:00 -04:00
Jason Gerlowski
7c0caeacfa SOLR-13362: Add 'includeIndexFieldFlags' in LukeRequest 2019-04-01 20:40:49 -04:00
Kevin Risden
96c293ec1b
SOLR-9079: Remove commons-lang as a dependency
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-20 19:51:34 -04:00
Andrzej Bialecki
b778417054 SOLR-11127: REINDEXCOLLECTION command for re-indexing of existing collections. 2019-03-19 13:47:44 +01:00
Chris Hostetter
653ba8d245 SOLR-12923: Fix some issues w/concurrency and exception swallowing in SimClusterStateProvider/SimCloudManager
There are 3 tightly related bug fixes in these changes:

1) ConcurrentModificationExceptions were being thrown by some SimClusterStateProvider methods when
   creating collections/replicas due to the use of ArrayLists nodeReplicaMap. These ArrayLists were changed
   to use synchronizedList wrappers.
2) The Exceptions from #1 were being swallowed/hidden by code using SimCloudManager.submit() w/o checking
   the result of the resulting Future object. (As a result, tests waiting for a particular ClusterShape
   would timeout regardless of how long they waited.)   To protect against "silent" failures like this,
   this SimCloudManager.submit() has been updated to wrap all input Callables such that any uncaught errors
   will be logged and "counted."  SimSolrCloudTestCase will ensure a suite level failure if any such failures
   are counted.
3) The changes in #2 exposed additional concurrency problems with the Callables involved in leader election:
   These would frequently throw IllegalStateExceptions due to assumptions about the state/existence of
   replicas when the Callables were created vs when they were later run -- notably a Callable may have been
   created that held a reference to a Slice, but by the time that Callable was run the collection (or a
   node, etc...) refered to by that Slice may have been deleted.  While fixing this, the leader election
   logic was also cleaned up such that adding a replica only triggers leader election for that shard, not
   every shard in the collection.

While auditing this code, cleanup was also done to ensure all usage of SimClusterStateProvider.lock was
also cleaned up to remove all risky points where an exception may have been possible after aquiring the
lock but before the try/finally that ensured it would be unlocked.

(cherry picked from commit 76babf876a49f82959cc36a1d7ef922a9c2dddff)
2019-03-15 14:24:07 -07:00
Gus Heck
1d85f13eeb SOLR-13131 Category Routed Aliases
(cherry picked from commit d8f2a02fdb11a484425f9fddfa7061711d2f0034)
2019-03-13 01:36:40 -04:00
Gus Heck
39adb09fc9 Remove inadvertently included println 2019-03-12 16:07:02 -04:00
Gus Heck
470813143d SOLR-12891 MacroExpander will no longer will expand URL parameters by
default inside of the 'expr' parameter, add InjectionDefense class
for safer handling of untrusted data in streaming expressions and add
-DStreamingExpressionMacros system property to revert to legacy behavior

(cherry picked from commit 9edc557f4526ffbbf35daea06972eb2c595e692b)
2019-03-12 11:56:28 -04:00
erick
277251c202 SOLR-13268: Clean up any test failures resulting from defaulting to async logging
(cherry picked from commit 9272c29)
2019-03-10 11:35:51 -07:00
Andrzej Bialecki
f6f5f995ef SOLR-13292: Provide extended per-segment status of a collection. 2019-03-09 14:09:34 +01:00
Christine Poerschke
c55415cda8 SOLR-13254: Correct message that is logged in solrj's ConnectionManager when an exception occurred while reconnecting to ZooKeeper. (hu xiaodong via Christine Poerschke) 2019-03-07 21:09:43 +00:00