Commit Graph

855 Commits

Author SHA1 Message Date
Chris Hostetter 2fdc882bc4 Additional logging in test framework methods that 'waitFor' something to better trace order of operations when failures occur 2019-08-21 13:13:40 -07:00
Noble Paul a4b0ab530f
SOLR-13650: Support for named global classloaders 2019-08-20 05:00:38 +10:00
Chris Hostetter f5856ef404 SOLR-13701: Fixed JWTAuthPlugin to update metrics prior to continuing w/other filters or returning error 2019-08-18 12:20:51 -07:00
Chris Hostetter 0291db44bc SOLR-13464: fix javadoc typo that precommit somehow missed? 2019-08-12 14:55:17 -07:00
Chris Hostetter c7822c393e SOLR-13464: Test work arounds
* Refactor existing work around in BasicAuthIntegrationTest up into SolrCloudAuthTestCase for re-use in JWTAuthPluginIntegrationTest

 * Simplify BasicAuthOnSingleNodeTest and PKIAuthenticationIntegrationTest to use their existing (static) security settings on creation of MiniSolrCloud.  Since they no longer modify security.json once the nodes are alive, the issue no longer affects them
2019-08-12 14:03:54 -07:00
Tomoko Uchida 9b986d268f SOLR-13593: Allow to look up analyzer components by their SPI names in field type configuration. 2019-08-11 16:35:25 +09:00
Munendra S N 8c4fde94fe SOLR-12555: use expectThrows() to verify the ex thrown in tests 2019-08-03 13:00:49 +05:30
Chris Hostetter ab470a6564 SOLR-13664: Fixed SolrTestCaseJ4.deleteCore() to properly reset the dataDir used by initCore() 2019-08-01 09:15:18 -07:00
Chris Hostetter 6dea203d11 SOLR-13660: Fixed AbstractFullDistribZkTestBase.waitForActiveReplicaCount() to ensure replicas are active. 2019-07-30 10:14:38 -07:00
Munendra S N 96d400f511 SOLR-12870: use StandardCharsets instead of String values
Fixes #469
2019-07-20 10:10:32 +05:30
Noble Paul bd30c3701e
SOLR-13565, SOLR-13553 (#774)
* SOLR-13565: initial commit

* SOLR-13565: updated with testcase

* SOLR-13565: removed unused methods

* SOLR-13565: better logging

* SOLR-13565: disable SSL

* SOLR-13565: more tests

* SOLR-13565: syncing with master

* SOLR-13565: fixing tests

* SOLR-13565: fixing tests

* SOLR-13534: Fix test

Remove buggy 'port roulette' code that can easily fail if OS gives the selected port to a different process just before creating the server

Use jetty's built in support for listining on an OS selected port instead

Also increase timeouts to better account for slow/heavily loaded (ie:jenkins) VMs where SolrCore reloading may take longer then 10 seconds

* SOLR-13565: set proper permission name

* SOLR-13565: syncing with master

* SOLR-13565: syncing with master

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: more tests

* SOLR-13565: Tests with key signing tests

* SOLR-13565: fixing concurrency issues in tests

* SOLR-13565: add tests with 512 bit RSA

* SOLR-13565: fixing concurrency issues

* SOLR-13565: remove unused code
2019-07-20 14:20:32 +10:00
Munendra S N 0e877aac34 SOLR-12554: Expose IndexWriterConfig's ramPerThreadHardLimitMB
* When ramPerThreadHardLimitMB is not specified, then Lucene's
  default value 1945 is used. The specified value should be
  greater than 0 and less than 2048MB
2019-07-01 22:42:19 +05:30
Chris Hostetter aaf20aefa4 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs
SOLR-13574: Add CHANGES entry that was overlooked
2019-06-27 15:51:20 -07:00
Chris Hostetter 7e57d3a9d9 SOLR-13574: Fix many test and test-framework classes to not fail on After/AfterClass cleanup if assumptions fail in Before/BeforeClass setup 2019-06-27 10:28:06 -07:00
Chris Hostetter 689fa583a0 Revert "SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs"
This reverts commit 6d6f14d391.

Reason for revert: after doing more testing I realized there are tests I overlooked which can (with randomized SSL usage) trigger NullPointerException
(or other related failures) in After/AfterClass due assumptions about cleanup that isn't actaully neccessary due to the AssumptionFailure
that may occur during Before/BeforeClass
2019-06-24 15:42:23 -07:00
Chris Hostetter 6d6f14d391 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs 2019-06-24 15:02:18 -07:00
Chris Hostetter c8c2f2f25b SOLR-12988: Fix Revert
an (erroneous) assigment to useSsl was left in the constructor after the (intended) conditional assigment, rendering the conditional logic useless
2019-06-20 16:04:49 -07:00
Cao Manh Dat e3752e87d0 SOLR-12988: Revert changes 2019-06-19 21:07:38 +01:00
Cao Manh Dat 91944a468e SOLR-12988: Skip running tests with SSL on Java 11 to 11.0.2 2019-06-19 10:43:17 +01:00
Cao Manh Dat c8382890ae SOLR-12988: Avoid using TLSv1.3 for HttpClient 2019-06-18 12:49:51 +01:00
Mikhail Khludnev 4f6314c59b SOLR-7530: /terms responds per field arrays in JSON by default 2019-06-18 08:38:02 +02:00
Chris Hostetter 5a974860fa SOLR-13490: Fix CollectionStateWatcher/CollectionStatePredicate based APIs in ZkStateReader and CloudSolrClient to be triggered on liveNode changes.
Also add Predicate<DocCollection> equivilents for callers that don't care about liveNodes.
2019-06-17 09:59:43 -07:00
Cao Manh Dat 0c24aa6c75 SOLR-13541: Upgrade Jetty to 9.4.19.v20190610 2019-06-14 15:46:19 +01:00
Erick Erickson bfb5b41144 SOLR-12013: collections API CUSTERSTATUS command fails when configset missing 2019-06-11 15:56:02 -07:00
Koen De Groote 67104dd615 LUCENE-8847: Code Cleanup: Rewrite StringBuilder.append with concatted strings (#707)
This specific commit affects all points in the casebase where the argument of a StringBuilder.append() call is itself a regular String concatenation.
This defeats the purpose of using StringBuilder and also introduces an extra alloction.
These changes should avoid that.

ant tests have run, succeeded on local machine.

Removing test files from the changes.

Another suggested rework.
2019-06-10 18:07:43 +02:00
Cao Manh Dat 301ea0e462
SOLR-13434: OpenTracing support for Solr (#685) 2019-06-04 20:04:11 +01:00
Erick Erickson 7ebeab71f4 SOLR-8346: Upgrade Zookeeper to version 3.5.5 2019-06-03 17:50:35 -07:00
Erick Erickson 0aaf543208 SOLR-13454: Investigate ReindexCollectionTest failures. I missed a place where I should have called the bandaid code 2019-05-10 13:56:04 -07:00
Erick Erickson 577be08bf2 SOLR-13454: Investigate ReindexCollectionTest failures 2019-05-09 12:45:47 -07:00
noble 733b071564 SOLR-13320 : add an update param failOnVersionConflicts=false to updates not fail when there is a version conflict 2019-05-07 15:20:02 +10:00
Mikhail Khludnev 5ca0602d28 SOLR-12291: fixing premature completion of async tasks
* extract async tracking methods from OverseerCollectionMessageHandler into the separate class
* replacing hashmap to named list to avoid entry loss
2019-04-30 09:57:42 +03:00
Ishan Chattopadhyaya dd9899b1c1 SOLR-5970: Return correct status upon collection creation failure 2019-04-28 23:16:29 +05:30
Ishan Chattopadhyaya 4b49bd99ca SOLR-12248, SOLR-4647: Grouping is broken on docValues-only fields 2019-04-28 23:01:58 +05:30
Chris Hostetter 1c3d23e58a SOLR-13336: fix CloudInspectUtil to use filter to eliminate risk of TooManyClausesException 2019-04-19 10:59:53 -07:00
Erick Erickson 2a3bd8e864 SOLR-11035: (at least) 2 distinct failures possible when clients attempt searches during SolrCore reload bandaid for DocValuesNotIndexedTest 2019-04-18 21:38:01 -07:00
Uwe Schindler faaee86efb LUCENE-8738: Move to Java 11 as minimum Java version (merged branch: jira/LUCENE-8738)
Co-authored-by: Adrien Grand <jpountz@apache.org>
2019-04-16 14:00:09 +02:00
Moshe 8527ec11af SOLR-12638: Partial/Atomic updates of nested docs.
and [child] now works in RTG.
2019-04-10 03:02:59 -04:00
Jan Høydahl 361502da8a SOLR-12120: New AuditLoggerPlugin type allowing custom Audit logger plugins 2019-04-04 15:48:51 +02:00
Kevin Risden 6596ed1c16
SOLR-13075: Harden SaslZkACLProviderTest (Kevin Risden, Hrishikesh Gadre, Peter Cseh)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-04-03 10:14:49 -04:00
Gus Heck 2d690885e5 SOLR-13322 - let forbidden apis check for sysout in solr core 2019-04-02 22:45:33 -04:00
Bar Rotstein 5b7866b085 SOLR-12955: Refactored DistributedUpdateProcessor to put SolrCloud specifics into a subclass
Closes #528
2019-03-19 13:26:31 -04:00
erick 9272c29539 SOLR-13268: Clean up any test failures resulting from defaulting to async logging 2019-03-10 11:05:00 -07:00
Mikhail Khludnev b8d569aff0 SOLR-9882: reporting timeAllowed breach as partialResults instead of 500 error 2019-03-04 17:41:57 +03:00
Cao Manh Dat e99934b240 SOLR-13276: Adding Http2 equivalent classes of CloudSolrClient and HttpClusterStateProvider 2019-03-04 09:41:45 +00:00
Erick 0de3905ce7 SOLR-12055: Enable async logging by default SOLR-12753: Async logging ring buffer and OOM error 2019-02-22 12:27:02 -08:00
Tomas Fernandez Lobbe bcd90f1561
SOLR-12708: CREATE collection request doesn't fail or cleanup when the request fails (#568)
When performing an async CREATE requests, responses to internal requests are also included inside the "success" or "failed" elements of the general response. This will make the operation cleanup in case of failure, the same way as we do when the request is synchronous.
2019-02-20 13:24:46 -08:00
shalinmangar 7e2d40197c SOLR-13248: Autoscaling based replica placement is broken out of the box.
Solr 7.5 enabled autoscaling based replica placement by default but in the absence of default cluster policies, autoscaling can place more than 1 replica of the  same shard on the same node. Also, the maxShardsPerNode and createNodeSet was not respected. Due to these reasons,  this issue reverts the default replica placement policy to the 'legacy' assignment policy that was the default until Solr 7.4.
2019-02-18 13:46:05 -08:00
markrmiller 4a3ddc94d8
SOLR-9515: Update to Hadoop 3 (Mark Miller, Kevin Risden)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-02-01 15:04:56 -05:00
Kevin Risden e4f202c1e3
Revert "SOLR-9515: Update to Hadoop 3"
This reverts commit 6bb24673f4.
2019-01-31 19:46:02 -05:00
markrmiller 6bb24673f4
SOLR-9515: Update to Hadoop 3
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-01-31 13:00:20 -05:00
Jan Høydahl d09c724a0e SOLR-12121: Fix test fails in JWTAuthPluginIntegrationTest.testMetrics 2019-01-24 12:43:27 +01:00
Jan Høydahl ea2c8ba38e SOLR-12121: JWT Token authentication plugin with OpenID Connect implicit flow login through Admin UI 2019-01-23 13:03:01 +01:00
Tomas Fernandez Lobbe 8b54b20fc4 SOLR-12770: Make it possible to configure a host whitelist for distributed search 2019-01-15 11:44:57 -08:00
Cao Manh Dat f80e8e1167 Merge jira/http2 branch to master 2018-12-16 16:58:20 +00:00
Dawid Weiss e916f1fb86 LUCENE-8611: Update randomizedtesting to 2.7.2, JUnit to 4.12, add hamcrest-core dependency. 2018-12-15 09:49:36 +01:00
Erick Erickson 3ca7e65388 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/lucene-solr 2018-12-14 07:43:06 -08:00
Erick Erickson 15b36299c4 SOLR-12727: Fix tests to work with 'interesting' entries in the hosts file like 'fe80::1%lo0 localhost' 2018-12-14 07:42:57 -08:00
Chris Hostetter df07fb33bb SOLR-13043: cleanup suspicious ExecutorService lifecycles in MiniSolrCloudCluster 2018-12-13 19:59:35 -07:00
Jan Høydahl 81dbad54e0 SOLR-12799: Allow Authentication Plugins to intercept internode requests on a per-request basis
Add 'forwardCredentials' parameter to BasicAuth which will then skip using PKI on sub requests
2018-12-13 10:51:56 +01:00
markrmiller 44b51cd041 SOLR-13067: Harden BasicAuthIntegrationTest. 2018-12-12 18:50:23 -06:00
Jan Høydahl ef2f0cd88c SOLR-12791: Add Metrics reporting for AuthenticationPlugin 2018-12-12 11:33:32 +01:00
markrmiller ab891fa472 SOLR-12801: Harden TestCloudRecovery. 2018-12-11 05:45:34 -06:00
markrmiller 56b959141f SOLR-12801: Try to harden closing of zk db in TestConfigSetsAPIZkFailure. 2018-12-10 10:02:58 -06:00
markrmiller 3eb2612e67 SOLR-12988: Disable SSL on Java 11/12 for now. 2018-12-09 18:31:28 -06:00
markrmiller eac3f58c43 SOLR-12801: wait 60 seconds instead of 30 for cores to close 2018-12-09 18:31:28 -06:00
Erick Erickson f690302e05 SOLR-12727: Upgrade ZooKeeper dependency to 3.4.13 2018-12-09 08:50:51 -08:00
markrmiller d8f482f5fb SOLR-13030: Update executor usage to work correctly with Java 11 and update Mockito & HttpComponents to work with Java 11 and fix get remote info retry to work across jvms better. 2018-12-01 00:26:02 -06:00
markrmiller 75b1831967 SOLR-12801: Make massive improvements to the tests.
SOLR-12804: Remove static modifier from Overseer queue access.

SOLR-12896: Introduce more checks for shutdown and closed to improve clean close and shutdown. (Partial)

SOLR-12897: Introduce AlreadyClosedException to clean up silly close / shutdown logging. (Partial)

SOLR-12898: Replace cluster state polling with ZkStateReader#waitFor. (Partial)

SOLR-12923: The new AutoScaling tests are way too flaky and need special attention. (Partial)

SOLR-12932: ant test (without badapples=false) should pass easily for developers. (Partial)

SOLR-12933: Fix SolrCloud distributed commit.
2018-11-29 11:58:51 -06:00
Christine Poerschke 7fc91deaba SOLR-12905: MultiSolrCloudTestCase now clears static clusterId2cluster in @AfterClass 2018-10-24 19:25:10 +01:00
Tomas Fernandez Lobbe 46f753d7c6 SOLR-12767: Always include the achieved rf in the response
This commit deprecates the min_rf parameter. Solr now always includes the achieved replication
factor in the update requests (as if min_rf was always specified). Also, reverts the changes
introduced in SOLR-8034, replicas that don't ack an update will have to recover to prevent
inconsistent shards.
2018-10-03 09:40:15 -07:00
Erick Erickson b2b597b038 SOLR-12773: Fix typos widely spread around codebase 2018-09-16 09:46:20 -07:00
Anshum Gupta a1b6db26db SOLR-12762: Fix javadoc for SolrCloudTestCase.clusterShape() method and add a method that validates only against Active slices while testing 2018-09-10 15:18:32 -07:00
Varun Thacker 606e529f93 SOLR-10697: HttpShardHandler now uses a default of 100k as maxConnections (10k previously) and default maxConnectionsPerHost as 100k (20 previously). They are now consisent with the UpdateShardHandler defaults 2018-09-01 07:20:15 -06:00
Shalin Shekhar Mangar 079a81f14f SOLR-12675: Make LeaderVoteWaitTimeoutTest more resilient against side effects of test methods.
Extracted a new method to ensure a given number of jettys are always running in the test setup. Also, delete all collections created by other test methods.
2018-08-20 14:45:50 +05:30
Shalin Shekhar Mangar 3c9050c3dd SOLR-12679: MiniSolrCloudCluster.startJettySolrRunner method should not add a duplicate jetty instance to the list 2018-08-20 14:24:31 +05:30
Shalin Shekhar Mangar ee498f5a38 SOLR-12679: MiniSolrCloudCluster.stopJettySolrRunner should remove jetty from the internal list
While the startJettySolrRunner adds the given jetty instance to the internal list of jetty instances, the stopJettySolrRunner method does not remove the given instance from the list. This leads to inconsistencies such as stopped jettys retained in the internal list and duplicate (stopped) jettys. This commit also fixes TestCollectionsAPIViaSolrCloudCluster to deal with this change.
2018-08-20 13:17:05 +05:30
Noble Paul 9b418a4593 SOLR-12618: AutoScalingHandlerTest failing in jenkins 2018-08-09 01:24:03 +10:00
Moshe 38bf976cd4 SOLR-12485: Solr-Update XML format now accepts child documents under a field
thus providing a semantic relationship.  (like allowed for JSON).
Improved XML.java a bit
Closes #430
2018-08-07 13:52:11 -04:00
Cao Manh Dat 705e6f76a4 SOLR-12412: Fix test failure 2018-07-17 18:42:29 +07:00
Erick Erickson 93ae3669b5 SOLR-12008: Settle a location for the log4j2.xml file 2018-07-11 20:57:38 -07:00
Cao Manh Dat 1197176110 SOLR-12412: Leader should give up leadership when IndexWriter.tragedy occur 2018-07-09 09:14:23 +07:00
Christine Poerschke a444e82bab SOLR-12527: factor out a test-framework/ConfigRequest class 2018-07-03 18:27:17 +01:00
David Smiley 095f9eb90d SOLR-12398: Add Heatmap facet option to JSON Facet API.
* moved the preponderance of the implementation from SpatialHeatmapFacets (used by SimpleFacets) into the new API.
2018-06-25 22:37:13 -04:00
Shalin Shekhar Mangar fabc408d3b SOLR-12507: Modify collection API should support un-setting properties 2018-06-21 15:45:24 +05:30
David Smiley 8095139da3 SOLR-12361: Allow nested child documents to be in field values of a SolrInputDocument.
* AddUpdateCommand and it's relationship with DirectUpdateHandler2 was reworked substantially.

Fixes #385
2018-06-11 10:48:30 -04:00
David Smiley 08ee037ff8 SOLR-12308: LISTALIASES is now assured to return an up-to-date response
* MiniSolrCloudCluster.deleteAllCollections will now first delete aliases
* Minor refactorings to AliasesManager, AliasIntegrationTest, CreateRoutedAliasTest
2018-05-07 22:17:30 -04:00
Chris Hostetter 4e0e8e979b SOLR-9304: Fix Solr's HTTP handling to respect '-Dsolr.ssl.checkPeerName=false' aka SOLR_SSL_CHECK_PEER_NAME 2018-04-22 13:38:37 -07:00
Mike McCandless 7c0387ad3f LUCENE-8248: MergePolicyWrapper is renamed to FilterMergePolicy and now also overrides getMaxCFSSegmentSizeMB 2018-04-13 15:45:19 -04:00
Andrzej Bialecki 376f6c4946 SOLR-12181: Add trigger based on document count / index size. 2018-04-11 15:38:54 +02:00
Christine Poerschke e513c95377 SOLR-12151: Add abstract MultiSolrCloudTestCase class. 2018-04-10 21:09:06 +01:00
Varun Thacker 56f80c0dc7 SOLR-12154: Disallow explicit usage of Log4j2 logger via forbidden APIs 2018-04-03 18:21:14 -07:00
Varun Thacker bea6e2307b SOLR-7887: Log4J2 upgrade fixes 2018-03-26 11:32:03 -07:00
Erick Erickson 624d128b5e SOLR-7887: Upgrade Solr to use log4j2 -- log4j 1 now officially end of life 2018-03-25 19:16:09 -07:00
markrmiller c98ab259c5 SOLR-12101: ZkTestServer was not handling connection timeout settings properly. 2018-03-17 12:36:48 -05:00
Varun Thacker 57524f1d41 SOLR-12083: Fix RealTime GET to work on a cluster running CDCR when using Solr's in-place updates 2018-03-14 12:58:30 -07:00
Jason Gerlowski 971bd26df6 SOLR-11629: Add new CloudSolrClient.Builder ctors
CloudSolrClient.Builder can be pointed at a Solr cluster in two ways: a
ZK connection string, or one or more Solr base URLs.  One of these two
values must be provided to create a working CloudSolrClient.

Since these values are required, this commit introduces two new ctors,
one for each means of CloudSolrClient setup.  It deprecates the existing
no-arg CloudSolrClient ctor.

Together, these changes make it clearer to our users that these options
are required (and mutually exclusive).
2018-03-10 10:45:43 -05:00
Cao Manh Dat 423a8cf69c SOLR-12051: Election timeout when no replicas are qualified to become leader 2018-03-09 18:19:09 +07:00
Shalin Shekhar Mangar 71fc9cd43d SOLR-11066: Implement a scheduled autoscaling trigger that runs on a fixed interval beginning with a given start time 2018-03-03 01:06:21 +05:30
Andrzej Bialecki eb80ca968e SOLR-11407: Wait for collections to recover before starting the test. 2018-02-28 13:12:51 +01:00
Tomas Fernandez Lobbe 029432e936 SOLR-12041: Fix random test failure in ChaosMonkeyNothingIsSafeWithPullReplicasTest 2018-02-27 15:06:28 -08:00