Commit Graph

2468 Commits

Author SHA1 Message Date
Joel Bernstein 62955b1a4e SOLR-13625: Fix broken test cases 2019-07-30 10:42:06 -04:00
Joel Bernstein d0674866ed SOLR-13625: Add CsvStream, TsvStream Streaming Expressions and supporting Stream Evaluators 2019-07-30 10:42:06 -04:00
Jason Gerlowski dc8e9afff9 SOLR-13622: Add fileStream stream-source 2019-07-25 09:13:00 -04:00
noble afa64c892b SOLR-13637: removed ununsed code 2019-07-21 12:29:02 -07:00
Noble Paul 631edee1cb
SOLR-13637 Enable loading of plugins from the corecontainer memclassloader 2019-07-21 12:21:56 -07:00
Munendra S N 96d400f511 SOLR-12870: use StandardCharsets instead of String values
Fixes #469
2019-07-20 10:10:32 +05:30
Noble Paul bd30c3701e
SOLR-13565, SOLR-13553 (#774)
* SOLR-13565: initial commit

* SOLR-13565: updated with testcase

* SOLR-13565: removed unused methods

* SOLR-13565: better logging

* SOLR-13565: disable SSL

* SOLR-13565: more tests

* SOLR-13565: syncing with master

* SOLR-13565: fixing tests

* SOLR-13565: fixing tests

* SOLR-13534: Fix test

Remove buggy 'port roulette' code that can easily fail if OS gives the selected port to a different process just before creating the server

Use jetty's built in support for listining on an OS selected port instead

Also increase timeouts to better account for slow/heavily loaded (ie:jenkins) VMs where SolrCore reloading may take longer then 10 seconds

* SOLR-13565: set proper permission name

* SOLR-13565: syncing with master

* SOLR-13565: syncing with master

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: removed accidental change

* SOLR-13565: more tests

* SOLR-13565: Tests with key signing tests

* SOLR-13565: fixing concurrency issues in tests

* SOLR-13565: add tests with 512 bit RSA

* SOLR-13565: fixing concurrency issues

* SOLR-13565: remove unused code
2019-07-20 14:20:32 +10:00
yonik c5cabf1e03 SOLR-13399: SPLITSHARD splitByPrefix for compositeId 2019-07-19 11:35:01 -04:00
Chris Hostetter 24b94b8dac Harden StreamDecoratorTest
remove flakey dependency on sleep (to wait for cache expiration) w/explicit instruction to ignore cache

sleep is not garunteed to sleep the exact amount (based on limitations of the system clock)
2019-07-18 19:40:24 -07:00
Gus Heck c97551cc36 SOLR-13375 - 2 dimensional routed aliases 2019-07-15 09:57:13 -04:00
Andrzej Bialecki dd4813d5b8 SOLR-13583: Return 400 Bad Request instead of 500 Server Error when a complex
alias is found but a simple alias was expected.
2019-07-05 09:19:32 +02:00
Andrzej Bialecki 717afb11fc SOLR-13583: Impossible to delete a collection with the same name as an existing alias. 2019-07-03 15:52:36 +02:00
Joel Bernstein 96d11063a7 SOLR-13589: Fix precommit 2019-07-01 21:54:25 -04:00
Joel Bernstein 6a99151eae SOLR-13589: Add zplot cluster test case 2019-07-01 21:39:45 -04:00
Joel Bernstein 2f6a681b39 SOLR-13589: Allow zplot to visualize clusters and convex hulls 2019-07-01 21:39:45 -04:00
Chris Hostetter aaf20aefa4 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs
SOLR-13574: Add CHANGES entry that was overlooked
2019-06-27 15:51:20 -07:00
Chris Hostetter 7e57d3a9d9 SOLR-13574: Fix many test and test-framework classes to not fail on After/AfterClass cleanup if assumptions fail in Before/BeforeClass setup 2019-06-27 10:28:06 -07:00
Jan Høydahl b54126169b SOLR-13569: AdminUI visual indication of prod/test/dev environment 2019-06-26 12:09:02 +02:00
Andrzej Bialecki 4d1058db6e SOLR-13566: REINDEXCOLLECTION does not work with (basic) authentication. 2019-06-25 16:54:27 +02:00
Noble Paul 742c80550c reformatting 2019-06-25 17:02:17 +10:00
Mikhail Khludnev 4589bbe47b SOLR-12866: Turn TestHdfsCloudBackupRestore ON. No changes yet. 2019-06-25 08:49:26 +03:00
Chris Hostetter 689fa583a0 Revert "SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs"
This reverts commit 6d6f14d391.

Reason for revert: after doing more testing I realized there are tests I overlooked which can (with randomized SSL usage) trigger NullPointerException
(or other related failures) in After/AfterClass due assumptions about cleanup that isn't actaully neccessary due to the AssumptionFailure
that may occur during Before/BeforeClass
2019-06-24 15:42:23 -07:00
Chris Hostetter 6d6f14d391 SOLR-12988: SSLTestConfig has been changed to throw AssumptionViolatedException when tests/seeds request SSL but the JVM appears to be an OpenJDK version known to have SSL bugs 2019-06-24 15:02:18 -07:00
Mikhail Khludnev 9137a0b0fe SOLR-13545: ContentStreamUpdateRequest to close file. 2019-06-21 23:38:08 +03:00
Gus Heck 5d47875184 SOLR-13419 - Better infix for TRA collection names 2019-06-20 09:47:52 -04:00
Joel Bernstein e88366c9b6 SOLR-10291: Add match Stream Evaluator to support regex matching 2019-06-19 19:40:20 -04:00
Cao Manh Dat 91944a468e SOLR-12988: Skip running tests with SSL on Java 11 to 11.0.2 2019-06-19 10:43:17 +01:00
Joel Bernstein 8a35088947 SOLR-13560: Fix precommit 2019-06-18 22:33:40 -04:00
Joel Bernstein 1dd98ca65d SOLR-13560: Add isNull and notNull Stream Evaluators 2019-06-18 22:33:40 -04:00
Noble Paul ed42d36c7b SOLR-13329: changed the put:on-each to put: on-each-node 2019-06-19 00:16:57 +10:00
Cao Manh Dat c8382890ae SOLR-12988: Avoid using TLSv1.3 for HttpClient 2019-06-18 12:49:51 +01:00
Chris Hostetter 5a974860fa SOLR-13490: Fix CollectionStateWatcher/CollectionStatePredicate based APIs in ZkStateReader and CloudSolrClient to be triggered on liveNode changes.
Also add Predicate<DocCollection> equivilents for callers that don't care about liveNodes.
2019-06-17 09:59:43 -07:00
Joel Bernstein 03e7205c89 SOLR-13552: Add recNum Stream Evaluator 2019-06-15 13:54:37 -04:00
Joel Bernstein 0038e93667 SOLR-13550: Allow zplot to automatically create the x axis 2019-06-14 17:49:03 -04:00
Cao Manh Dat 0c24aa6c75 SOLR-13541: Upgrade Jetty to 9.4.19.v20190610 2019-06-14 15:46:19 +01:00
Erick Erickson 81e8b385a4 SOLR-12013: collections API CUSTERSTATUS command fails when configset missing 2019-06-13 15:40:13 -07:00
Cassandra Targett 65b5391041 SOLR-13235: update doc links in apispec files to new pages 2019-06-12 19:03:21 -05:00
Thomas Wöckinger 828960927f SOLR-13347: Add support for reading/writing UUID from/to TransactionLog (#681)
SOLR-13347: Transaction log to natively support UUID types
2019-06-13 08:56:41 +10:00
Erick Erickson bfb5b41144 SOLR-12013: collections API CUSTERSTATUS command fails when configset missing 2019-06-11 15:56:02 -07:00
Gus Heck abeecfacd4 SOLR-13439 - Adds ability to locally cache collection properties for a specified duration. 2019-06-11 10:12:52 -04:00
Andrzej Bialecki 6527e74ed8 Improve the test by actually checking that the version of Aliases is
more recent, instead of simply waiting.
2019-06-11 12:13:54 +02:00
Andrzej Bialecki 010466ec04 SOLR-13512: Raw index data analysis tool (extension of COLSTATUS collection command). 2019-06-10 19:21:46 +02:00
Koen De Groote 67104dd615 LUCENE-8847: Code Cleanup: Rewrite StringBuilder.append with concatted strings (#707)
This specific commit affects all points in the casebase where the argument of a StringBuilder.append() call is itself a regular String concatenation.
This defeats the purpose of using StringBuilder and also introduces an extra alloction.
These changes should avoid that.

ant tests have run, succeeded on local machine.

Removing test files from the changes.

Another suggested rework.
2019-06-10 18:07:43 +02:00
Tomas Fernandez Lobbe f3148fa9e0 SOLR-13521: Fix input parameter handling for DynamicField and FieldTypes (Schema API) 2019-06-05 16:01:43 -07:00
Cao Manh Dat 301ea0e462
SOLR-13434: OpenTracing support for Solr (#685) 2019-06-04 20:04:11 +01:00
Cao Manh Dat cee4ed783e SOLR-13510: Intermittent 401's for internode requests with basicauth enabled 2019-06-04 16:12:49 +01:00
erick 045ee7c0fa SOLR-8346: Upgrade Zookeeper to version 3.5.5. Update solrj/ivy.xml to match 8x precommit fix 2019-06-03 21:14:02 -07:00
Erick Erickson 7ebeab71f4 SOLR-8346: Upgrade Zookeeper to version 3.5.5 2019-06-03 17:50:35 -07:00
Noble Paul 0a41163d27
SOLR-13504: In autoscaling policies, use an explicit 'put : on-each' to specify the the rules is applied on each node (#694)
SOLR-13504: In autoscaling policies, use an explicit 'put : on-each' to specify the the rules is applied on each node
2019-06-03 18:13:18 +10:00
markrmiller b09d462ee4 SOLR-13489: Stop the leader from trying to rejoin the election on session expiration and harden our zk reconnect code path. 2019-06-02 22:56:56 -05:00
Noble Paul 808f934cee
SOLR-13504 improve autoscaling syntax by adding a nodeset attribute (#693)
* SOLR-13504:  more checks and tests
2019-06-02 18:54:28 +10:00
Noble Paul 1ff7b2942c
SOLR-13504: improve autoscaling syntax by adding a nodeset attribute (#691)
SOLR-13504: In autoscaling policies, use an explicit 'nodeset' attribute for filtering nodes instead of using them directly at the toplevel
2019-05-31 17:45:55 +10:00
Gus Heck 6ede32a079 SOLR-13491 - Touch-up test. Beasting failed 1/50 (5) Now passes 500/500 (20). 2019-05-30 10:05:32 -04:00
Gus Heck d0c1c36c91 SOLR-13491 - SolrZkClient's watch wrapper no longer allows zookeeper
to hold the same watch object multiple times.
2019-05-30 08:43:16 -04:00
Chris Hostetter c2b92f3015 Fix all solr tests to pass w/ -Dtests.dups=2 -Dtests.jvms=1 2019-05-29 10:27:15 -07:00
Joel Bernstein 6ca372fcbb SOLR-13494: Add DeepRandomStream implementation 2019-05-29 12:53:10 -04:00
Cao Manh Dat 43397ff0a2 SOLR-13450: Backport the fix from CloudHttp2SolrClientTest 2019-05-29 16:55:58 +01:00
Noble Paul 6ac31c6db3
SOLR-13493: /autoscaling/suggestions to be able to filter by type (#686)
* SOLR-13493: /autoscaling/suggestions to be able to filter by type
2019-05-28 07:20:12 +10:00
Noble Paul e9d9f4dcc1 SOLR-13484: ref guide 2019-05-23 17:06:29 +10:00
Noble Paul a1c9f8f7db SOLR-13484: refactored code 2019-05-23 12:50:09 +10:00
Andrzej Bialecki 93e57e63cd SOLR-13475: Null Pointer Exception when querying collection through collection alias. 2019-05-20 15:19:35 +02:00
Andrzej Bialecki 62f969403a SOLR-13437: Add a missing package description. 2019-05-20 12:57:54 +02:00
Noble Paul bd64ed6d2a
SOLR-13437: fork noggit code into Solr (#666)
* SOLR-13437: fork noggit code into Solr
2019-05-16 11:10:27 +10:00
Andrzej Bialecki 6f309dfa66 SOLR-13454: Fix the method's behavior which caused test failures due to collections disappearing during iteration. 2019-05-14 14:09:24 +02:00
Andrzej Bialecki f2c18bacf2 SOLR-13440: Support saving/restoring autoscaling state for repeatable simulations. 2019-05-13 18:44:26 +02:00
Joel Bernstein 6069ef6ca6 SOLR-13047: Fix Pre-commit 2019-05-10 16:12:35 -04:00
Joel Bernstein f9cd8b0957 SOLR-13047: Add facet2D Streaming Expression
Co-authored-by: Joel Bernstein <jbernste@apache.org>
Co-authored-by: Nazerke Seidan <seinaz1997@gmail.com>
2019-05-10 15:02:18 -04:00
Cao Manh Dat 6b5b74bc9c SOLR-13445: Preferred replicas on nodes with same system properties as the query master 2019-05-08 17:55:49 +01:00
Gus Heck 76b854cb4f SOLR-13306 Add a request parameter to execute a streaming expression locally 2019-05-08 12:13:07 -04:00
Cao Manh Dat de5f3d76ed SOLR-13449: SolrClientNodeStateProvider always retries on requesting metrics from other nodes 2019-05-07 09:40:45 +01:00
noble 733b071564 SOLR-13320 : add an update param failOnVersionConflicts=false to updates not fail when there is a version conflict 2019-05-07 15:20:02 +10:00
Jason Gerlowski 4309c6eca4 SOLR-13318: Fix casting issues in BucketBasedJsonFacet 2019-05-05 23:38:05 -04:00
noble 8908205b42 SOLR-13441: Refactor code to minimize direct use of noggit 2019-05-03 07:20:05 +10:00
Andrzej Bialecki 6eccf2bf53 SOLR-13427: Support simulating the execution of autoscaling suggestions. 2019-04-29 23:14:38 +02:00
Noble Paul 25bd1cbb82 SOLR-13429: HashBasedRouter logs the entire state.json when a slice is not found 2019-04-30 06:07:51 +10:00
Andrzej Bialecki ced0243a3e SOLR-13407: Fix NPE and be consistent about returning empty instead of null properties. 2019-04-29 12:19:29 +02:00
Mikhail Khludnev 6d94631538 SOLR-13081: Let in-place update work with route.field 2019-04-25 14:05:42 +03:00
Erick Erickson 48dc020dda SOLR-13268: Clean up any test failures resulting from defaulting to async logging 2019-04-24 09:23:11 -07:00
Gus Heck 80d3ac8709 SOLR-13418 - safer synchronization and zk version checking for collection properties 2019-04-23 12:29:08 -04:00
Cao Manh Dat bc8985d031 SOLR-13276: Improving CloudHttp2SolrClientTest 2019-04-23 10:07:20 +01:00
Andrzej Bialecki f46ba5227e SOLR-13407: Reject update requests sent to non-routed multi collection aliases. 2019-04-18 14:53:06 +02:00
erick a9771a5849 SOLR-13408: Cannot start/stop DaemonStream repeatedly, other API improvements 2019-04-17 16:02:06 -07:00
Uwe Schindler faaee86efb LUCENE-8738: Move to Java 11 as minimum Java version (merged branch: jira/LUCENE-8738)
Co-authored-by: Adrien Grand <jpountz@apache.org>
2019-04-16 14:00:09 +02:00
Chris Hostetter d90034f0d6 SOLR-13336: add maxBooleanClauses (default to 1024) setting to solr.xml, reverting previous effective value of Integer.MAX_VALUE-1, to restrict risk of pathalogical query expansion. 2019-04-15 10:27:08 -07:00
Christine Poerschke fe1a109476 SOLR-13366: Clarify 'Invalid stage name' warning logging in AutoScalingConfig 2019-04-12 16:01:55 +01:00
Joel Bernstein 58001bfc87 SOLR-13391: Add variance and standard deviation stream evaluators
Squashed commit of the following:

commit 406d4b959a42e4830ac1c52836ccbcfc1b614b46
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:03:34 2019 +0200

    added missing package

commit 32c239687c39c5da3e4f2d0f25df73127331fa99
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:03:14 2019 +0200

    added package

commit 7b3f9bd415002969a4ec5d87a9ffbfd6fcff6e92
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:02:28 2019 +0200

    added var and stddev functions

commit 77c4f9fdd9f111862a55b645aad960457291414c
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:00:59 2019 +0200

    added test for the variance and standard deviation stream evaluators

commit 2d9692c178590b65e46cfd9e04ca0384c7d39ec5
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:50:30 2019 +0200

    added var and stddev new evaluators

commit d265225747bce9a0eabd713994ddd4990dbbbfa2
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:49:23 2019 +0200

    variance streaming evaluator

commit a3330064bb62b5723b9125334ef1d61fc3b098d3
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:49:02 2019 +0200

    standard deviation streaming evaluator
2019-04-12 09:37:50 -04:00
Chris Hostetter 980fd7d5c5 SOLR-13393: Fixed ZkClientClusterStateProvider to prevent risk of leaking ZkStateReader/threads when processing concurrent requests during shutdown.
This primarily affected tests, but may have also caused odd errors/delays when restart/shutting down solr nodes.
2019-04-11 14:22:50 -07:00
Andrzej Bialecki 02c4503f8c SOLR-13262: Add collection RENAME command and support using aliases in most collection admin commands. 2019-04-10 18:56:39 +02:00
Joel Bernstein 46131e9cda SOLR-13374: Add fetchSize parameter to the jdbc Streaming Expression 2019-04-05 08:52:52 -04:00
Gus Heck 2d690885e5 SOLR-13322 - let forbidden apis check for sysout in solr core 2019-04-02 22:45:33 -04:00
Jason Gerlowski 2480b74887 SOLR-13362: Add 'includeIndexFieldFlags' in LukeRequest 2019-04-01 20:40:18 -04:00
Kevin Risden 6222abf448
SOLR-9079: Remove commons-lang as a dependency
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-20 19:37:19 -04:00
Andrzej Bialecki 6f2b7bf5c0 SOLR-11127: REINDEXCOLLECTION command for re-indexing of existing collections. 2019-03-19 13:42:59 +01:00
Chris Hostetter 76babf876a SOLR-12923: Fix some issues w/concurrency and exception swallowing in SimClusterStateProvider/SimCloudManager
There are 3 tightly related bug fixes in these changes:

1) ConcurrentModificationExceptions were being thrown by some SimClusterStateProvider methods when
   creating collections/replicas due to the use of ArrayLists nodeReplicaMap. These ArrayLists were changed
   to use synchronizedList wrappers.
2) The Exceptions from #1 were being swallowed/hidden by code using SimCloudManager.submit() w/o checking
   the result of the resulting Future object. (As a result, tests waiting for a particular ClusterShape
   would timeout regardless of how long they waited.)   To protect against "silent" failures like this,
   this SimCloudManager.submit() has been updated to wrap all input Callables such that any uncaught errors
   will be logged and "counted."  SimSolrCloudTestCase will ensure a suite level failure if any such failures
   are counted.
3) The changes in #2 exposed additional concurrency problems with the Callables involved in leader election:
   These would frequently throw IllegalStateExceptions due to assumptions about the state/existence of
   replicas when the Callables were created vs when they were later run -- notably a Callable may have been
   created that held a reference to a Slice, but by the time that Callable was run the collection (or a
   node, etc...) refered to by that Slice may have been deleted.  While fixing this, the leader election
   logic was also cleaned up such that adding a replica only triggers leader election for that shard, not
   every shard in the collection.

While auditing this code, cleanup was also done to ensure all usage of SimClusterStateProvider.lock was
also cleaned up to remove all risky points where an exception may have been possible after aquiring the
lock but before the try/finally that ensured it would be unlocked.
2019-03-14 22:27:48 -07:00
Gus Heck d8f2a02fdb SOLR-13131 Category Routed Aliases 2019-03-13 01:32:23 -04:00
Gus Heck cf88f54a29 Remove inadvertently included println 2019-03-12 16:09:04 -04:00
Gus Heck 9edc557f45 SOLR-12891 MacroExpander will no longer will expand URL parameters by
default inside of the 'expr' parameter, add InjectionDefense class
for safer handling of untrusted data in streaming expressions and add
-DStreamingExpressionMacros system property to revert to legacy behavior
2019-03-12 10:46:30 -04:00
erick 9272c29539 SOLR-13268: Clean up any test failures resulting from defaulting to async logging 2019-03-10 11:05:00 -07:00
Andrzej Bialecki 27df824a4b SOLR-13292: Provide extended per-segment status of a collection. 2019-03-09 14:08:01 +01:00
Christine Poerschke 683aa3d3e9 SOLR-13254: Correct message that is logged in solrj's ConnectionManager when an exception occurred while reconnecting to ZooKeeper. (hu xiaodong via Christine Poerschke) 2019-03-07 20:17:31 +00:00
Joel Bernstein 38005350d1 SOLR-13287: Remove System.out debugging 2019-03-06 13:56:02 -05:00
Andrzej Bialecki 0bc26d07ad SOLR-13271: Read-only mode for SolrCloud collections. 2019-03-05 17:16:25 +01:00
Joel Bernstein c34c56b7b2 SOLR-13287: Allow zplot to visualize probability distributions in Apache Zeppelin 2019-03-05 09:19:14 -05:00
Noble Paul 7771d7bb84 SOLR-13285: Updates with enum fields and javabin cause ClassCastException 2019-03-05 06:11:50 +11:00
Cao Manh Dat e99934b240 SOLR-13276: Adding Http2 equivalent classes of CloudSolrClient and HttpClusterStateProvider 2019-03-04 09:41:45 +00:00
Noble Paul 3ae52e1fe6 SOLR-13282: JDBCStreamTest should use assertEquals(double, double, delta) instead of '==' to compare 2 double values 2019-03-01 10:13:14 +11:00
Joel Bernstein dcb022bc67 SOLR-10436: Add hashRollup Streaming Expression 2019-02-28 09:20:08 -05:00
Cao Manh Dat 00c02290d5 SOLR-12297: Remove debugging System.out line 2019-02-27 09:50:59 +00:00
Noble Paul a89b065c1f SOLR-13255 : ClasscastException when URPs try to read a String field which returns a ByteArrayUTF8CHarSequence . This is a regression in release 7.7 2019-02-20 22:19:18 +11:00
shalinmangar 7e2d40197c SOLR-13248: Autoscaling based replica placement is broken out of the box.
Solr 7.5 enabled autoscaling based replica placement by default but in the absence of default cluster policies, autoscaling can place more than 1 replica of the  same shard on the same node. Also, the maxShardsPerNode and createNodeSet was not respected. Due to these reasons,  this issue reverts the default replica placement policy to the 'legacy' assignment policy that was the default until Solr 7.4.
2019-02-18 13:46:05 -08:00
Erick Erickson 3235c61e77 SOLR-12028: BadApple and AwaitsFix annotations usage. 2019-02-17 10:40:58 -08:00
Noble Paul cfefdade5f SOLR-13171 : A true streaming parser for javabin payload/stream without creating any objects 2019-02-13 18:23:43 +11:00
Bruno P. Kinoshita 5310152450 Fix some spell check issues 2019-02-12 21:35:30 -08:00
Andrzej Bialecki 242ff88e02 SOLR-13155: Add command-line option for testing autoscaling configurations. 2019-02-12 11:53:15 +01:00
Jason Gerlowski f30f9b49bf SOLR-13042: Miscellaneous JSON Faceting ref-guide improvements 2019-02-06 21:09:13 -05:00
David Smiley 372d68f7f6 SOLR-5211: Document that delete-by-id (and updates) don't affect child/nested docs 2019-02-01 15:21:16 -05:00
Noble Paul 250d21da94 SOLR-13130: during the ResponseBuilder.STAGE_GET_FIELDS directly copy string bytes and avoid creating String Objects 2019-01-27 16:02:11 +11:00
Jan Høydahl ea2c8ba38e SOLR-12121: JWT Token authentication plugin with OpenID Connect implicit flow login through Admin UI 2019-01-23 13:03:01 +01:00
Joel Bernstein 2aa2c16b88 SOLR-131476: Add double value to test vector 2019-01-21 14:01:13 -05:00
Joel Bernstein 732281c4cc SOLR-131476: Add movingMAD Stream Evaluator 2019-01-21 13:46:33 -05:00
Joel Bernstein cbfc9cccf6 SOLR-13146: Allow derivatives to be computed for the oscillate Stream Evaluator 2019-01-20 13:19:34 -05:00
Tomas Fernandez Lobbe 8b54b20fc4 SOLR-12770: Make it possible to configure a host whitelist for distributed search 2019-01-15 11:44:57 -08:00
Joel Bernstein 570d573c00 SOLR-13104: Add natural and repeat Stream Evaluators 2019-01-13 13:13:33 -05:00
Joel Bernstein 292e26bc2d SOLR-13134: Allow the knnRegress Stream Evaluator to more easily perform bivariate regression 2019-01-12 15:25:45 -05:00
Noble Paul 0635c657c1 SOLR-13016: precommit errors 2019-01-10 11:58:53 +11:00
Noble Paul 1e14a6c6d6 SOLR-13016: Computing suggestions when policy have "#EQUAL" or "#ALL" rules take too long 2019-01-09 23:18:05 +11:00
Noble Paul 825e63c00b SOLR-12983: tests don't need to use the optimization 2019-01-08 17:26:19 +11:00
Noble Paul 3932a4cc6c SOLR-12983: JavabinLoader should avoid creating String Objects and create UTF8CharSequence fields from byte[] 2019-01-08 15:27:48 +11:00
Andrzej Bialecki 6e745bd250 SOLR-12730: Implement staggered SPLITSHARD requests in IndexSizeTrigger. 2019-01-07 19:14:54 +01:00
Shalin Shekhar Mangar 2bd6f246b0 SOLR-11126: New Node-level health check handler at /admin/info/healthcheck and /node/health paths that checks if the node is live, connected to zookeeper and not shutdown 2019-01-06 12:41:49 +05:30
David Smiley 6342ec699e SOLR-12633: remove anonChildDocs update parameter used in nested docs in JSON. 2019-01-03 10:58:59 -05:00
Gus Heck 752989fd74 SOLR-13086 improve error message in DocumentObjectBinder 2018-12-31 07:54:56 -05:00
Erick Erickson 24ae0d16cd SOLR-12028: Catching up with annotations after recent Solr test work 2018-12-27 18:03:50 -08:00
Joel Bernstein d018cd18f4 SOLR-13088: Add zplot Stream Evaluator to plot math expressions in Apache Zeppelin 2018-12-27 14:42:27 -05:00
Jason Gerlowski 207b3f4453 SOLR-13045: Sim node versioning should start at 0
Prior to this commit, new ZK nodes being simulated by the sim framework
were started with a version of -1.  This causes problems, since -1 is
also coincidentally the flag value used to ignore optimistic concurrency
locking and force overwrite values.
2018-12-21 08:04:44 -05:00
Adrien Grand 785d02208a Remove duplicate package info. 2018-12-17 11:29:34 +01:00
Adrien Grand 6f08eee2fd Fix compilation. 2018-12-17 10:07:36 +01:00
Cao Manh Dat f80e8e1167 Merge jira/http2 branch to master 2018-12-16 16:58:20 +00:00
Dawid Weiss e916f1fb86 LUCENE-8611: Update randomizedtesting to 2.7.2, JUnit to 4.12, add hamcrest-core dependency. 2018-12-15 09:49:36 +01:00
Jan Høydahl 81dbad54e0 SOLR-12799: Allow Authentication Plugins to intercept internode requests on a per-request basis
Add 'forwardCredentials' parameter to BasicAuth which will then skip using PKI on sub requests
2018-12-13 10:51:56 +01:00
Joel Bernstein 7e4555a2fd SOLR-13057: Allow search, facet and timeseries Streaming Expressions to accept a comma delimited list of collections 2018-12-12 09:16:08 -05:00
Noble Paul c651cbfd9a SOLR-12885: BinaryResponseWriter (javabin format) should directly copy from BytesRef to output 2018-12-11 18:35:57 +11:00
Jan Høydahl b6cbb8494e SOLR-13014: URI Too Long with large streaming expressions in SolrJ 2018-12-10 18:22:52 +01:00
markrmiller 3eb2612e67 SOLR-12988: Disable SSL on Java 11/12 for now. 2018-12-09 18:31:28 -06:00
Joel Bernstein 17fca051c5 SOLR-13046: Suppress SSL for StreamingTest 2018-12-07 09:19:40 -05:00
Jason Gerlowski a5fb6f8adc Add 'prelim_sort' helper to SolrJ's TermsFacetMap 2018-12-04 14:29:29 -05:00
markrmiller 33c40a8da4 SOLR-13027: Change retries to work across JVM impls properly by looking for an IOException. 2018-12-01 00:26:15 -06:00
markrmiller d8f482f5fb SOLR-13030: Update executor usage to work correctly with Java 11 and update Mockito & HttpComponents to work with Java 11 and fix get remote info retry to work across jvms better. 2018-12-01 00:26:02 -06:00
markrmiller 75b1831967 SOLR-12801: Make massive improvements to the tests.
SOLR-12804: Remove static modifier from Overseer queue access.

SOLR-12896: Introduce more checks for shutdown and closed to improve clean close and shutdown. (Partial)

SOLR-12897: Introduce AlreadyClosedException to clean up silly close / shutdown logging. (Partial)

SOLR-12898: Replace cluster state polling with ZkStateReader#waitFor. (Partial)

SOLR-12923: The new AutoScaling tests are way too flaky and need special attention. (Partial)

SOLR-12932: ant test (without badapples=false) should pass easily for developers. (Partial)

SOLR-12933: Fix SolrCloud distributed commit.
2018-11-29 11:58:51 -06:00
Joel Bernstein c2cac88770 SOLR-12984: The search Streaming Expression should properly support and push down paging when using the /select handler 2018-11-27 11:22:02 -05:00
Moshe a346ba0d3c SOLR-5211: Always populate _root_ (if defined).
And, small refactor: Clarified how _version_ is transferred from root to children.
2018-11-25 21:47:49 -05:00
Noble Paul 492c3440de SOLR-13006: ZkNodeProps to be able to load from both javabin and JSON 2018-11-21 18:20:03 +11:00
Noble Paul 25bca6f165 SOLR-12992: When using binary format, ExportWriter to directly copy BytesRef instead of creating new String 2018-11-20 14:58:32 +11:00
Jason Gerlowski d17c6d8897 SOLR-12981: Introduce SolrJ type for JSON facet response parsing
Recent JIRA's (SOLR-12947, SOLR-12965) have added support making it
easier to compose JSON query/faceting requests using SolrJ.  But neither
made parsing the responses to these queries any easier.

This commit introduces NestableJsonFacet (along with several companion
types) which are Java representations of the JSON faceting response.
They can be accessed via the new QueryResponse method:
`getJsonFacetingResponse()`.
2018-11-17 17:14:40 -05:00
Erick Erickson 763e64260f SOLR-12881: Remove unneeded import statements 2018-11-14 17:48:15 -08:00
Noble Paul e81dd4e870 SOLR-12977: fixed bug 2018-11-13 00:10:04 +11:00
Noble Paul cd1e829732 SOLR-12978: In autoscaling NPE thrown for nodes where value is absent 2018-11-12 18:53:16 +11:00
Noble Paul 605c3f6f1a SOLR-12977: Autoscaling tries to fetch metrics from dead nodes 2018-11-12 18:39:05 +11:00
Jason Gerlowski 52998fa50e SOLR-12965: Add facet support to JsonQueryRequest 2018-11-10 21:44:25 -05:00
Jason Gerlowski 4410ef941a SOLR-12947: Misc JsonQueryRequest code cleanup 2018-11-09 13:15:08 -05:00
Chris Hostetter 77a4bfaa90 SOLR-12962: Added a new 'uninvertible' option for fields and fieldtypes. This defaults to 'true' for backcompat allowing a FieldCache to be built for indexed fields as needed, but users are encouraged to set this to false (using docValues as needed) to reduce the risk of large fluxuations in heap size due to unexpected attempts to sort/facet/function on non-docValue fields. 2018-11-09 08:30:04 -07:00
Jason Gerlowski 1b084db901 SOLR-12947: Add MapWriter compatibility to JsonQueryRequest
JsonQueryRequest had `setQuery` methods that took in a query either as a
String or as a Map.  But no such overload for MapWriter, a SolrJ
interface used to transmit Maps via "push writing" over the wire.  This
commit adds an overload taking this type, so that users can specify
their queries this way as well.

This commit also changes JsonQueryRequest writes out the request, to
ensure it uses "push writing" in non-MapWriter cases as well.
2018-11-07 21:40:06 -05:00
Joel Bernstein 2d0e565c62 SOLR-12975: Add ltrim and rtrim Stream Evaluators 2018-11-07 20:47:07 -05:00
Gus Heck 53482e510c SOLR-12938 - fix test case for handling of bogus collection names
that was failing when HttpClusterStateProvider is used instead of
ZkClusterStateProvider
2018-11-07 20:05:32 -05:00
Joel Bernstein 259925d12f SOLR-12795: Require bucketSorts 2018-11-07 08:58:57 -05:00
Joel Bernstein 80efc23999 SOLR-12971: Add pivot Stream Evaluator to pivot facet co-occurrence counts into a matrix 2018-11-07 08:14:17 -05:00
Joel Bernstein b230543b47 SOLR-12795: Fix precommit 2018-11-06 11:53:00 -05:00
Joel Bernstein 3d94213110 SOLR-12795: Introduce 'rows' and 'offset' parameter in FacetStream 2018-11-06 11:23:40 -05:00
Jason Gerlowski 2d95b740db SOLR-12947: Add SolrJ helper for making JSON DSL requests
The JSON request API is great, but it's hard to use from SolrJ.  This
commit adds 'JsonQueryRequest', which makes it much easier to write
JSON API requests in SolrJ applications.
2018-11-06 07:34:53 -05:00
Noble Paul 08fcce4c98 SOLR-11997: Suggestions API/UI should show an entry where a violation could not be resolved 2018-11-06 22:27:26 +11:00
Gus Heck 45b772f4a9 SOLR-12938 - Cluster status now returns results for aliases instead of
throwing an exception
2018-11-04 12:01:51 -05:00
Noble Paul eb359ca079 SOLR-12023: Autoscaling policy engine shuffles replicas needlessly 2018-11-04 19:23:56 +11:00
Andrzej Bialecki 3ed64375ef SOLR-12942: Add an option in IndexSizeTrigger to select the split shard method. 2018-10-31 18:47:34 +01:00
Joel Bernstein 856e28d8cf SOLR-11572: Add recip Stream Evaluator to support reciprocal transformations 2018-10-30 09:42:24 -04:00
Joel Bernstein ac1925045d SOLR-12936: Allow percentiles Stream Evaluator to accept an array of percentiles to calculate 2018-10-29 16:29:04 -04:00
Joel Bernstein e618e831d3 SOLR-12935: Suppress SSL for StreamExpressionTest and StreamDecoratorTest 2018-10-29 13:49:31 -04:00
Noble Paul a298802516 SOLR-12868: test was making wrong assumption 2018-10-27 11:11:54 +11:00
Marvin Bredal Lillehaug 6c419454a2 SOLR-7557: Fix parsing of child documents using queryAndStreamResponse 2018-10-26 14:59:31 +02:00
Noble Paul f33be7a172 SOLR-12868: Request forwarding for v2 API is broken 2018-10-26 12:50:45 +11:00
Christine Poerschke c277674f0e SOLR-12873: Replace few remaining occurrences of LUCENE_CURRENT with LATEST for luceneMatchVersion. 2018-10-24 19:28:12 +01:00
David Smiley 3e89b7a771 SOLR-12754: New hl.weightMatches for UnifiedHighlighter WEIGHT_MATCHES
(defaults to true in master/8)
2018-10-23 13:28:10 -04:00
noble 576d28f643 SOLR-11522: Moved the _get methods to a separate interafce and keep MapWriter clean 2018-10-23 12:35:23 +11:00
Anshum Gupta d799fd53c7 SOLR-5004: Allow a shard to be split into 'n' sub-shards using the collections API 2018-10-22 15:01:24 -07:00
Joel Bernstein fcaea07f3c SOLR-12829: Add plist (parallel list) Streaming Expression 2018-10-22 15:20:13 -04:00
Noble Paul c31a95d261 SOLR-12846: Added support for "host" variable in autoscaling policy rules 2018-10-23 00:03:59 +11:00
Noble Paul 5de6332209 SOLR-12892: MapWriter to use CharSequence instead of String 2018-10-22 11:14:41 +11:00
Andrew Lundgren 1a8188d92b SOLR-10981: Support for stream.url or stream.file pointing to gzipped data 2018-10-18 19:53:21 -04:00
Jason Gerlowski e6f6f352cf SOLR-12856: Small improvements to SolrJ javadocs 2018-10-17 19:10:56 -04:00
Christine Poerschke 95af8d6ac2 SOLR-12876: remove @BadApple from ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:51 -04:00
Christine Poerschke 7fa19d2676 SOLR-12876: upon failure report exception message in ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:11 -04:00
Noble Paul f1a30bfb00 SOLR-12792: extract test data into separate files in autoscaling tests 2018-10-16 19:11:08 +11:00
Shalin Shekhar Mangar aa0a5289e6 SOLR-12739: Clear all collections in TestCollectionStateWatchers setup so that the collections created by test methods are spread evenly in the cluster. 2018-10-16 12:14:22 +05:30
Noble Paul 9c7b8564d8 SOLR-12806: use autoscaling policies with strict=false to prioritize node allocation 2018-10-16 16:56:51 +11:00
Joel Bernstein 73a413cd85 SOLR-12862: Fix TestLang 2018-10-15 15:47:03 -04:00
Joel Bernstein 6c0fbe5a9d SOLR-12862: Add log10 Stream Evaluator and allow the pow Stream Evaluator to accept a vector of exponents 2018-10-15 15:47:03 -04:00
Christine Poerschke 1ccd555862 Fix couple of typos. 2018-10-15 15:08:17 -04:00
Erick Erickson 6c5df58b5a SOLR-12028: BadApple and AwaitsFix annotations usage 2018-10-14 21:13:33 -04:00
Jason Gerlowski 6d1b2e2f38 SOLR-8808: Add null/empty check to SolrClient.deleteByIds 2018-10-13 22:15:36 -04:00
Jason Gerlowski 42ac07d11b SOLR-12565: Add SolrJ snippet to 'Using ZooKeeper to manage config' ref-guide page 2018-10-11 14:30:43 -04:00
Joel Bernstein a0bb501772 SOLR-12851: Improvements and fixes to let and select Streaming Expressions 2018-10-11 10:43:57 -04:00