Commit Graph

8141 Commits

Author SHA1 Message Date
Dawid Weiss 23f3fd2d48 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-25 13:14:57 +01:00
Bruno Roustant 27840562a6
SOLR-14131: Add maxQueryLength option to DirectSolrSpellchecker.
Closes #1113
2019-12-24 15:05:00 +01:00
Nándor Mátravölgyi 1be5b68964 LUCENE-9091: UnifiedHighlighter HTML escaping should only
escape essentials
2019-12-23 17:20:48 -05:00
Noble Paul ef15ae9805
SOLR-14125 : Streaming expressions to be loadable from packages (#1108)
SOLR-14125: Make <expressible> plugins work with packages
2019-12-23 15:20:26 +11:00
Tomas Fernandez Lobbe c4f68bdab9
SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper (#1095)
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
2019-12-20 14:55:01 -08:00
Dawid Weiss 5897b78572 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-20 17:35:40 +01:00
Kevin Risden aab3c5faa3
SOLR-14106: Cleanup Jetty SslContextFactory usage
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:05:47 -05:00
Chris Hostetter bc2770ebb8 SOLR-14128: SystemCollectionCompatTest - increase logging to aid in debuging future (jenkins) failures 2019-12-19 17:14:56 -07:00
Mike Drob 93585ba1d3 SOLR-13190 Surface Fuzzy term errors in Solr
Use newly added exceptions in Lucene for too complex fuzzy terms to
provide better error reporting for Solr queries.
2019-12-19 10:58:28 -06:00
Ishan Chattopadhyaya cbfa781fe3 SOLR-14108: Handle missing verify commands or missing default params in Package Manager 2019-12-19 10:38:34 +05:30
Matthias Krueger 1e5100d5a5
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 17:24:43 -05:00
Dawid Weiss 206d62b9d5 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-18 15:10:04 +01:00
Robert Muir 56839f6ace SOLR-13983: remove or replace process execution in SystemInfoHandler 2019-12-18 09:03:07 -05:00
Robert Muir 612cba38ca SOLR-14110: sandbox javax.script usage in tests 2019-12-18 06:30:24 -05:00
Dawid Weiss 28b19c2af2 Merge with master. 2019-12-18 09:32:35 +01:00
Dawid Weiss 71a5714e29 SOLR-14103: remove extra unused dependencies (jersey-core, jersey-server, netty-all). 2019-12-18 09:18:32 +01:00
Mikhail Khludnev b0e532b7f3 SOLR-14051: removing Block Join Facet Component in favor of uniqueBlock(\_root_). 2019-12-18 11:16:53 +03:00
Gus Heck 46e5e13728 SOLR-13749 Cross collection join filter (XCJF)
Squashed commit of the following:  commit ffa68a8adb9c5dc16578ab26f731da247533c980
2019-12-18 03:01:24 -05:00
Chris Hostetter cc4262a8ec SOLR-14099: Fixed @LogLevel annotation in test-framework to correctly 'unset' Loggers after test 2019-12-17 14:58:45 -07:00
Tim Allison 279a391cf3
SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies) (#1092)
* SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies)

* fix CHANGES.txt file
2019-12-17 16:09:08 -05:00
Chris Hostetter 8493cf18cb Harden (Cloud)ExitableDirectoryReaderTest
Thread.sleep() is "subject to the precision and accuracy of system timers and schedulers."

But tests using DelayingSearchComponent need to ensure that it sleeps *at least* as long as they request, in order to trigger the timeAllowed constraint
2019-12-17 13:54:33 -07:00
Chris Hostetter 33e44b2fd6 SOLR-13696: AwaitsFix RoutedAliasUpdateProcessorTest (and subclasses)
The helper method RoutedAliasUpdateProcessorTest.addDocsAndCommit doesn't garuntee docs have been committed when it returns, causing threading/timing bugs in tests that use it as a gate for making subsequent assertions -- causing a steady stream of jenkins test failures
2019-12-17 11:00:03 -07:00
Dawid Weiss 4b7bb7cf29 SOLR-14103: remove unused dependencies and their checksums, licenses. 2019-12-17 15:52:12 +01:00
Dawid Weiss 4c94a13e69 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-17 13:38:14 +01:00
Chris Hostetter db11e9e9a2 SOLR-14081: re-implement FullSolrCloudDistribCmdsTest to extend SolrCloudTestCase 2019-12-16 15:58:06 -07:00
Chris Hostetter e6b5da5c12 SOLR-14099: work around @LogLevel bug in LoggingHandlerTest 2019-12-16 12:13:03 -07:00
Robert Muir dc35e5752b LUCENE-9094: Ban ObjectInputStream and ObjectOutputStream in forbidden-apis 2019-12-16 13:31:11 -05:00
Andrzej Bialecki b5a2cfba4f SOLR-14094: Enable this test again in master. 2019-12-16 15:54:04 +01:00
Ishan Chattopadhyaya ee0b066ab6 SOLR-14096: Stopping -Denable.packages=true from leaking to other tests 2019-12-16 20:20:07 +05:30
Andrzej Bialecki 83800c03df Fix an occasional test error caused by the maintenance trigger generating events. 2019-12-16 13:54:36 +01:00
Ishan Chattopadhyaya 7dfea5fe33 SOLR-14087: Changing the filestore dir name back to filestore from .filestore 2019-12-16 18:18:53 +05:30
Adrien Grand b660bcd0a2 SOLR-14094: Bad-apple TestSolrCachePerf. 2019-12-16 13:46:33 +01:00
Dawid Weiss bc539fc0fd Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-16 11:20:45 +01:00
noble 479db61df8 SOLR-14087: changed the filestore location to .filestore instead of $filestore 2019-12-16 15:51:36 +11:00
Noble Paul d64c5c20b6
SOLR-14087: disable package store API if -Denable.packages not set to true 2019-12-16 08:04:33 +11:00
Kevin Risden 2f051a4bfe
SOLR-14086: Tika ClassNotFound error due to commons-compress in solr-core dependency
Introduced in SOLR-14033 by including
commons-compress as a compile time
dependency in Solr core instead of as
as test only dependency.

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-15 13:39:52 -05:00
Ishan Chattopadhyaya 640ff96522 SOLR-13662: Fixes to package manager
* Better logging and error reporting
* Fixing deploy command to handle previously undeployed packages
* Test now uses @LogLevel annotation
* Deploy command had a hard coded collection name by mistake, fix it
2019-12-15 10:44:02 +05:30
yonik 49c34028ab SOLR-13884: Ignore ConcurrentCreateCollectionTest 2019-12-14 09:31:13 -05:00
Kevin Risden 7a9a6ef79e
SOLR-14077: Hadoop shouldn't need to look for metrics config in user home
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-13 22:08:48 -05:00
yonik 5f8e65c58f SOLR-14079: fix SPLITSHARD splitByPrefix in async mode 2019-12-13 17:55:05 -05:00
yonik db65c82c39 SOLR-13884: detect multiple replicas on single node 2019-12-13 17:37:44 -05:00
yonik 73c535261c SOLR-13884: use policies, preferences 2019-12-13 17:37:44 -05:00
yonik fae6aebc74 SOLR-13884: add ConcurrentCreateCollectionTest test 2019-12-13 17:37:44 -05:00
erick 8278886966 SOLR-14026: Upgrade Jetty to 9.4.24.v20191120 and dropwizard to 4.1.2 2019-12-13 10:01:37 -05:00
Dawid Weiss 16466d5256 Add dependency on log4j-1.2 api for solr core tests. 2019-12-13 15:32:59 +01:00
Dawid Weiss 4500f0e327 Consolidating versions between gradle and ant. 2019-12-13 13:31:23 +01:00
Dawid Weiss 035cede6b8 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-13 10:51:14 +01:00
Robert Muir f083f40b28 SOLR-14076: clean up static fields leak in nightly-only test 2019-12-13 04:06:07 -05:00
Kevin Risden 3ba005465a
SOLR-14048: Improve Hadoop test sanity checks
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 21:27:38 -05:00
Dawid Weiss 4cee6c68c7 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-12 17:27:28 +01:00
Kevin Risden 322ed8ce4d
SOLR-14047: Make sure tests don't pickup other Hadoop installs
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 10:23:29 -05:00
Dawid Weiss 6094d4dd13 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-12 14:16:48 +01:00
noble b35f1debe3 SOLR-14013: javabin performance regressions 2019-12-12 23:26:37 +11:00
Ishan Chattopadhyaya 7097e9c41a SOLR-13978: Removed LTR from default configset 2019-12-12 15:09:21 +05:30
Ishan Chattopadhyaya fa1ad006b6 SOLR-14071: Untrusted configsets shouldn't be allowed to use <lib> directive 2019-12-12 15:00:09 +05:30
Ishan Chattopadhyaya dce36c10e9 SOLR-13978: Remove non-essential components from default configset
The default configset no longer has the following:
   - Library inclusions (<lib ../>) for extraction, solr-cell libs, clustering, velocity and language identifier
   - /browse, /tvrh and /update/extract handlers
   - TermVector component (if someone wants it, can be added using config APIs)
   - XSLT response writer
   - Velocity response writer
If you want to use them in your collections, please add them to your configset manually or through the Config APIs.
2019-12-12 10:43:31 +05:30
Munendra S N 88b5b5a7cd SOLR-13970: disallow using collapse/expand with grouping
* Using collapse with grouping would cause inconsistent behavior.
  This is because grouping calls the same postfilter twice without
  resetting the internal state of the DocValues cache
* Using expand with grouping would cause NPE
2019-12-12 10:21:20 +05:30
Ishan Chattopadhyaya f681d433ae SOLR-14062: Split IndexSizeTriggerTest into three 2019-12-12 10:12:17 +05:30
Ishan Chattopadhyaya 8db8ab3be2 SOLR-13945: SPLITSHARD can cause data loss due to rollback when final commit fails 2019-12-12 08:58:34 +05:30
Kevin Risden 861c77cb17
SOLR-14053: Fix HDFS tests to be ignored if Native I/O isn't available (remove tests.disableHdfs)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-11 22:02:07 -05:00
Mikhail Khludnev f01b3e97d1 SOLR-13904: Make Analytics component sensitive to timeAllowed. 2019-12-11 23:48:17 +03:00
Robert Muir dc031ea382 SOLR-14050: clean up tests use of network addresses
Solr tests now have a similar policy to Lucene, loopback use only. If a
test tries to resolve or connect to the internet, it will get SecurityException.

Some solr tests explicitly try to talk to dead nodes with real
networking. This is not good and asking for trouble, but use low loopback port numbers instead of
multicast addresses. The idea is that it fails faster. Move these to
constants so that stuff isn't copy-pasted everywhere, in case we have to
do something different later.
2019-12-11 12:51:45 -05:00
Dawid Weiss 5cbbdae793 SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL). 2019-12-11 16:40:31 +01:00
Dawid Weiss 77a5dd6926 SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL). 2019-12-11 16:39:54 +01:00
Dawid Weiss 16019344cb Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-11 15:03:46 +01:00
Dawid Weiss 9e236a4835
SOLR-14053: Don't start hdfs when native libraries can't be loaded. Remove tests.disableHdfs. (#1072) 2019-12-11 15:01:24 +01:00
Jason Gerlowski d8aa04575f
SOLR-13972: Warn about insecure settings on startup (#1058) 2019-12-11 07:16:09 -05:00
Dawid Weiss 87104a155a Correct commons-compress dependency. 2019-12-11 09:44:16 +01:00
Dawid Weiss 9fad7b67b0 Follow-up to changes on master. 2019-12-11 09:01:37 +01:00
Dawid Weiss 27d5509644 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-11 08:57:18 +01:00
Ishan Chattopadhyaya 34f11c9f57 SOLR-13822: Fix Eclipse project 2019-12-11 05:55:30 +05:30
Thomas Wöckinger 9e84da95a2 SOLR-13966: forgot to test empty list 2019-12-10 16:29:19 -05:00
Kevin Risden 48775ea18e
SOLR-14033: Fix Hadoop tests with security manager
This removes the Solr security manager hacks
for Hadoop. It does so by:
* Using a fake group mapping class instead of ShellGroupMapping
* Copies a few Hadoop classes and modifies them for tests with no Shell
* Nulls out some of the static variables in the tests

The Hadoop files were copied from Apache Hadoop 3.2.0
and copied to the test package to be only picked up
during tests. They were modified to remove the need to
shell out for access. The assumption is that these
HDFS integration tests only run on Unix based systems
and therefore Windows compatibility was removed in some
of the modified classes. The long term goal is to remove
these custom Hadoop classes. All the copied classes are
in the org.apache.hadoop package.

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-10 16:15:24 -05:00
Andrzej Bialecki c4f0c33638 SOLR-13975, SOLR-13896: ConcurrentUpdateSolrClient connection stall prevention. 2019-12-10 21:45:43 +01:00
Dawid Weiss 20eaaa012d Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-10 14:52:30 +01:00
Andrzej Bialecki fed199df7b SOLR-13563: SPLITSHARD using LINK method fails on disk usage checks. 2019-12-10 14:21:37 +01:00
Christine Poerschke b97afd79ca Fix 5 javac warnings: 'yield' may become a restricted identifier in a future release. 2019-12-10 12:32:34 +00:00
Thomas Wöckinger e250f3e82c SOLR-13966: LatLonPointSpatialField fix for RealTimeGetComponent
used in atomic/partial updates.
Closes #1035
2019-12-09 22:51:18 -05:00
Houston Putman 1c78d2c637
SOLR-12217: Support shards.preference in SolrJ for individual shard requests (#984) 2019-12-09 17:11:58 -05:00
Dawid Weiss f853d994ec Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 16:48:21 +01:00
Andrzej Bialecki 86cab79730 SOLR-13979: Expose separate metrics for distributed and non-distributed requests. 2019-12-09 13:46:33 +01:00
Dawid Weiss a6d7017f2e Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 10:55:54 +01:00
Munendra S N df508ffe01 SOLR-11706: fix for multivalued trie date in min/max and more tests
* selecting single value for multivalued trie date field is not
  supported.
* add additional tests for variance, unique, hll aggregations
2019-12-08 10:49:37 +05:30
Michael Gibney 8e9876f516 SOLR-7798: robust support for expand when used w/o collapsing (#325)
There are applications of ExpandComponent that intentionally do not
involve prior collapsing of results on the expand field, which can lead
to an NPE in expand component when expand.field (for matched docs) has
fewer unique values than the number of matched docs.

This commit refines the approach taken in SOLR-13877, which addressed
the same underlying issue.
2019-12-08 09:59:33 +05:30
Kevin Risden 7c8635d600
SOLR-14028: Fix test permissions for TestSolrCLIRunExample
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:32:11 -05:00
Dawid Weiss c3bb81f032 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-07 10:53:34 +01:00
Dawid Weiss 78575f0a2c Revert "Adding woodstox temporarily so that tests pass."
This reverts commit de8a37ee72.
2019-12-07 10:51:00 +01:00
Munendra S N a1e51cd777 SOLR-11706: minor refactors
* rename stdDev, variance methods to reflect the functionality
* add util functions to compute corrected stdDev and variance
* use DocValuesIterator#advanceExact to check if values exists for the doc
2019-12-07 11:16:25 +05:30
Erick Erickson 7d5d44a3c4 SOLR-13988: Harden CreateCollectionCleanupTest. Incorporate Dawid Weiss' suggestion for windows 2019-12-06 19:10:27 -05:00
Mike 155ab116a2
Revert "SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050)" (#1063)
This reverts commit 2387bb9d60.
2019-12-06 17:08:40 -06:00
Dawid Weiss 0d18581225 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-06 19:02:26 +01:00
Erick Erickson 106b9d6866 SOLR-13988: Harden CreateCollectionCleanupTest 2019-12-06 11:59:53 -05:00
Dawid Weiss de8a37ee72 Adding woodstox temporarily so that tests pass. 2019-12-06 13:37:48 +01:00
Dawid Weiss f371df327f Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-06 11:57:29 +01:00
Andrzej Bialecki d2b01ef28f SOLR-13831: Context property _loop_iter_ should be a string in order to support
variable expansion.
2019-12-05 18:27:12 +01:00
Anshum Gupta 2387bb9d60
SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050) 2019-12-05 18:37:53 +05:30
Dawid Weiss 1a24ccb4ee Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-05 11:17:34 +01:00
Munendra S N 12e8cca644 SOLR-11706: add support for aggregation on multivalued fields
* min, max, sum, sumsq, avg, stddev, variance, percentile aggregations
  in JSON facets now supports multivalued fields
2019-12-05 10:48:22 +05:30
Robert Muir c4126ef858 SOLR-14015: remove blanket filesystem read access from solr-tests.policy
Restrict this to only minimal paths like lucene. It is the defense for directory traversal attacks.
It will also help find bad bugs where things are reading filesystem in the wrong locations.
2019-12-04 23:16:19 -05:00
Robert Muir becc16fb28 SOLR-14002: fix another static leak in test 2019-12-03 22:43:11 -05:00