Commit Graph

14136 Commits

Author SHA1 Message Date
Dawid Weiss 7350f03cd1 Reordered some lines and comments to make it easier to manually diff/ merge with gradle branch. 2019-12-25 13:29:11 +01:00
Dawid Weiss 584f564c91 Reordered some lines and comments to make it easier to manually diff/ merge with gradle branch. 2019-12-25 13:26:16 +01:00
Dawid Weiss 23f3fd2d48 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-25 13:14:57 +01:00
Jan Høydahl aa43f352d9
SOLR-14146: Zookeeper version not resolved in RefGuide (#1119) 2019-12-24 23:06:27 +01:00
Robert Muir 3ab59aa1c9 SOLR-14120: Solr Admin UI breaks when using IE11 2019-12-24 11:27:44 -08:00
Robert Muir b73e27d1ca SOLR-14144: add IP-based access control to securing solr page 2019-12-24 07:55:42 -08:00
Robert Muir b87e1f5843 SOLR-14143: add request logging to securing solr page 2019-12-24 06:46:29 -08:00
Robert Muir efd13f2884 SOLR-13984: docs, changes.txt 2019-12-24 06:41:14 -08:00
Robert Muir 126d6b7767
SOLR-13984: add (experimental, disabled by default) security manager support (#1082)
* SOLR-13984: add (experimental, disabled by default) security manager support.

User can set SOLR_SECURITY_MANAGER_ENABLED=true to enable security manager at runtime.

The current policy file used by tests is moved to solr/server
Additional permissions are granted for the filesystem locations set by bin/solr, and networking everywhere is enabled.

This takes advantage of the fact that permission entries are ignored if properties are not defined:
https://docs.oracle.com/javase/7/docs/technotes/guides/security/PolicyFiles.html#PropertyExp
2019-12-24 06:30:31 -08:00
Bruno Roustant 27840562a6
SOLR-14131: Add maxQueryLength option to DirectSolrSpellchecker.
Closes #1113
2019-12-24 15:05:00 +01:00
Robert Muir 72c99e921c
SOLR-14136: ip whitelist/blacklist via env vars (#1111)
SOLR-14136: ip whitelist/blacklist via env vars

This makes it easy to restrict access to Solr by IP. For example SOLR_IP_WHITELIST="127.0.0.1, 192.168.0.0/24, [::1], [2000:123:4:5::]/64" would restrict access to v4/v6 localhost, the 192.168.0 ipv4 network, and 2000:123:4:5 ipv6 network. Any other IP will receive a 403 response.

Blacklisting functionality can deny access to problematic addresses or networks that would otherwise be allowed. For example SOLR_IP_BLACKLIST="192.168.0.3, 192.168.0.4" would explicitly prevent those two specific addresses from accessing solr.
2019-12-23 19:26:11 -05:00
Nándor Mátravölgyi 1be5b68964 LUCENE-9091: UnifiedHighlighter HTML escaping should only
escape essentials
2019-12-23 17:20:48 -05:00
Robert Muir 403fd05646 SOLR-14138: changes.txt 2019-12-23 10:49:18 -08:00
Robert Muir 1425d6cbf8
SOLR-14138: enable request log via environ var, remove deprecated jetty class usage, respect SOLR_LOGS_DIR (#1110)
User can now set SOLR_REQUESTLOG_ENABLED=true to enable the jetty request log, instead of editing XML. The location of the request logs will respect SOLR_LOGS_DIR if that is set. The deprecated NCSARequestLog is no longer used, instead it uses CustomRequestLog with NCSA_FORMAT.
2019-12-23 10:37:31 -05:00
Noble Paul ef15ae9805
SOLR-14125 : Streaming expressions to be loadable from packages (#1108)
SOLR-14125: Make <expressible> plugins work with packages
2019-12-23 15:20:26 +11:00
Tomas Fernandez Lobbe c4f68bdab9
SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper (#1095)
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
2019-12-20 14:55:01 -08:00
Cassandra Targett 53423462f2 Ref Guide: various little typos; clean up Solr CLI section on bin/solr export 2019-12-20 15:00:22 -06:00
Dawid Weiss 5897b78572 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-20 17:35:40 +01:00
Andy Vuong e428628054 SOLR-14107: Ensure bin/solr -q/-v args work with -e/example (#1093)
Co-authored-by: Andy Vuong <andyvvv.101@gmail.com>
2019-12-20 11:31:16 -05:00
Robert Muir b7b6b0f3bf SOLR-14112: do not display load average of -1.00 on windows in admin UI 2019-12-20 05:42:00 -05:00
Kevin Risden aab3c5faa3
SOLR-14106: Cleanup Jetty SslContextFactory usage
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:05:47 -05:00
Chris Hostetter bc2770ebb8 SOLR-14128: SystemCollectionCompatTest - increase logging to aid in debuging future (jenkins) failures 2019-12-19 17:14:56 -07:00
Mike Drob 93585ba1d3 SOLR-13190 Surface Fuzzy term errors in Solr
Use newly added exceptions in Lucene for too complex fuzzy terms to
provide better error reporting for Solr queries.
2019-12-19 10:58:28 -06:00
Gus Heck 2f7276f935 Fix attribution 2019-12-19 10:50:37 -05:00
Jason Gerlowski 7cfa31b103 SOLR-14042: Fix varargs precommit warnings 2019-12-19 10:03:04 -05:00
Adrien Grand 868e41bc99 Minor improvements to the Solr changes. 2019-12-19 08:41:36 +01:00
Ishan Chattopadhyaya cbfa781fe3 SOLR-14108: Handle missing verify commands or missing default params in Package Manager 2019-12-19 10:38:34 +05:30
Robert Muir 7490bfd828 SOLR-14085: remove solr fork of lucene test securitymanager 2019-12-18 23:06:31 -05:00
Chris Hostetter d30f90e349 SOLR-14099: expanded comment on static final variable based on followup questions in Jira from Dawid 2019-12-18 16:36:34 -07:00
Matthias Krueger 1e5100d5a5
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 17:24:43 -05:00
Cassandra Targett fc2fbb2f7e SOLR-13662: Improvements for Ref Guide package-manager.adoc 2019-12-18 09:28:16 -06:00
Dawid Weiss 206d62b9d5 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-18 15:10:04 +01:00
Robert Muir 56839f6ace SOLR-13983: remove or replace process execution in SystemInfoHandler 2019-12-18 09:03:07 -05:00
Robert Muir 612cba38ca SOLR-14110: sandbox javax.script usage in tests 2019-12-18 06:30:24 -05:00
Dawid Weiss 2e453afa28 Merge tika upgrade monster-patch. commons-csv excluded from gradle. 2019-12-18 09:51:57 +01:00
Dawid Weiss 28b19c2af2 Merge with master. 2019-12-18 09:32:35 +01:00
Dawid Weiss 71a5714e29 SOLR-14103: remove extra unused dependencies (jersey-core, jersey-server, netty-all). 2019-12-18 09:18:32 +01:00
Mikhail Khludnev b0e532b7f3 SOLR-14051: removing Block Join Facet Component in favor of uniqueBlock(\_root_). 2019-12-18 11:16:53 +03:00
Gus Heck 46e5e13728 SOLR-13749 Cross collection join filter (XCJF)
Squashed commit of the following:  commit ffa68a8adb9c5dc16578ab26f731da247533c980
2019-12-18 03:01:24 -05:00
Chris Hostetter cc4262a8ec SOLR-14099: Fixed @LogLevel annotation in test-framework to correctly 'unset' Loggers after test 2019-12-17 14:58:45 -07:00
Tim Allison 279a391cf3
SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies) (#1092)
* SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies)

* fix CHANGES.txt file
2019-12-17 16:09:08 -05:00
Chris Hostetter 8493cf18cb Harden (Cloud)ExitableDirectoryReaderTest
Thread.sleep() is "subject to the precision and accuracy of system timers and schedulers."

But tests using DelayingSearchComponent need to ensure that it sleeps *at least* as long as they request, in order to trigger the timeAllowed constraint
2019-12-17 13:54:33 -07:00
Cassandra Targett 3e8872738a Ref Guide: fix typos & standardize spellings 2019-12-17 12:59:17 -06:00
Cassandra Targett 3d4246089f Ref Guide: make section headings in Headline Case 2019-12-17 12:12:34 -06:00
Cassandra Targett 6785650317 Ref Guide: Upgrade notes for 8.4 2019-12-17 12:02:26 -06:00
Chris Hostetter 33e44b2fd6 SOLR-13696: AwaitsFix RoutedAliasUpdateProcessorTest (and subclasses)
The helper method RoutedAliasUpdateProcessorTest.addDocsAndCommit doesn't garuntee docs have been committed when it returns, causing threading/timing bugs in tests that use it as a gate for making subsequent assertions -- causing a steady stream of jenkins test failures
2019-12-17 11:00:03 -07:00
Dawid Weiss 4b7bb7cf29 SOLR-14103: remove unused dependencies and their checksums, licenses. 2019-12-17 15:52:12 +01:00
Dawid Weiss 0f7a046e85 SOLR-14104: clean up asm license. 2019-12-17 15:11:57 +01:00
Dawid Weiss 868d5b4ae6 SOLR-14104: clean up asm license. 2019-12-17 15:07:44 +01:00
Dawid Weiss 98965b6c98 SOLR-14104: clean up asm license. 2019-12-17 15:07:38 +01:00
Dawid Weiss 0e2a493446 Add transitive Lucene dependencies so that Solr licenses/ folder is (more) consistent with ant. This is an insane hack at the build-level. Mark it for removal once we get rid of ant. 2019-12-17 15:02:08 +01:00
Dawid Weiss 079ddeb1f4 SOLR-14104: Remove a truckload of unused licenses and notice files. 2019-12-17 14:41:12 +01:00
Dawid Weiss 893f802e51 Remove a truckload of unused licenses and notice files. 2019-12-17 14:30:08 +01:00
Dawid Weiss faadb65202 Regenerate checksum for a single dependency once. Add trailing newline for consistency with ant code. 2019-12-17 14:27:25 +01:00
Dawid Weiss 4c94a13e69 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-17 13:38:14 +01:00
Chris Hostetter db11e9e9a2 SOLR-14081: re-implement FullSolrCloudDistribCmdsTest to extend SolrCloudTestCase 2019-12-16 15:58:06 -07:00
Chris Hostetter e6b5da5c12 SOLR-14099: work around @LogLevel bug in LoggingHandlerTest 2019-12-16 12:13:03 -07:00
Robert Muir dc35e5752b LUCENE-9094: Ban ObjectInputStream and ObjectOutputStream in forbidden-apis 2019-12-16 13:31:11 -05:00
Andrzej Bialecki b5a2cfba4f SOLR-14094: Enable this test again in master. 2019-12-16 15:54:04 +01:00
Ishan Chattopadhyaya ee0b066ab6 SOLR-14096: Stopping -Denable.packages=true from leaking to other tests 2019-12-16 20:20:07 +05:30
Andrzej Bialecki 83800c03df Fix an occasional test error caused by the maintenance trigger generating events. 2019-12-16 13:54:36 +01:00
Ishan Chattopadhyaya 7dfea5fe33 SOLR-14087: Changing the filestore dir name back to filestore from .filestore 2019-12-16 18:18:53 +05:30
Adrien Grand b660bcd0a2 SOLR-14094: Bad-apple TestSolrCachePerf. 2019-12-16 13:46:33 +01:00
Dawid Weiss 67d3cf678d Merge with master. 2019-12-16 11:27:02 +01:00
Dawid Weiss bc539fc0fd Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-16 11:20:45 +01:00
David Smiley 2db48314f9
SOLR-14072: Deprecate Blob API and runtimeLib (#1086) 2019-12-15 23:53:17 -05:00
noble 479db61df8 SOLR-14087: changed the filestore location to .filestore instead of $filestore 2019-12-16 15:51:36 +11:00
Noble Paul d64c5c20b6
SOLR-14087: disable package store API if -Denable.packages not set to true 2019-12-16 08:04:33 +11:00
Kevin Risden 2f051a4bfe
SOLR-14086: Tika ClassNotFound error due to commons-compress in solr-core dependency
Introduced in SOLR-14033 by including
commons-compress as a compile time
dependency in Solr core instead of as
as test only dependency.

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-15 13:39:52 -05:00
Ishan Chattopadhyaya be0b963a22 SOLR-14071: Updating upgrade notice 2019-12-15 11:21:10 +05:30
Ishan Chattopadhyaya 640ff96522 SOLR-13662: Fixes to package manager
* Better logging and error reporting
* Fixing deploy command to handle previously undeployed packages
* Test now uses @LogLevel annotation
* Deploy command had a hard coded collection name by mistake, fix it
2019-12-15 10:44:02 +05:30
David Smiley 7c048c5070
SOLR-14069: Ref guide: overhaul: resources, libs, plugins, config-sets (#1077)
* split "resource-and-plugin-loading.adoc" into "resource-loading.adoc" and "libs.adoc" then overhauled both.
* enhanced "config-sets.adoc", moving some content in from elsewhere; bit of an overhaul.
* solr-plugins.adoc is now top-level; overhauled content
* Move resource-loading.adoc up a level in the TOC to underneath "The Well-Configured Solr Instance.
* Separate out the leading sentence.
2019-12-14 11:50:00 -05:00
yonik 49c34028ab SOLR-13884: Ignore ConcurrentCreateCollectionTest 2019-12-14 09:31:13 -05:00
Kevin Risden 7a9a6ef79e
SOLR-14077: Hadoop shouldn't need to look for metrics config in user home
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-13 22:08:48 -05:00
yonik 5f8e65c58f SOLR-14079: fix SPLITSHARD splitByPrefix in async mode 2019-12-13 17:55:05 -05:00
yonik db65c82c39 SOLR-13884: detect multiple replicas on single node 2019-12-13 17:37:44 -05:00
yonik 73c535261c SOLR-13884: use policies, preferences 2019-12-13 17:37:44 -05:00
yonik fae6aebc74 SOLR-13884: add ConcurrentCreateCollectionTest test 2019-12-13 17:37:44 -05:00
erick 2feeb88c29 SOLR-14026: Upgrade Jetty to 9.4.24.v20191120 and dropwizard to 4.1.2, moved to 8.5 in CHANGES.txt 2019-12-13 12:42:09 -05:00
Dawid Weiss 208d094262 Remove checksum files from ref guide. 2019-12-13 17:09:25 +01:00
erick 8278886966 SOLR-14026: Upgrade Jetty to 9.4.24.v20191120 and dropwizard to 4.1.2 2019-12-13 10:01:37 -05:00
Dawid Weiss abd5102312 Merge with master. 2019-12-13 15:35:14 +01:00
Dawid Weiss 16466d5256 Add dependency on log4j-1.2 api for solr core tests. 2019-12-13 15:32:59 +01:00
Dawid Weiss d130bffa8f LUCENE-9092: Upgrade randomizedtesting to 2.7.5 and Carrot2 to 3.16.2 2019-12-13 15:13:26 +01:00
Dawid Weiss 3aff1664e5 updateChecksums, validation of dangling unreferenced files under licenses/. Separated licenses-gradle for Solr for now (doesn't include transitive Lucene dependencies). 2019-12-13 15:07:59 +01:00
Dawid Weiss d7c2e3029b Ignore gradle files for rat checks. 2019-12-13 13:44:18 +01:00
Dawid Weiss 4500f0e327 Consolidating versions between gradle and ant. 2019-12-13 13:31:23 +01:00
Dawid Weiss 528a2ecb56 LUCENE-9092: Upgrade randomizedtesting to 2.7.5 and Carrot2 to 3.16.2 (follow-up) 2019-12-13 12:12:11 +01:00
Dawid Weiss 517261dcff LUCENE-9092: Upgrade randomizedtesting to 2.7.5 and Carrot2 to 3.16.2 2019-12-13 12:11:38 +01:00
Dawid Weiss 035cede6b8 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-13 10:51:14 +01:00
Robert Muir f083f40b28 SOLR-14076: clean up static fields leak in nightly-only test 2019-12-13 04:06:07 -05:00
Kevin Risden 3ba005465a
SOLR-14048: Improve Hadoop test sanity checks
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 21:27:38 -05:00
Andrzej Bialecki e155649026 SOLR-13975: Make sure the stall time is adjusted up when an unusually long
poll time is configured.
2019-12-12 19:58:03 +01:00
Dawid Weiss c40689875a Correct regexes normalizing jar filenames so that the resulting licenses are consistent with gradle (which will use proper artifact name, not a chain of regexes). 2019-12-12 19:26:46 +01:00
Dawid Weiss b29b731a2c Correct regexes normalizing jar filenames so that the resulting licenses are consistent with gradle (which will use proper artifact name, not a chain of regexes). 2019-12-12 19:25:22 +01:00
Dawid Weiss 4cee6c68c7 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-12 17:27:28 +01:00
Kevin Risden 322ed8ce4d
SOLR-14047: Make sure tests don't pickup other Hadoop installs
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-12 10:23:29 -05:00
Dawid Weiss 6094d4dd13 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-12 14:16:48 +01:00
noble 4d5df0e20a SOLR-14013: FIX: javabin performance regressions 2019-12-12 23:38:35 +11:00
noble b35f1debe3 SOLR-14013: javabin performance regressions 2019-12-12 23:26:37 +11:00
Ishan Chattopadhyaya 57e717eff2 SOLR-14065: Deprecate Velocity 2019-12-12 16:13:32 +05:30
Ishan Chattopadhyaya 7097e9c41a SOLR-13978: Removed LTR from default configset 2019-12-12 15:09:21 +05:30
Ishan Chattopadhyaya fa1ad006b6 SOLR-14071: Untrusted configsets shouldn't be allowed to use <lib> directive 2019-12-12 15:00:09 +05:30
Adrien Grand b72365ae21 Add next minor version 8.5 2019-12-12 09:37:51 +01:00
Ishan Chattopadhyaya dce36c10e9 SOLR-13978: Remove non-essential components from default configset
The default configset no longer has the following:
   - Library inclusions (<lib ../>) for extraction, solr-cell libs, clustering, velocity and language identifier
   - /browse, /tvrh and /update/extract handlers
   - TermVector component (if someone wants it, can be added using config APIs)
   - XSLT response writer
   - Velocity response writer
If you want to use them in your collections, please add them to your configset manually or through the Config APIs.
2019-12-12 10:43:31 +05:30
Munendra S N 88b5b5a7cd SOLR-13970: disallow using collapse/expand with grouping
* Using collapse with grouping would cause inconsistent behavior.
  This is because grouping calls the same postfilter twice without
  resetting the internal state of the DocValues cache
* Using expand with grouping would cause NPE
2019-12-12 10:21:20 +05:30
Ishan Chattopadhyaya f681d433ae SOLR-14062: Split IndexSizeTriggerTest into three 2019-12-12 10:12:17 +05:30
Ishan Chattopadhyaya 8db8ab3be2 SOLR-13945: SPLITSHARD can cause data loss due to rollback when final commit fails 2019-12-12 08:58:34 +05:30
Kevin Risden 861c77cb17
SOLR-14053: Fix HDFS tests to be ignored if Native I/O isn't available (remove tests.disableHdfs)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-11 22:02:07 -05:00
Joel Bernstein d559f47222 SOLR-14060: Update CHANGES.txt 2019-12-11 20:59:23 -05:00
Joel Bernstein ee0a6b45ca SOLR-14060: Allow the random Streaming Expression to create the x-axis 2019-12-11 20:37:20 -05:00
Mikhail Khludnev f01b3e97d1 SOLR-13904: Make Analytics component sensitive to timeAllowed. 2019-12-11 23:48:17 +03:00
Robert Muir dc031ea382 SOLR-14050: clean up tests use of network addresses
Solr tests now have a similar policy to Lucene, loopback use only. If a
test tries to resolve or connect to the internet, it will get SecurityException.

Some solr tests explicitly try to talk to dead nodes with real
networking. This is not good and asking for trouble, but use low loopback port numbers instead of
multicast addresses. The idea is that it fails faster. Move these to
constants so that stuff isn't copy-pasted everywhere, in case we have to
do something different later.
2019-12-11 12:51:45 -05:00
Erik Hatcher 128360856d SOLR-14025: VelocityResponseWriter hardening 2019-12-11 12:36:14 -05:00
Joel Bernstein 13b865ac4c SOLR-13957: Update CHANGES.txt 2019-12-11 12:02:47 -05:00
Joel Bernstein 71893936d1 SOLR-14043: Update CHANGES.txt 2019-12-11 11:56:46 -05:00
Dawid Weiss 5cbbdae793 SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL). 2019-12-11 16:40:31 +01:00
Dawid Weiss 77a5dd6926 SOLR-14055: LegacyCloudClusterPropTest fails on Windows (requires SuppressSSL). 2019-12-11 16:39:54 +01:00
Dawid Weiss 16019344cb Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-11 15:03:46 +01:00
Dawid Weiss 9e236a4835
SOLR-14053: Don't start hdfs when native libraries can't be loaded. Remove tests.disableHdfs. (#1072) 2019-12-11 15:01:24 +01:00
Jason Gerlowski 4f2fedbe6b SOLR-13999: Add missing CHANGES.txt entry 2019-12-11 07:43:23 -05:00
Jason Gerlowski d8aa04575f
SOLR-13972: Warn about insecure settings on startup (#1058) 2019-12-11 07:16:09 -05:00
Dawid Weiss 87104a155a Correct commons-compress dependency. 2019-12-11 09:44:16 +01:00
Dawid Weiss 9fad7b67b0 Follow-up to changes on master. 2019-12-11 09:01:37 +01:00
Dawid Weiss 27d5509644 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-11 08:57:18 +01:00
Erick Erickson d189520935 SOLR-13953: Prometheus exporter in SolrCloud mode limited to 100 nodes 2019-12-10 20:19:30 -05:00
Ishan Chattopadhyaya 34f11c9f57 SOLR-13822: Fix Eclipse project 2019-12-11 05:55:30 +05:30
Thomas Wöckinger 9e84da95a2 SOLR-13966: forgot to test empty list 2019-12-10 16:29:19 -05:00
Kevin Risden 48775ea18e
SOLR-14033: Fix Hadoop tests with security manager
This removes the Solr security manager hacks
for Hadoop. It does so by:
* Using a fake group mapping class instead of ShellGroupMapping
* Copies a few Hadoop classes and modifies them for tests with no Shell
* Nulls out some of the static variables in the tests

The Hadoop files were copied from Apache Hadoop 3.2.0
and copied to the test package to be only picked up
during tests. They were modified to remove the need to
shell out for access. The assumption is that these
HDFS integration tests only run on Unix based systems
and therefore Windows compatibility was removed in some
of the modified classes. The long term goal is to remove
these custom Hadoop classes. All the copied classes are
in the org.apache.hadoop package.

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-10 16:15:24 -05:00
Vergil Cheynov 20d3284a09 "Added missing parameter under 'topic parameters'" (#1056) 2019-12-10 16:05:46 -05:00
Andrzej Bialecki c4f0c33638 SOLR-13975, SOLR-13896: ConcurrentUpdateSolrClient connection stall prevention. 2019-12-10 21:45:43 +01:00
Andrzej Bialecki 6d03baa485 SOLR-13806: SolrJ QueryResponse._explainMap is incorrectly typed. 2019-12-10 20:44:17 +01:00
Joel Bernstein 8c6a2640ed SOLR-14043: Allow the precision Stream Evaluator to operate on matrices 2019-12-10 12:57:05 -05:00
Dawid Weiss 20eaaa012d Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-10 14:52:30 +01:00
Andrzej Bialecki fed199df7b SOLR-13563: SPLITSHARD using LINK method fails on disk usage checks. 2019-12-10 14:21:37 +01:00
Christine Poerschke b97afd79ca Fix 5 javac warnings: 'yield' may become a restricted identifier in a future release. 2019-12-10 12:32:34 +00:00
Alessandro Benedetti e84a23529e SOLR-14029: Solr Ref Guide: clarify requestDispatcher handleSelect=true 2019-12-09 23:28:45 -05:00
Thomas Wöckinger e250f3e82c SOLR-13966: LatLonPointSpatialField fix for RealTimeGetComponent
used in atomic/partial updates.
Closes #1035
2019-12-09 22:51:18 -05:00
Kevin Risden 12825f3642
SOLR-14039: SOLR-13987 broke multiple node /select handler due to jetty.xml whitespace
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-09 19:29:37 -05:00
Chris Hostetter 485e140e93 SOLR-14032: some misc ref-guide improvements related to clarifying the pros/cons of the diff ways to 'boost' documents by func/query 2019-12-09 15:34:42 -07:00
Houston Putman 1c78d2c637
SOLR-12217: Support shards.preference in SolrJ for individual shard requests (#984) 2019-12-09 17:11:58 -05:00
Dawid Weiss 511bcaa4c1 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 22:37:08 +01:00
Joel Bernstein 1eaa5b5ac2 SOLR-13957: Add sensible defaults for the facet, random, facet2D, timeseries, stats and update Streaming Expressions 2019-12-09 16:04:03 -05:00
Dawid Weiss f853d994ec Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 16:48:21 +01:00
Christine Poerschke df933f8104 SOLR-14030: fix 2 javac warnings: [dep-ann] deprecated item is not annotated with @Deprecated 2019-12-09 14:13:52 +00:00
Andrzej Bialecki 86cab79730 SOLR-13979: Expose separate metrics for distributed and non-distributed requests. 2019-12-09 13:46:33 +01:00
Dawid Weiss a6d7017f2e Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-09 10:55:54 +01:00
Jan Høydahl 0d78535dcf SOLR-13977: Move changes entry to 8.4 2019-12-09 10:27:53 +01:00
Munendra S N df508ffe01 SOLR-11706: fix for multivalued trie date in min/max and more tests
* selecting single value for multivalued trie date field is not
  supported.
* add additional tests for variance, unique, hll aggregations
2019-12-08 10:49:37 +05:30
Michael Gibney 8e9876f516 SOLR-7798: robust support for expand when used w/o collapsing (#325)
There are applications of ExpandComponent that intentionally do not
involve prior collapsing of results on the expand field, which can lead
to an NPE in expand component when expand.field (for matched docs) has
fewer unique values than the number of matched docs.

This commit refines the approach taken in SOLR-13877, which addressed
the same underlying issue.
2019-12-08 09:59:33 +05:30
ngomx 07e4d86207
SOLR-13818: Upgrade jackson to 2.10.0
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 19:09:18 -05:00
Kevin Risden f9e15839bf
SOLR-13987: Admin UI should not rely on javascript eval()
* Removes `'unsafe-eval'` from CSP `script-src`
* Enables Angular CSP mode
* Removes `eval()` JSON parsing in `cloud.js`
* Removes `jstree` themes error

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:40:04 -05:00
Kevin Risden 7c8635d600
SOLR-14028: Fix test permissions for TestSolrCLIRunExample
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-07 16:32:11 -05:00
Dawid Weiss c3bb81f032 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-07 10:53:34 +01:00
Dawid Weiss 2a6ffd23fa Reverting aalto change. 2019-12-07 10:53:30 +01:00
Dawid Weiss 78575f0a2c Revert "Adding woodstox temporarily so that tests pass."
This reverts commit de8a37ee72.
2019-12-07 10:51:00 +01:00
Munendra S N a1e51cd777 SOLR-11706: minor refactors
* rename stdDev, variance methods to reflect the functionality
* add util functions to compute corrected stdDev and variance
* use DocValuesIterator#advanceExact to check if values exists for the doc
2019-12-07 11:16:25 +05:30
Erick Erickson 7d5d44a3c4 SOLR-13988: Harden CreateCollectionCleanupTest. Incorporate Dawid Weiss' suggestion for windows 2019-12-06 19:10:27 -05:00
Mike 155ab116a2
Revert "SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050)" (#1063)
This reverts commit 2387bb9d60.
2019-12-06 17:08:40 -06:00
Jason Gerlowski 62e0222aef SOLR-13087: Remove 'whoami' usage in bin/solr
whoami displays a warning if the effective-uid is not in /etc/password.
This can happen in certain situations when running in a docker
container.  This replaces the 'whoami' usage with a safer check.
2019-12-06 15:31:37 -05:00
Dawid Weiss 0d18581225 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-06 19:02:26 +01:00
Dawid Weiss a7444f7af4 LUCENE-9077: Add support for running under gradle test runner. 2019-12-06 19:00:50 +01:00
Erick Erickson 106b9d6866 SOLR-13988: Harden CreateCollectionCleanupTest 2019-12-06 11:59:53 -05:00
Dawid Weiss de8a37ee72 Adding woodstox temporarily so that tests pass. 2019-12-06 13:37:48 +01:00
Dawid Weiss 226f5490a0 Correct lucene version passed to tests to be stripped of qualifiers. 2019-12-06 13:05:10 +01:00
Dawid Weiss 8e81037180 Merging with master, updating deps. 2019-12-06 12:16:07 +01:00
Dawid Weiss f371df327f Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-06 11:57:29 +01:00
Jan Høydahl 7417fa1cf3
SOLR-13954: Embedded ZooKeeper in Solr now does not try to load JettyAdminServer (#1059) 2019-12-06 11:03:23 +01:00
Robert Muir 33ca971d2b SOLR-14020: move hadoop hacks out of lucene TestSecurityManager into a solr one 2019-12-05 14:53:23 -05:00
Andrzej Bialecki d2b01ef28f SOLR-13831: Context property _loop_iter_ should be a string in order to support
variable expansion.
2019-12-05 18:27:12 +01:00
Anshum Gupta 2387bb9d60
SOLR-13990: Switch out woodstox-core-asl with aalto-xml and upgrade woodstox stax-2 API (#1050) 2019-12-05 18:37:53 +05:30
Dawid Weiss 1a24ccb4ee Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-05 11:17:34 +01:00
Robert Muir e77027dd8c SOLR-13993: sandbox velocity template render (if security manager is enabled)
The solr permissions are weak sauce due to the huge number of features, third-party dependencies, etc.

Hence they have access to do many things. For "scripting" such as velocity we have to look at a more aggressive stance:

Step 1: Can we wrap a sandbox around the whole goddamn thing and call it a day?
Step 2: Let's separate the "engine" from "untrusted code" and only be an asshole to the latter.
Step 3: Java's security is shit, Lets contain that classloader and whitelist access.
2019-12-05 01:06:38 -05:00
Munendra S N 12e8cca644 SOLR-11706: add support for aggregation on multivalued fields
* min, max, sum, sumsq, avg, stddev, variance, percentile aggregations
  in JSON facets now supports multivalued fields
2019-12-05 10:48:22 +05:30
Robert Muir c4126ef858 SOLR-14015: remove blanket filesystem read access from solr-tests.policy
Restrict this to only minimal paths like lucene. It is the defense for directory traversal attacks.
It will also help find bad bugs where things are reading filesystem in the wrong locations.
2019-12-04 23:16:19 -05:00
Andrzej Bialecki f71c2c8e92 SOLR-13981: Remove unused DistributedQueue interface. (Andras Salamon) 2019-12-04 11:23:49 +01:00
Robert Muir becc16fb28 SOLR-14002: fix another static leak in test 2019-12-03 22:43:11 -05:00
Robert Muir 165529767b SOLR-14000: clean up more static field leaks in tests
On windows, these objects can't be inspected due to security restrictions. So the test runner fails the tests since it does not know how big the leak is.
2019-12-03 18:51:00 -05:00
Jeff 16f793915e SOLR-13926: javadocs on CompositeIdRouter
Closes #1009
2019-12-03 17:43:01 -05:00
Anshum Gupta 09df6647ac
SOLR-13998: Add thread safety annotations to classes (#1053) 2019-12-04 01:19:56 +05:30
Dawid Weiss 7c26c6de02 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-03 18:45:12 +01:00
Dawid Weiss 49bab132b1 Applying two forbidden api check violations (applied to master). 2019-12-03 14:26:02 +01:00
Dawid Weiss 0f61aa9516 Forbidden APIs: add missing root locale. 2019-12-03 13:07:23 +01:00
Dawid Weiss 6f0842eaa5 Use toLowerCase with an explicit locale in CheckLinksAndAnchors. 2019-12-03 13:01:43 +01:00
Robert Muir 9e5d11be8a fix static leaks, null stuff out in afterclass 2019-12-03 06:28:19 -05:00
Robert Muir c8c9c10023 SOLR-13982: set security-related http response headers by default
Unfortunately, as a first start this is very weak protection against
e.g. XSS.  This is because some 'unsafe-xxx' rules must be present due
to the insecurity of angular JS: Until SOLR-13987 is fixed, XSS & co are
still easy.
2019-12-03 06:12:33 -05:00
noble a51c7b89f2 SOLR-13995: Move ZkShardTerms.Terms to SolrJ 2019-12-03 15:16:34 +11:00
Noble Paul d8f9f47ca0
SOLR-13992: Refactor code to have collection, shard name in Replica,Slice (#1051)
* SOLR-13992: Refactor code to have collection name shard name in Replica,Slice
2019-12-03 13:10:19 +11:00
Cassandra Targett de1c9fb9e8 SOLR-13885: various Ref Guide typos. This closes #990 2019-12-02 13:33:45 -06:00
Dawid Weiss d4a9842375 Initial gradle build layer. 2019-12-02 15:34:57 +01:00
Shalin Shekhar Mangar 5a697344ed SOLR-13805: NPE when calling /solr/admin/info/health on standalone solr 2019-11-30 10:04:00 +05:30
Jan Høydahl 936f4b6ee9 SOLR-13977: solr create -c not working under Windows 10 2019-11-29 01:22:06 +01:00
Jan Høydahl 48010ffc9f Add 8.3.1 CHANGES entry for SOLR-13465, SOLR-13941 and SOLR-13905 2019-11-28 20:56:57 +01:00
David Smiley 6a72b81ed3 SOLR-13971: Revert changes to the default configset.
* clarified these are Java system properties
* trivial dead code change; Boolean.getBoolean returns a primitive
2019-11-28 10:45:58 -05:00
Bruno Roustant b4cc3c6ad2
SOLR-13968: Support postingsFormat and docValuesFormat in schema fields.
Closes #1039
2019-11-28 16:13:10 +01:00
Ishan Chattopadhyaya 212593d362 SOLR-13971: Renamed the velocity template parameter names 2019-11-28 15:46:26 +05:30
Jan Høydahl 9f78482295
SOLR-13969: Clean up and document AuditEvent API (#1041) 2019-11-28 09:55:11 +01:00
Ishan Chattopadhyaya 50e8cea918 SOLR-13971: Removing velocity from _default and disabling custom template support by default 2019-11-28 07:52:43 +05:30
Andrzej Bialecki 47a908a0b9 Fix the list of common handler metrics. 2019-11-27 15:59:53 +01:00
Jonathan Pool a5ab17db82 Correct inconsistency on plugin support (#272) 2019-11-27 08:55:52 +01:00
Eduardo Leggiero 70c5942f3d Removed extra whitespace (#292) 2019-11-27 08:50:12 +01:00
noble 6c7a095f33 SOLR-13963: JavaBinCodec has concurrent modification of CharArr resulting in corrupt internode updates 2019-11-26 08:12:23 +11:00
Dawid Weiss 063c82ebd6 SOLR-13952: reverting Erick's commit (with permission). 2019-11-25 17:56:20 +01:00
Thomas Wöckinger b5fd6d7b22 SOLR-13961: Allow null/empty for removal of child doc in atomic update
Closes #1030
2019-11-25 09:57:07 -05:00
Erick Erickson f1cf3db588 SOLR-13952: Separate out Gradle-specific code from other (mostly test) changes and commit separately, forgot CHANGES.txt 2019-11-24 13:31:45 -05:00
Erick Erickson 4b34d726ab SOLR-13952: Separate out Gradle-specific code from other (mostly test) changes and commit separately 2019-11-24 13:24:40 -05:00
Jan Høydahl 592ea19eff SOLR-12193: reverting one line back to trace 2019-11-24 00:06:07 +01:00
Jan Høydahl d809bc27f1 SOLR-12193: Move some log messages to TRACE level, remove some dead code 2019-11-23 23:57:59 +01:00
Jan Høydahl 312431b182
SOLR-13465 CoreContainer.auditloggerPlugin should be volatile (#672) 2019-11-23 01:21:47 +01:00
Jan Høydahl e45c5ce9b9
SOLR-13905 Make findRequestType in AuditEvent more robust (#1014) 2019-11-22 23:34:20 +01:00
Eric Pugh 537862d5bb Document how to load your own streaming plugins (#1025) 2019-11-22 11:16:57 -08:00
Tomas Fernandez Lobbe 37512dad48 SOLR-13950: Add attribution 2019-11-22 11:06:45 -08:00
Andy Vuong 4910c0f558 SOLR-13950: Fix getLeaderRetry swallowing interrupt in ZkStateReader (#1023)
Let InterruptedException bubble up
2019-11-22 11:04:45 -08:00
Munendra S N 2740d90dee SOLR-13912: add support for countvals aggregation in JSON facet module
* This aggregation is equivalent to StatsComponent's count
2019-11-22 18:16:20 +05:30
Chris Hostetter 8f30f6436c SOLR-13946: Fix SpellCheckCollatorTest.testEstimatedHitCounts lower/upper bounds to match computable values based on random merge policies 2019-11-21 11:46:35 -07:00
noble f98555854c SOLR-13822: Bug fixs and tests for URP loading 2019-11-21 11:25:16 +11:00
Tomas Fernandez Lobbe 400514026e SOLR-13907: Cloud view tree - fixed placement 2019-11-20 10:56:18 -08:00
Jan Høydahl f00bcd5609
SOLR-13941: Configure JettySolrRunner same as in web.xml (#1018) 2019-11-20 10:20:54 +01:00
Cassandra Targett d1ffb38286 SOLR-13782: add CHANGES entry 2019-11-19 15:57:08 -06:00
Cassandra Targett b5bf906caf
SOLR-13782: Remove PDF Ref Guide build (#999)
closes #999
2019-11-19 14:54:30 -07:00
noble a593d3050c Revert "SOLR-13942: /api/cluster/zk/* to fetch raw ZK data"
This reverts commit 935a2987f8.

this was accidentally pushed to master.
2019-11-20 06:08:06 +11:00
noble 935a2987f8 SOLR-13942: /api/cluster/zk/* to fetch raw ZK data 2019-11-19 18:05:18 +11:00
Chris Hostetter 59465c20c4 SOLR-13943: AwaitsFix TimeRoutedAliasUpdateProcessorTest.testDateMathInStart 2019-11-18 16:32:21 -07:00
Mikhail Khludnev 51b1c5a023 LUCENE-9036: ExitableDirectoryReader checks timeout on DocValues access. 2019-11-18 23:34:43 +03:00
Chris Hostetter 1411aaee94 HdfsRecoveryZkTest & HdfsNNFailoverTest: Remove @BadApple anotation
These tests were originally anotated @BadApple in early 2018 as pat of SOLR-12028.

Neither test has failed since 2018-12-28.

Since we no longer have logs from those older jenkins builds, it's hard to be certain how/why this
test was failing, or why exactly it stopped failing – but it's possible the underlying issues were
addressed by general hardening of SolrCloud and the associated base test classes around the same time.
2019-11-18 12:22:12 -07:00
Adrien Grand 7755cdf03f
LUCENE-9027: Use SIMD instructions to decode postings. (#973) 2019-11-18 19:08:32 +01:00
Chris Hostetter f9076d85cf SOLR-13924: AwaitsFix: MoveReplicaHDFSTest 2019-11-18 09:58:00 -07:00
Ishan Chattopadhyaya 0857bb60d3 SOLR-13662, SOLR-13822: Fixing bug with refresh API, un-ignoring the test and new reference guide on Package Management 2019-11-18 04:00:00 +05:30
Ishan Chattopadhyaya 5200ee0ef9 SOLR-13662: Ignoring the PackageManagerCLITest until further investigation of failures 2019-11-17 06:06:02 +05:30
Munendra S N 0602956a44 SOLR-13911: add support for missing aggregation in JSON facet module
* This missing aggregation is equivalent to StatsComponent's missing
2019-11-16 12:12:11 +05:30
Chris Hostetter 3fb39b2960 TestDistributedStatsComponentCardinality: Remove @BadApple anotation
This test was originally anotated @BadApple ~2018-10-14 as pat of SOLR-12028.

So far in 2019, it has failed in 62 jenkins-BadApple builds, but all prior to 2019-06-14.

Since we no longer have logs from those older jenkins builds, it's hard to be certain how/why
this test was failing, or why exactly it *stopped* failing -- but a likely suspect is that
the root cause of the problem may have been fixed as part of the Jetty upgrade in SOLR-13541.
2019-11-15 22:25:39 -07:00
Andrzej Bialecki 66e78ba7c5 SOLR-13898: Allow inexact double comparison. Close resources. 2019-11-15 20:38:20 +01:00
Chris Hostetter 805305c410 SOLR-13909: ReplicationHandler testing: Replace the completely broken CheckBackupStatus with a new BackupStatusChecker helper class 2019-11-15 10:17:26 -07:00
Tomas Fernandez Lobbe 4931c0989d SOLR-13860: Ignore testKillTlogReplica 2019-11-14 15:16:35 -08:00
Ishan Chattopadhyaya e59563f189 SOLR-13662: Renaming the test jars to .tmp to avoid precommit failures. Adding timeout for test failure fix. 2019-11-15 00:55:44 +02:00
Andrzej Bialecki b4fe911cc8 SOLR-13817: Remove legacy SolrCache implementations. 2019-11-14 21:21:44 +01:00
Ishan Chattopadhyaya d9f41f8a5a SOLR-13662: Package manager (CLI) 2019-11-14 18:21:35 +05:30
Andrzej Bialecki 32c3255b93 SOLR-13898: fix a typo. 2019-11-13 18:10:49 +01:00
Istvan Farkas 21a54c4bc7
SOLR-13921: Processing UpdateRequest with delegation token throws NullPointerException
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-11-13 11:11:45 -05:00
Chris Hostetter 30e55e2b6e SOLR-13872: Fixed Backup failures due to race conditions in saving/reserving commit points 2019-11-13 08:58:52 -07:00
Andrzej Bialecki 0c3233877b SOLR-13898: Non-atomic use of SolrCache get / put. 2019-11-13 14:43:09 +01:00
noble 59cc299c7e SOLR-13821: Return the size of the file 2019-11-13 18:58:34 +11:00
noble 550c7296b6 SOLR-13822: Added a testcase and a bug fix 2019-11-13 17:42:37 +11:00
noble 11fd8d630a SOLR-13841: Added 'JsonProperty' to forbidden APIs 2019-11-13 15:51:49 +11:00
Chris Hostetter 5df9a51cbf Fix SOLR-13869 typo in CHANGES.txt 2019-11-12 14:04:35 -07:00
Chris Hostetter 3a5d67b87b SOLR-13869: remove deprecated SolrTestCaseJ4.getNextAvailablePort() from master 2019-11-12 14:03:39 -07:00
Chris Hostetter 603be023fe SOLR-13864: SolrTestCaseJ4.getNextAvailablePort() has been deprecated 2019-11-12 13:41:46 -07:00
Chris Hostetter 367fe2f341 SOLR-13870: SolrJmxReporterTest no longer depends on (buggy) getNextAvailablePort() 2019-11-12 09:42:05 -07:00
noble 8847711212 SOLR-13822: more ref guide 2019-11-12 18:02:40 +11:00
Noble Paul 40661489cd
SOLR-13822: Ref guide and error handling
SOLR-13822: Ref guide and error handling for package loader, package store
2019-11-12 16:45:04 +11:00
noble 7a207a9353 SOLR-13822: Missing package-info files 2019-11-08 14:46:53 +11:00
Houston Putman 5c7215fabf SOLR-13844: Fixing tests related to ShardTerms recovery removal (#995) 2019-11-06 17:24:55 +00:00
noble c37d011974 missing JIRA number 2019-11-06 20:27:10 +11:00
Joel Bernstein 4f849e7a49 SOLR-13864: MathExpressionTest non-reproducible failures due to assertions of non-absolutes and randomization beyond test seed 2019-11-05 15:15:19 -05:00
Andrzej Bialecki 4f16d87c7e SOLR-13858: Combine two almost identical entries into one. 2019-11-05 19:02:35 +01:00
Joel Bernstein 746a3a9c88 SOLR-10786: Update CHANGES.txt 2019-11-05 09:16:27 -05:00
Andrzej Bialecki 720fb94113 SOLR-13882: Collections API COLSTATUS does not check live_nodes when reporting replica's status. 2019-11-05 14:06:05 +01:00
Andrzej Bialecki e58a90f18d SOLR-13858: Clean up SolrInfoBean / SolrMetricProducer API. 2019-11-04 15:31:43 +01:00
Jason Gerlowski de28c67627 SOLR-13762: Allow BinaryField use with non-binary wt's.
Closes #883
2019-11-04 08:43:04 -05:00
Noble Paul b5f5b0f2bc
SOLR-13841: removed jackson dependencies from SolrJ and provided a mapping to our annotation (#992)
Provide mappings for jackson annotation @JsonProperty to use Jackson deserializer
2019-11-04 16:38:21 +11:00
Joel Bernstein c908ea2e5a SOLR-10786: Add DBSCAN clustering Streaming Evaluator 2019-11-02 14:27:42 -04:00
Tomas Fernandez Lobbe 5c6a299eff SOLR-13207: Fix tests 2019-11-01 15:53:38 -07:00
Chris Hennick b17d630e50 SOLR-13207: Handle query errors in calculateMinShouldMatch (#978)
Traps error that arises when the < operator is used at the end of a query field.
Also handles NumberFormatException when the operand isn't a number.
2019-11-01 10:40:56 -07:00
David Smiley 124d38a597 SOLR-13830: Correct ref guide on [child] response structure. 2019-11-01 11:15:25 -04:00
Houston Putman 6e1ecd1218 SOLR-13844: Remove replica recovery terms with the replica term (#951) 2019-11-01 14:34:53 +00:00
noble 53b002f59d SOLR-13822: FIle leakes fixed 2019-11-01 16:33:20 +11:00
noble 22b681755c SOLR-13822: Disbaled on windows till further investigation 2019-10-30 08:27:23 +11:00
Munendra S N 24134cf9b1 SOLR-13823: fix ClassCastEx in group.query when score is requested
* This makes sures score computed for standalone and distributed
  is same for group.query. This is done by using mainQuery to compute
  scores
2019-10-29 13:56:03 +05:30
Munendra S N 0a4f6c566e SOLR-13877: fix NPE in expand component
* This could happen when expand component is not used with collapse
  and matched docs have fewer unique values
2019-10-29 13:56:03 +05:30
Munendra S N b82b7725e1 SOLR-13783: fix failing tests due to NamedList.toString() change 2019-10-29 13:35:31 +05:30
Munendra S N bd0091d94e update documentation for q.op and df
* defaultSearchField and defaultOperator are removed from schema.
  update the documentation to reflect this change
2019-10-29 10:51:31 +05:30
Tomas Fernandez Lobbe c7c0bdf2df SOLR-13783: Move CHANGES entry 2019-10-28 17:10:24 -07:00
Chris Hennick 74333c3af2 SOLR-13783: Add space after comma in NamedList.toString() (#979) 2019-10-28 17:09:08 -07:00
Tomas Fernandez Lobbe ee82e4567f SOLR-13865: Add missing package docs 2019-10-28 16:25:26 -07:00
Houston Putman fa27e476f7 SOLR-13865: Migrate replica routing code to SolrJ (#974)
* [SOLR-13865] Migrate replica routing code to  solrJ

* Added a CommonTestInjection class.

* Fixing imports.

* Reverted extraneous streaming changes.

* Fix precommit errors.

* Changing name of the RLTManager.

* Splitting up existing tests.

* Updated documentation.

* Added solr/CHANGES.txt entry
2019-10-28 15:49:21 -07:00
noble 3af4e6adc6 SOLR-13822: Adressing Windows test failures 2019-10-29 06:12:52 +11:00
noble e5a5ceb6d8 a simple perf test to check serialization/deserialization perf 2019-10-28 17:17:26 +11:00
Chris Hostetter b17a4cb5a9 SOLR-13822: AwaitsFix this test until the file leaks are addressed 2019-10-25 14:44:25 -07:00
Tobias Ibounig ce3857cb27 Add temporal unit to warmupTime param in ref guide (#975) 2019-10-25 15:01:16 -05:00
Cassandra Targett d91152e113 SOLR-13847: Fix docs for Metrics Trigger 2019-10-25 13:56:53 -05:00
Tomas Fernandez Lobbe 3524494025 SOLR-13866: Remove entry from CHANGES.txt
The fix made it in time to 8.3 so it was never released, no need for a CHANGES entry
2019-10-24 11:50:21 -07:00
Munendra S N 3ef54e4516 SOLR-12393:fix score not returned if expanded docs sorted by non-score 2019-10-24 19:41:14 +05:30
Munendra S N f71e4b210d SOLR-13403: test terms component with point fields on empty index 2019-10-24 10:06:16 +05:30
Tomas Fernandez Lobbe dc9dbd266b
SOLR-13866: Override getSolrMetricsContext in DirectUpdateHandler2 (#971) 2019-10-23 16:13:26 -07:00
Noble Paul 98f08d39aa
SOLR-13822: Isolated Classloading from packages (#957)
SOLR-13822: A Package management system with the following features. A packages.json in ZK to store
  the configuration, APIs to read/edit them and isolated classloaders to load the classes from
  those packages if the 'class' attribute is prefixed with `<package-name>:`
2019-10-24 08:55:11 +11:00
David Smiley 3ae8204248 SOLR-13855: DistributedZkUpdateProcessor needs to propagate URP.finish()
Important since Run URP finish() propagates to updateLog to fsync()!
Closes #969
2019-10-23 17:49:01 -04:00
Andrzej Bialecki c1174dc0d6 SOLR-13831: Support defining arbitrary autoscaling simulation scenarios. 2019-10-23 20:48:10 +02:00
Tomas Fernandez Lobbe 98cdac82a1
SOLR-13860: Enable back TestTlogReplica (#965)
* Wait for leader in testBasicLeaderElection

It can take some time (>4 seconds) to elect a new leader, and if the update is attempted immediately it'll fail. Need to either wait for the leader or retry the udpate in case of failure (which is what clients would do)

* Wait for leader to be active in testKillTlogReplica

* Add hack to prevent unrelated failure

* Reduce the time wait time for replica state change

* A more robust attempt to add replicas in the tests

* Wait for replication for 2 times the replication time
2019-10-23 10:46:36 -07:00
Andrzej Bialecki 1d7cd61575 SOLR-13854: Remove deprecated SolrMetricProducer.initializeMetrics API. 2019-10-22 21:23:48 +02:00
Munendra S N 597241a412 SOLR-13403: disable distrib test for point fields in terms 2019-10-22 10:40:38 +05:30
Mikhail Khludnev afdb80069c SOLR-13824: reject prematurely closed curly bracket in JSON. 2019-10-21 23:25:06 +03:00
epugh 2e6119e8fd tweak documentation to be clearer about uprefix 2019-10-20 23:50:42 -04:00
Munendra S N 80bca5040a SOLR-9802: fix grouping failure for date fields in solrcloud
Closes #221
2019-10-20 15:57:19 +05:30
Noble Paul 831f90fa36
SOLR-13841: Add jackson databind annotations to SolrJ classpath
SOLR-13841: Add jackson databind annotations to SolrJ classpath
2019-10-20 10:00:13 +11:00
Munendra S N cabc125eef SOLR-13403: fix NPE in terms for DatePointField
* This fixes NPE and adds support for DatePointField in terms
  component
2019-10-18 23:45:57 +05:30
Munendra S N 227a624f8a SOLR-12769: correct documentation for delete op in request params API 2019-10-18 21:13:35 +05:30
Munendra S N dce0c5953c SOLR-13827: fail on unknown operation in Request Parameters API 2019-10-18 21:08:33 +05:30
Andrzej Bialecki f07998fc23 SOLR-13677: All Metrics Gauges should be unregistered by components that registered them. 2019-10-18 17:15:04 +02:00
Shalin Shekhar Mangar 86a40c1cd5 SOLR-13843: The MOVEREPLICA API ignores replica type and always adds 'nrt' replicas 2019-10-18 14:48:37 +05:30
Chris Hostetter 63e9bcf5d1 SOLR-13741: Harden AuditLoggerIntegrationTest 2019-10-16 16:56:34 -07:00
Chris Hostetter ebc720c5b0 SOLR-13852: Fix TestCloudNestedDocsSort to ensure child docs are never created in a way that violates uniqueKey rules 2019-10-16 15:49:58 -07:00
Jan Høydahl 611c4f960e
SOLR-13835 HttpSolrCall produces incorrect extra AuditEvent on AuthorizationResponse.PROMPT (#946) 2019-10-17 00:44:34 +02:00
Cassandra Targett 621461fd1a SOLR-12786: Update Ref Guide build tool versions & fix section links for new format requirements 2019-10-16 11:03:17 -05:00
Cassandra Targett b881a09592 Ref Guide: fix headline case 2019-10-16 10:08:57 -05:00
Andrzej Bialecki f7f6a37f33 SOLR-13849: Ignore events created by running triggers. 2019-10-16 10:32:54 +02:00
Chris Hostetter 939b3364e6 SOLR-13846: workaround - elliminate use of problematic PreemptiveBasicAuthClientBuilderFactory in tests that don't need it 2019-10-15 15:37:33 -07:00
Cassandra Targett 8dd2ab52b4 Ref Guide: fix headline case, e.g & i.e, random spaces 2019-10-15 09:45:08 -05:00
Cassandra Targett 96cf2d1762 Ref Guide: first pass at 8.3 upgrade notes 2019-10-15 09:02:31 -05:00
Cassandra Targett 3deff52b5f Ref Guide: Upgrade Notes for 8.2 (neglected to do earlier) 2019-10-15 08:14:12 -05:00
Ishan Chattopadhyaya e2b160b865 SOLR-13834: ZkController#getSolrCloudManager() now uses the same ZkStateReader instance instead of instantiating a new one
ZkController#getSolrCloudManager() created a new instance of ZkStateReader, thereby causing mismatch in the
visibility of the cluster state and, as a result, undesired race conditions.
2019-10-15 14:51:02 +05:30
Ishan Chattopadhyaya b8648c60e7 SOLR-13793: Limiting number of forwards to total replicas in collection to avoid deadly forwarding loops 2019-10-15 14:43:20 +05:30
Jan Høydahl 64fb42c714
SOLR-13665: Added missing netty dependencies to solrJ (#938) 2019-10-15 10:35:05 +02:00
Cassandra Targett 8ad759436b Ref Guide: Fix errant & empty style block throwing errors 2019-10-14 19:54:49 -05:00
Koen De Groote e7e6cfaecf LUCENE-8994: Code Cleanup - Pass values to list constructor instead of empty constructor followed by addAll(). (#919) 2019-10-14 18:45:47 +02:00
Koen De Groote 04786244d0 LUCENE-8979: Code Cleanup: Use entryset for map iteration wherever possible. - part 2 2019-10-14 18:36:19 +02:00
Noble Paul b6ea7d60b7
SOLR-13731: javabin must support a 1:1 mapping of the JSON update format 2019-10-14 11:07:38 +11:00
yonik 1d43bda284 SOLR-13815: enhance live split test to fail more often 2019-10-13 17:07:10 -04:00
noble 88f457ee2a SOLR-13821: refactored the code to change the API to suit package loader 2019-10-12 16:59:14 +11:00
noble 84126ea0ea SOLR-13787: Better error logging 2019-10-12 16:35:08 +11:00
Yonik Seeley a057b0d159
SOLR-13815: fix live split data loss due to cluster state change between checking current shard state and getting list of subShards (#920)
* SOLR-13815: add simple live split test to help debugging possible issue

* SOLR-13815: fix live split data loss due to cluster state change berween checking current shard state and getting list of subShards
2019-10-11 15:07:03 -04:00
noble 5b6561eadb SOLR-13787: Support for Payload<T> as 3rd param 2019-10-12 00:39:05 +11:00
noble 2d32f0b5a6 SOLR-13787: Added support for PayLoad<T> as 3rd param 2019-10-12 00:23:40 +11:00
noble 8bfd8a55c9 SOLR-13827: Added support for PayLoad<T> as 3rd param 2019-10-12 00:11:59 +11:00
Joel Bernstein bed9e7c474 SOLR-13829: Update CHANGES.txt 2019-10-11 09:02:56 -04:00
Joel Bernstein ad1c24e190 SOLR-13829: RecursiveEvaluator casts Continuous numbers to Discrete Numbers, causing mismatch 2019-10-10 21:19:25 -04:00
noble 5e9ed10657 SOLR-13821: Incorrect file path escape in windows 2019-10-11 11:47:39 +11:00
Gus Heck fb3d030e05 SOLR-13760 update CHANGES.txt 2019-10-10 18:35:12 -04:00
Gus Heck be813bd0ae
SOLR-13760 - restore viability of date math in TRA start property (#879)
* SOLR-13760 - restore viability of date math in TRA start property by 
fixing the start date for time routed aliases
upon the receipt of the first document to avoid problems
with date math calculations required by DRA's
2019-10-10 18:17:22 -04:00
Andrzej Bialecki 430267ecc9 SOLR-13828: Improve ExecutePlanAction error handling. 2019-10-10 23:59:06 +02:00
Jason Gerlowski 083f2b5407 SOLR-13820: Small corrections to Rule-Based Auth docs 2019-10-10 17:04:27 -04:00
Cao Manh Dat 1cda424503 SOLR-13293: ConcurrentUpdateHttp2SolrClient always log AsynchronousCloseException exception error on indexing 2019-10-09 20:56:50 +01:00
noble c0b00716bd SOLR-13821: missing package-info.java 2019-10-09 23:17:30 +11:00
Ishan Chattopadhyaya 2e1a470c90 Adding 8.4.0 version 2019-10-08 20:03:38 +05:30
Joel Bernstein 44dc51608a SOLR-13298: Update CHANGES.txt 2019-10-08 09:59:40 -04:00
Andrzej Bialecki 8c144444fe SOLR-13376: Multi-node race condition to create/remove nodeLost markers. 2019-10-08 13:41:02 +02:00
Noble Paul e3bd5a7da2
SOLR-13821: Package Store for storing package artifacts (#929)
SOLR-13821: Package Store for storing package artifacts
2019-10-08 14:24:33 +11:00
Jason Gerlowski 25eda17c66 Fix atomic-update test failures 2019-10-07 14:14:46 -04:00
Andrzej Bialecki c0a446b179 SOLR-13790: LRUStatsCache size explosion and ineffective caching. 2019-10-07 19:53:52 +02:00
Jason Gerlowski ceb47042d1 SOLR-13539: Fix MV removeregex atomic-updates
Prior to this commit, the ByteArrayUtf8CharSequence issues had been
fixed on single value removeregex commands, but not if multiple regex's
were used.

This commit fixes our NamedList parsing for this additional case.  It
also adds some tests for related atomic-update cases.

Co-Authored-By: Tim Owen
2019-10-07 13:38:55 -04:00
Jason Gerlowski 2b04363700
SOLR-13820: Improve RBAP documentation (#924)
The ref-guide page for Rule-Based Authorization was in need of a refresh.  Some mailing-list questions made it clear there were a few areas users were unclear on, including permission resolution, permission syntax and defaults, and pros/cons of editing configuration using the API vs directly in ZooKeeper.

This commit clarifies these points, as well as doing some larger restructuring to (hopefully) make the page make a little more sense as a whole.
2019-10-07 12:33:06 -04:00
Jason Gerlowski 24afd95902 SOLR-13539: Improve atomic-update test coverage
Closes #665
2019-10-07 08:27:29 -04:00
Joel Bernstein 88fee95d54 SOLR-13298: Allow zplot to plot matrices 2019-10-06 22:18:00 -04:00
Noble Paul c5dc671aa3
SOLR-13787: An annotation based system to write v2 APIs
This is to make V2 APIs easier to write and less error prone
* All specs are always in sync with code
* specs are generated from code
*  no need to learn and write json schema
2019-10-07 09:19:57 +11:00
Mikhail Khludnev 1cf7368ed8 SOLR-13719: introducing SolrClient.ping(collection) 2019-10-06 23:36:58 +03:00
Ishan Chattopadhyaya 515af6d3ec SOLR-13661: Reverting all half-baked stuff from SOLR-13707, SOLR-13659, SOLR-13565, SOLR-13650, SOLR-13710, SOLR-13721, SOLR-13637
All half baked package management and hot-classloading code reverted to allow for a fresh start.
2019-10-06 18:00:40 +05:30
Thomas Wöckinger 22e96697de SOLR-13795: Managed schema should do a core reload in standalone mode.
Fixes #902
2019-10-04 13:05:01 -04:00
Christine Poerschke b51013a10b SOLR-13812: Add javadocs, uneven rejection and basic test coverage for the SolrTestCaseJ4.params method.
(Diego Ceccarelli, Christine Poerschke, Munendra S N)
2019-10-04 11:18:33 +01:00
Christine Poerschke 824f0eca6b SOLR-13791: Remove remaining Commons BeanUtils references. (Andras Salamon, Christine Poerschke) 2019-10-04 11:14:19 +01:00
Andrzej Bialecki a0396da64b SOLR-8241: Fix an NPE. 2019-10-03 21:11:44 +02:00
Andrzej Bialecki 8007ac0cb0 SOLR-8241: Add CaffeineCache, an efficient implementation of SolrCache. 2019-10-03 15:17:08 +02:00
Mike Drob 2d3baf6e8f SOLR-13797 SolrResourceLoader no longer caches bad results when asked for wrong type 2019-10-02 16:35:54 -05:00
Chris Hostetter a57ec148e5 SOLR-13811: Refactor AutoAddReplicasIntegrationTest to isolate problematic situation into an AwaitsFix test method 2019-10-02 10:13:33 -07:00
Ahmed Adel 9063cf1b96 Fixing link to Lucene Java Bugs page (#909) 2019-10-02 10:29:07 +02:00
Thomas Wöckinger 4ddde00667 SOLR-13802: Write analyzer property luceneMatchVersion to managed schema 2019-10-01 09:17:59 -04:00
Erick Erickson 67f4c7f36e SOLR-13771: Add -v and -m to ulimit section of reference guide and bin/solr checks. Forgot CHANGES.txt entry 2019-09-30 18:01:06 -04:00
Erick Erickson a1f3d2c29a SOLR-13771: Add -v and -m to ulimit section of reference guide and bin/solr checks 2019-09-30 17:58:35 -04:00
Chris Hostetter 0ec7986fc0 Minor logging improvements 2019-09-30 10:00:33 -07:00
Cao Manh Dat 7350c50316 SOLR-13798: SSL: Adding Enabling/Disabling client's hostname verification config 2019-09-30 16:29:43 +01:00
Joel Bernstein e7522297a7 SOLR-13632,SOLR-13667,SOLR-13625: Update CHANGES.txt 2019-09-29 20:36:35 -04:00
Joel Bernstein 22b8943407 SOLR-13632: Fix precommit 2019-09-29 19:14:43 -04:00
Joel Bernstein d4f612368d SOLR-13632: Support integral plots, cosine distance and string truncation with math expressions 2019-09-29 19:01:40 -04:00
Erick Erickson 4f89987141 :SOLR-13454: Investigate ReindexCollectionTest failures, added more safeguards in bandaid code 2019-09-29 12:25:43 -04:00
Shalin Shekhar Mangar 2ba61c8fb9 SOLR-13712: JMX MBeans are not exposed because of race condition between creating platform mbean server and registering mbeans 2019-09-29 10:09:58 +05:30
Munendra S N e5d95011f0 SOLR-13417: handle stats on date/str fields in solrj's JSON facet resp
* Except for min/max aggregation in all other cases values woudl be
  number. As for same data/string field, value can vary based on
  aggregation used, capture response in Map<String, Object>
2019-09-28 12:08:55 +05:30
Munendra S N 7752964e19 SOLR-13180: fix classCastEx in JSON Request API 2019-09-28 11:12:18 +05:30
Yonik Seeley ae72f4f542
SOLR-13399: add SPLITSHARD splitByPrefix docs (#903)
* SOLR-13399: add SPLITSHARD splitByPrefix docs

* SOLR-13727: CHANGES entry for bug
2019-09-27 12:07:42 -04:00
Chris Hostetter ec9780c8aa SOLR-13747: New TestSSLTestConfig.testFailIfUserRunsTestsWithJVMThatHasKnownSSLBugs() to give people running tests more visibility if/when they use a known-buggy JVM causing most SSL tests to silently SKIP 2019-09-26 14:12:20 -07:00
Munendra S N 42e64ffd53 SOLR-13272: add documentation for arbitrary range in JSON facet 2019-09-26 09:50:34 +05:30
David Smiley 0d0af505a0 SOLR-13784: EmbeddedSolrServer coreName optional 2019-09-25 11:33:28 -04:00
Munendra S N cd9f3a9a46 SOLR-13022: validate sort parameters in JSON facet after parsing
* This fixes NPE in case of non-existent aggregate functions in sort/prelim_sort
* validate sort direction
2019-09-25 10:39:55 +05:30
Andrew Hind d279fe8a80 LUCENE-8984: MoreLikeThis MLT is biased for uncommon fields (#871)
* SOLR-13752: MoreLikeThis MLT is biased for uncommon fields
2019-09-24 21:58:26 -07:00
Chris Hostetter 4ec4061cbc SOLR-13786: AwaitsFix SolrExporterIntegrationTest 2019-09-23 10:33:08 -07:00
Gus Heck d75f027912 SOLR-11492 - clean up /solr/cloud-dev and add a well documented script. 2019-09-21 08:39:48 -04:00
Munendra S N 43ee86a3d0 SOLR-13272: add support for arbitrary ranges in JSON Range faceting
In some cases, the gap might need to be different for different ranges.
To support such cases, add support to specify arbitrary ranges.
2019-09-21 11:46:11 +05:30
Munendra S N 59fe7b7d9f SOLR-13725: allow negative values for limit in TermsFacetMap
* when limit is negative all the facet values are returned
* allow mincount=0 in TermsFacetMap.
2019-09-21 11:03:51 +05:30
Munendra S N c22379253c SOLR-13780: fix ClassCastException in NestableJsonFacet
* handle both int and long values for count. In case of single-shard or
  standalone, count is int whereas in multishard count would be long
2019-09-21 10:58:31 +05:30
Jason Gerlowski e66741aecf
SOLR-13638: Add debug,trace RBAP logging (#894)
Increase log level to DEBUG or TRACE for
org.apache.solr.security.RuleBasedAuthorizationPlugin for
more helpful debugging output.
2019-09-20 14:50:52 -04:00
Chris Hostetter 5a01a8b362 SOLR-13781: AwaitsFix TestContainerReqHandler.testPackageAPI 2019-09-19 17:14:32 -07:00
Dawid Weiss 2a1d5eea42 SOLR-13779: Use the safe fork of simple-xml for clustering contrib 2019-09-19 12:24:26 +02:00
Jan Høydahl dd729549b5
SOLR-13734 JWTAuthPlugin to support multiple issuers (#860) 2019-09-19 09:50:20 +02:00
Andrzej Bialecki 9e449ad0bc SOLR-13763: Ignore freedisk changes in a live simulator created from snapshot. 2019-09-18 23:22:18 +02:00
Houston Putman c7f8487328 SOLR-13773: Prometheus Exporter GC and Heap options (#887)
* SOLR-13773: Prometheus Exporter GC and Heap options

* Adding info to the ref-guide.
2019-09-18 13:31:53 -07:00
Andrzej Bialecki 6a8cfddf30 SOLR-13763: Improve the tracking of "freedisk" in autoscaling simulations. 2019-09-18 19:18:47 +02:00
Bruno Roustant fd0c8b9e81 LUCENE-8921: IndexSearcher.termStatistics API change
Closes #797
2019-09-17 16:48:24 -04:00
Jan Høydahl b617769614
SOLR-13767: Upgrade jackson to 2.9.9 (#886) 2019-09-17 01:13:23 +02:00
Andrzej Bialecki 30aad175e0 SOLR-13159: Add a warning about DNS resolution in SolrCloud clusters. 2019-09-16 18:50:36 +02:00
Andrzej Bialecki e04917dc9f SOLR-9658: Max idle time support for SolrCache implementations. 2019-09-16 16:50:07 +02:00
Jason Gerlowski 2546e7a2ec SOLR-13622: Fix file-handle leak 2019-09-14 20:39:12 -04:00
Jan Høydahl 31735eeb40 SOLR-13238: BlobHandler generates non-padded md5 2019-09-14 22:23:17 +02:00
Thomas Wöckinger e788024b84 SOLR-13739: Optimized large managed schema modifications
Internal O(n^2) problem.
Fixes #855
2019-09-13 12:35:27 -04:00
Koen De Groote ec78ef7852 Changing keyset() to entryset() and sometines values(). (#868) 2019-09-13 14:42:38 +02:00
Chris Hostetter 3ed96026d3 LTR Test Hardening:
1) use per-method state isolation in several tests...

This helps prevent failures in one test to allow persisted date to leak into other test methods,
as well as ensuring that these tests play nicely with -Dtests.iters > 1

2) TestRerankBase cleanup to eliminate unnecessary extra SolrCore (that was being leaked)
2019-09-12 18:11:24 -07:00
Michael Gibney 0ce635ec01 SOLR-13714: Correct refguide regarding shardHandlerFactory solrconfig.xml element (#843) 2019-09-12 13:18:35 -05:00
Chris Hostetter fb5a3e28fe CloudExitableDirectoryReaderTest improvements
remove use of LbSolrClient to prevent premature failure of low timeAllowed options on slow jenkins machines

increase cluster size to also test codepaths where requests are proxied by a node that does not host any core in the collection
2019-09-11 16:29:28 -07:00
Chris Hostetter 416de65d31 Fix TestSnapshotCloudManager test bug: file handle leak
I believe this was the root cause of some recent windows jenkins suite level failures in cleaning up temp files
2019-09-11 11:47:50 -07:00
Jan Høydahl 4599f6e9ee SOLR-13713: JWTAuthPlugin to support multiple JWKS endpoints 2019-09-10 13:01:47 +02:00
Noble Paul 042478cfa7 SOLR-13677: reverting the last commit 2019-09-08 14:57:47 +10:00
Andrzej Bialecki 9510e06612 SOLR-13742: temporarily disable this assertion while I investigate jenkins failures
(the test passes local beasting).
2019-09-07 22:23:22 +02:00
Andrzej Bialecki 6f22bf0964 SOLR-13742: Allow optional redaction of data saved by 'bin/solr autoscaling -save'.
Fix some unwanted side-effects in snapshots + add more robust unit tests.
2019-09-07 12:09:09 +02:00
David Smiley da158ab229 SOLR-13745: AtomicUpdateProcessorFactoryTest should close request 2019-09-06 13:55:57 -04:00