32661 Commits

Author SHA1 Message Date
Robert Muir
30069e13f5 SOLR-13984: docs, changes.txt 2019-12-24 06:43:50 -08:00
Robert Muir
89d88de5c2 SOLR-13984: add (experimental, disabled by default) security manager support (#1082)
* SOLR-13984: add (experimental, disabled by default) security manager support.

User can set SOLR_SECURITY_MANAGER_ENABLED=true to enable security manager at runtime.

The current policy file used by tests is moved to solr/server
Additional permissions are granted for the filesystem locations set by bin/solr, and networking everywhere is enabled.

This takes advantage of the fact that permission entries are ignored if properties are not defined:
https://docs.oracle.com/javase/7/docs/technotes/guides/security/PolicyFiles.html#PropertyExp
2019-12-24 06:31:14 -08:00
Robert Muir
d7ff40f53f SOLR-14136: ip whitelist/blacklist via env vars (#1111)
SOLR-14136: ip whitelist/blacklist via env vars

This makes it easy to restrict access to Solr by IP. For example SOLR_IP_WHITELIST="127.0.0.1, 192.168.0.0/24, [::1], [2000:123:4:5::]/64" would restrict access to v4/v6 localhost, the 192.168.0 ipv4 network, and 2000:123:4:5 ipv6 network. Any other IP will receive a 403 response.

Blacklisting functionality can deny access to problematic addresses or networks that would otherwise be allowed. For example SOLR_IP_BLACKLIST="192.168.0.3, 192.168.0.4" would explicitly prevent those two specific addresses from accessing solr.
2019-12-23 16:28:12 -08:00
Tomas Fernandez Lobbe
5f5ef58117 SOLR-14095: Fix Java 8 compile issue 2019-12-23 15:03:23 -08:00
Tomas Fernandez Lobbe
fe04a5b6f0 SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper (#1095)
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
2019-12-23 15:03:14 -08:00
Nándor Mátravölgyi
80ad056bab LUCENE-9091: UnifiedHighlighter HTML escaping should only
escape essentials

(cherry picked from commit 1be5b689640fe4d1bf0ae3fd19c5fe93b20a77ef)
2019-12-23 17:21:32 -05:00
Robert Muir
f1a674717a SOLR-14138: changes.txt 2019-12-23 10:49:49 -08:00
Bruno Roustant
361bf78d89
LUCENE-9102: update changes.txt 2019-12-23 16:59:42 +01:00
Robert Muir
baeaa56fb2 SOLR-14138: enable request log via environ var, remove deprecated jetty class usage, respect SOLR_LOGS_DIR (#1110)
User can now set SOLR_REQUESTLOG_ENABLED=true to enable the jetty request log, instead of editing XML. The location of the request logs will respect SOLR_LOGS_DIR if that is set. The deprecated NCSARequestLog is no longer used, instead it uses CustomRequestLog with NCSA_FORMAT.
2019-12-23 07:38:56 -08:00
Bruno Roustant
ab1dc42c63
LUCENE-9102: Add maxQueryLength option to DirectSpellchecker. 2019-12-23 13:03:19 +01:00
noble
04b0a5d8f3 SOLR-14125 : Streaming expressions to be loadable from packages 2019-12-23 15:30:11 +11:00
Cassandra Targett
f74a62f37e Ref Guide: various little typos; clean up Solr CLI section on bin/solr export 2019-12-20 15:00:51 -06:00
Andy Vuong
939057deff SOLR-14107: Ensure bin/solr -q/-v args work with -e/example (#1093)
Co-authored-by: Andy Vuong <andyvvv.101@gmail.com>
2019-12-20 11:32:11 -05:00
Robert Muir
3d01cd6f74 SOLR-14112: do not display load average of -1.00 on windows in admin UI 2019-12-20 05:45:11 -05:00
Kevin Risden
3f23002456
SOLR-14106: Cleanup Jetty SslContextFactory usage
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:19:12 -05:00
Chris Hostetter
22fe38f060 SOLR-14128: SystemCollectionCompatTest - increase logging to aid in debuging future (jenkins) failures
(cherry picked from commit bc2770ebb834b2871117b22f16f9b432787d4f82)
2019-12-19 17:15:18 -07:00
Adrien Grand
fb6e2d16de LUCENE-9103: WANDScorer can miss some hits in some rare conditions. 2019-12-19 17:15:02 +01:00
Jason Gerlowski
5270b17a3b SOLR-14042: Fix varargs precommit warnings 2019-12-19 10:03:38 -05:00
iverase
36fbba43b8 Move changes entry to 8.4 2019-12-19 08:47:45 +01:00
Adrien Grand
741593f57b Minor improvements to the Solr changes. 2019-12-19 08:41:47 +01:00
Ishan Chattopadhyaya
35cb6a0203 SOLR-14108: Fix cherry-pick problem with last commit 2019-12-19 11:08:56 +05:30
Ishan Chattopadhyaya
3a4f43227b SOLR-14108: Handle missing verify commands or missing default params in Package Manager 2019-12-19 10:47:29 +05:30
Robert Muir
04e306f616 SOLR-14085: remove solr fork of lucene test securitymanager 2019-12-18 23:12:57 -05:00
Matthias Krueger
d226aba686
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 19:30:31 -05:00
Chris Hostetter
f0714517e4 SOLR-14099: expanded comment on static final variable based on followup questions in Jira from Dawid
(cherry picked from commit d30f90e34963f63c07df53df82960f927ab20a8e)
2019-12-18 16:38:36 -07:00
noble
ac7ad676ef SOLR-13822: Bug fixs and tests for URP loading 2019-12-19 06:24:26 +11:00
tallison
f06e32c969
SOLR-14054 -- need to add xml-apis for Java 8 after upgrading xerces 2019-12-18 12:49:43 -05:00
Cassandra Targett
56824fb6d7 SOLR-13662: Improvements for Ref Guide package-manager.adoc 2019-12-18 10:53:03 -06:00
Robert Muir
8c14015e52 SOLR-13983: remove or replace process execution in SystemInfoHandler 2019-12-18 09:23:36 -05:00
Robert Muir
53a82aedcb SOLR-14110: sandbox javax.script usage in tests 2019-12-18 06:31:00 -05:00
Mikhail Khludnev
cc00e1dcef SOLR-14092: Mark BlockJoinFacetComponent as deprecated. 2019-12-18 11:11:25 +03:00
Chris Hostetter
d1fa6e1e02 SOLR-14099: Fixed @LogLevel annotation in test-framework to correctly 'unset' Loggers after test
(cherry picked from commit cc4262a8ec37b2420e1d80a392c5e8019f43e24c)
2019-12-17 14:59:26 -07:00
Chris Hostetter
35793386b0 Harden (Cloud)ExitableDirectoryReaderTest
Thread.sleep() is "subject to the precision and accuracy of system timers and schedulers."

But tests using DelayingSearchComponent need to ensure that it sleeps *at least* as long as they request, in order to trigger the timeAllowed constraint

(cherry picked from commit 8493cf18cbfcbf020c467737e28c55e4b05c60f9)
2019-12-17 14:48:15 -07:00
tallison
a58269f6a6
SOLR-14054: Upgrade to Tika 1.23 2019-12-17 15:55:21 -05:00
Cassandra Targett
fb6af5e538 Ref Guide: fix typos & standardize spellings 2019-12-17 14:11:25 -06:00
Cassandra Targett
94d98bb134 Ref Guide: make section headings in Headline Case 2019-12-17 13:00:40 -06:00
Chris Hostetter
c9bd7cedc2 SOLR-13696: AwaitsFix RoutedAliasUpdateProcessorTest (and subclasses)
The helper method RoutedAliasUpdateProcessorTest.addDocsAndCommit doesn't garuntee docs have been committed when it returns, causing threading/timing bugs in tests that use it as a gate for making subsequent assertions -- causing a steady stream of jenkins test failures

(cherry picked from commit 33e44b2fd6973aa801d8bad2b64ff1931d885ee3)
2019-12-17 11:10:24 -07:00
Cassandra Targett
95c7b1d925 Ref Guide: Upgrade notes for 8.4 2019-12-17 12:02:58 -06:00
Ignacio Vera
f08a830a6a LUCENE-9055: Fix the detection of lines crossing triangles through edge points (#1020) 2019-12-17 09:40:09 +01:00
Chris Hostetter
10ea628bb6 SOLR-14081: re-implement FullSolrCloudDistribCmdsTest to extend SolrCloudTestCase
(cherry picked from commit db11e9e9a2c07136399ba002f2bbefe8c611b0a0)
2019-12-16 17:32:57 -07:00
Chris Hostetter
be1e6b457b SOLR-14099: work around @LogLevel bug in LoggingHandlerTest
(cherry picked from commit e6b5da5c12c37dce6f3d767bbafb75b28795ab2f)
2019-12-16 12:13:38 -07:00
Robert Muir
cfccbe5af3 LUCENE-9094: Ban ObjectInputStream and ObjectOutputStream in forbidden-apis 2019-12-16 13:41:33 -05:00
Ishan Chattopadhyaya
461317062c SOLR-14096: Stopping -Denable.packages=true from leaking to other tests 2019-12-16 20:20:43 +05:30
Andrzej Bialecki
c8fb1bf74e Fix an occasional test error caused by the maintenance trigger generating events. 2019-12-16 13:55:12 +01:00
Ishan Chattopadhyaya
8aa0103b14 SOLR-14087: Changing the filestore dir name back to filestore from .filestore 2019-12-16 18:19:44 +05:30
Adrien Grand
ed97a36fb4 SOLR-14094: Bad-apple TestSolrCachePerf. 2019-12-16 13:46:44 +01:00
Ishan Chattopadhyaya
d19b54e141 DOAP changes for release 8.3.1 2019-12-16 09:22:58 +01:00
David Smiley
0ea3ffd717 SOLR-14072: Deprecate Blob API and runtimeLib (#1086)
(cherry picked from commit 2db48314f97a6017fe216f77c34cf5b261985cf4)
2019-12-15 23:54:02 -05:00
noble
f433051f5e SOLR-14087: changed the filestore location to .filestore instead of $filestore 2019-12-16 15:51:14 +11:00
Noble Paul
3635a1bcdb SOLR-14087: disable package store API if -Denable.packages not set to true 2019-12-16 08:06:23 +11:00