13658 Commits

Author SHA1 Message Date
Joel Bernstein
861bdae964 SOLR-14130: Get working with branch_8x 2020-01-03 09:51:18 -05:00
Joel Bernstein
f35cd71427 SOLR-14130: Harden parsing logic 2020-01-03 08:53:31 -05:00
Joel Bernstein
600326c318 SOLR-14130: Fix precommit 2020-01-03 08:53:11 -05:00
Joel Bernstein
eb480c6c3b SOLR-14130: Add postlogs command line tool for indexing Solr logs 2020-01-03 08:52:47 -05:00
Dawid Weiss
daa4a8e467 Follow-up unused import removal. 2020-01-03 14:21:22 +01:00
Dawid Weiss
2b00d633a5 SOLR-13778: Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection) 2020-01-03 14:19:09 +01:00
Andrzej Bialecki
22386a1f12 SOLR-14122: SimUtils converts v2 to v1 request params incorrectly. 2020-01-02 14:25:55 +01:00
Nándor Mátravölgyi
5874b9c793 LUCENE-9093: UnifiedHighlighter LengthGoalBreakIterator frag align
Matches in passages should be centered better on average.
 Closes #1123

(cherry picked from commit 4c9cc2cefd7f3593c4b4e1e5a087e3d206298989)
2020-01-01 01:00:13 -05:00
Jan Høydahl
6eff727590 SOLR-14129: Reuse Jackson ObjectMapper in AuditLoggerPlugin (#1104)
(cherry picked from commit c4993bc99ca4e9b1780c900e8bfa242d540ff8b5)
2019-12-30 17:41:59 +01:00
Cassandra Targett
601f9dbcf0 Ref Guide: fix upgrade notes version typo 2019-12-30 10:04:35 -06:00
Jan Høydahl
523b783f63 SOLR-14109: Always log to stdout from server/scripts/cloud-scripts/zkcli.{bat|sh} (#1130)
(cherry picked from commit 33bd811fb8b2a9bee595548e96c2a74721aa11b3)
2019-12-30 16:36:18 +01:00
Eric Pugh
e134123060 Word choice should be starting, not staring (#1128)
(cherry picked from commit 5a50eaa2c683a2921a1e1e846593bda48e36b296)
2019-12-30 12:48:19 +01:00
Robert Muir
300e81b655 SOLR-14141: eliminate JKS keystore from solr ssl docs.
Currently the documentation pretends to create a JKS keystore. It is
only actually a JKS keystore on java 8: on java9+ it is a PKCS12
keystore with a .jks extension (because PKCS12 is the new java default).
It works even though solr explicitly tells the JDK
(SOLR_SSL_KEY_STORE_TYPE=JKS) that its JKS when it is in fact not, due
to how keystore backwards compatibility was implemented.

Fix docs to explicitly create a PKCS12 keystore with .p12 extension and
so on instead of a PKCS12 keystore masquerading as a JKS one. This
simplifies the SSL steps since the "conversion" step (which was doing
nothing) from .JKS -> .P12 can be removed.
2019-12-29 09:34:55 -05:00
Mikhail Khludnev
c01b45b924 SOLR-13808: caching {!bool filter=..} by default. 2019-12-28 23:34:52 +03:00
Bruno Roustant
8f5f18041a
SOLR-14131: Add maxQueryLength option to DirectSolrSpellchecker. 2019-12-25 21:48:07 +01:00
Jan Høydahl
6722b94d52 SOLR-14146: Zookeeper version not resolved in RefGuide (#1119)
(cherry picked from commit aa43f352d9103b51c0cf33fd41bf16192810627f)
2019-12-24 23:07:58 +01:00
Robert Muir
359d82348e SOLR-14120: Solr Admin UI breaks when using IE11 2019-12-24 11:28:14 -08:00
Robert Muir
7feba46a6f SOLR-14144: add IP-based access control to securing solr page 2019-12-24 07:56:14 -08:00
Robert Muir
4cde252a84 SOLR-14143: add request logging to securing solr page 2019-12-24 06:47:00 -08:00
Robert Muir
30069e13f5 SOLR-13984: docs, changes.txt 2019-12-24 06:43:50 -08:00
Robert Muir
89d88de5c2 SOLR-13984: add (experimental, disabled by default) security manager support (#1082)
* SOLR-13984: add (experimental, disabled by default) security manager support.

User can set SOLR_SECURITY_MANAGER_ENABLED=true to enable security manager at runtime.

The current policy file used by tests is moved to solr/server
Additional permissions are granted for the filesystem locations set by bin/solr, and networking everywhere is enabled.

This takes advantage of the fact that permission entries are ignored if properties are not defined:
https://docs.oracle.com/javase/7/docs/technotes/guides/security/PolicyFiles.html#PropertyExp
2019-12-24 06:31:14 -08:00
Robert Muir
d7ff40f53f SOLR-14136: ip whitelist/blacklist via env vars (#1111)
SOLR-14136: ip whitelist/blacklist via env vars

This makes it easy to restrict access to Solr by IP. For example SOLR_IP_WHITELIST="127.0.0.1, 192.168.0.0/24, [::1], [2000:123:4:5::]/64" would restrict access to v4/v6 localhost, the 192.168.0 ipv4 network, and 2000:123:4:5 ipv6 network. Any other IP will receive a 403 response.

Blacklisting functionality can deny access to problematic addresses or networks that would otherwise be allowed. For example SOLR_IP_BLACKLIST="192.168.0.3, 192.168.0.4" would explicitly prevent those two specific addresses from accessing solr.
2019-12-23 16:28:12 -08:00
Tomas Fernandez Lobbe
5f5ef58117 SOLR-14095: Fix Java 8 compile issue 2019-12-23 15:03:23 -08:00
Tomas Fernandez Lobbe
fe04a5b6f0 SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper (#1095)
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
2019-12-23 15:03:14 -08:00
Nándor Mátravölgyi
80ad056bab LUCENE-9091: UnifiedHighlighter HTML escaping should only
escape essentials

(cherry picked from commit 1be5b689640fe4d1bf0ae3fd19c5fe93b20a77ef)
2019-12-23 17:21:32 -05:00
Robert Muir
f1a674717a SOLR-14138: changes.txt 2019-12-23 10:49:49 -08:00
Robert Muir
baeaa56fb2 SOLR-14138: enable request log via environ var, remove deprecated jetty class usage, respect SOLR_LOGS_DIR (#1110)
User can now set SOLR_REQUESTLOG_ENABLED=true to enable the jetty request log, instead of editing XML. The location of the request logs will respect SOLR_LOGS_DIR if that is set. The deprecated NCSARequestLog is no longer used, instead it uses CustomRequestLog with NCSA_FORMAT.
2019-12-23 07:38:56 -08:00
noble
04b0a5d8f3 SOLR-14125 : Streaming expressions to be loadable from packages 2019-12-23 15:30:11 +11:00
Cassandra Targett
f74a62f37e Ref Guide: various little typos; clean up Solr CLI section on bin/solr export 2019-12-20 15:00:51 -06:00
Andy Vuong
939057deff SOLR-14107: Ensure bin/solr -q/-v args work with -e/example (#1093)
Co-authored-by: Andy Vuong <andyvvv.101@gmail.com>
2019-12-20 11:32:11 -05:00
Robert Muir
3d01cd6f74 SOLR-14112: do not display load average of -1.00 on windows in admin UI 2019-12-20 05:45:11 -05:00
Kevin Risden
3f23002456
SOLR-14106: Cleanup Jetty SslContextFactory usage
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:19:12 -05:00
Chris Hostetter
22fe38f060 SOLR-14128: SystemCollectionCompatTest - increase logging to aid in debuging future (jenkins) failures
(cherry picked from commit bc2770ebb834b2871117b22f16f9b432787d4f82)
2019-12-19 17:15:18 -07:00
Jason Gerlowski
5270b17a3b SOLR-14042: Fix varargs precommit warnings 2019-12-19 10:03:38 -05:00
Adrien Grand
741593f57b Minor improvements to the Solr changes. 2019-12-19 08:41:47 +01:00
Ishan Chattopadhyaya
35cb6a0203 SOLR-14108: Fix cherry-pick problem with last commit 2019-12-19 11:08:56 +05:30
Ishan Chattopadhyaya
3a4f43227b SOLR-14108: Handle missing verify commands or missing default params in Package Manager 2019-12-19 10:47:29 +05:30
Robert Muir
04e306f616 SOLR-14085: remove solr fork of lucene test securitymanager 2019-12-18 23:12:57 -05:00
Matthias Krueger
d226aba686
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 19:30:31 -05:00
Chris Hostetter
f0714517e4 SOLR-14099: expanded comment on static final variable based on followup questions in Jira from Dawid
(cherry picked from commit d30f90e34963f63c07df53df82960f927ab20a8e)
2019-12-18 16:38:36 -07:00
noble
ac7ad676ef SOLR-13822: Bug fixs and tests for URP loading 2019-12-19 06:24:26 +11:00
tallison
f06e32c969
SOLR-14054 -- need to add xml-apis for Java 8 after upgrading xerces 2019-12-18 12:49:43 -05:00
Cassandra Targett
56824fb6d7 SOLR-13662: Improvements for Ref Guide package-manager.adoc 2019-12-18 10:53:03 -06:00
Robert Muir
8c14015e52 SOLR-13983: remove or replace process execution in SystemInfoHandler 2019-12-18 09:23:36 -05:00
Robert Muir
53a82aedcb SOLR-14110: sandbox javax.script usage in tests 2019-12-18 06:31:00 -05:00
Mikhail Khludnev
cc00e1dcef SOLR-14092: Mark BlockJoinFacetComponent as deprecated. 2019-12-18 11:11:25 +03:00
Chris Hostetter
d1fa6e1e02 SOLR-14099: Fixed @LogLevel annotation in test-framework to correctly 'unset' Loggers after test
(cherry picked from commit cc4262a8ec37b2420e1d80a392c5e8019f43e24c)
2019-12-17 14:59:26 -07:00
Chris Hostetter
35793386b0 Harden (Cloud)ExitableDirectoryReaderTest
Thread.sleep() is "subject to the precision and accuracy of system timers and schedulers."

But tests using DelayingSearchComponent need to ensure that it sleeps *at least* as long as they request, in order to trigger the timeAllowed constraint

(cherry picked from commit 8493cf18cbfcbf020c467737e28c55e4b05c60f9)
2019-12-17 14:48:15 -07:00
tallison
a58269f6a6
SOLR-14054: Upgrade to Tika 1.23 2019-12-17 15:55:21 -05:00
Cassandra Targett
fb6af5e538 Ref Guide: fix typos & standardize spellings 2019-12-17 14:11:25 -06:00