Commit Graph

13882 Commits

Author SHA1 Message Date
Kevin Risden 22155bf7a7
SOLR-14163: SOLR_SSL_CLIENT_HOSTNAME_VERIFICATION needs to work with Jetty server/client SSL contexts
Closes #1147

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-09 10:28:35 -05:00
noble 3b660d6b84 SOLR-14165: SolrResponse serialVersionUID has changed in a backward incompatible way 2020-01-10 01:17:50 +11:00
andywebb1975 ffe75fb441 SOLR-14165: set SolrResponse's serialVersionUID explicitly 2020-01-10 01:04:10 +11:00
Eric Pugh 8718447112 SOLR-13927: Correct v2 /schema APIs in docs (#1010) 2020-01-09 08:58:14 -05:00
Dawid Weiss 09fb6f196f Don't assemble solr ref guide by default. 2020-01-09 13:48:06 +01:00
Dawid Weiss 2ba3ec7173 LUCENE-9124: updated build script for solr-ref-guide; newer plugin version and a workaround against gem proxy down. 2020-01-09 13:31:50 +01:00
Dawid Weiss 0674fada65 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-09 11:56:02 +01:00
Houston Putman 08b64aab8f Revert "SOLR-11746: Existence query support for numeric point fields"
This reverts commit f5ab3ca688.
2020-01-08 18:33:15 -05:00
Houston Putman ee66e5ef23 Revert "SOLR-11746: Adding docs for negative existence queries."
This reverts commit 9edb143efd.
2020-01-08 18:32:31 -05:00
Tomas Fernandez Lobbe a9beeb1d1e SOLR-14169: Fix 20 Resource Leak warnings in SolrJ's apache/solr/common 2020-01-08 11:16:32 -08:00
Dawid Weiss 7e4c841aa7 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-08 12:26:10 +01:00
Jason Gerlowski a17c486424 Revert "SOLR-13985: Bind to localhost interface by default"
This temporarily reverts commit 479e73 while a potentially related
networking hiccup is investigated.
2020-01-07 09:05:13 -05:00
Dawid Weiss 405d227c55 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-07 08:45:12 +01:00
Houston Putman 9edb143efd SOLR-11746: Adding docs for negative existence queries. 2020-01-06 13:08:13 -05:00
Houston Putman f5ab3ca688 SOLR-11746: Existence query support for numeric point fields 2020-01-06 12:12:22 -05:00
Martijn Koster ac777a5352 SOLR-13089: Fix lsof edge cases in the solr CLI script 2020-01-06 13:20:14 +01:00
Chris Hostetter 0fac7c1a26 SOLR-13486: Text improvements
* force a hard commit of all docs in TestCloudConsistency to work around bug in that test

 * add new AwaitsFix'ed TestTlogReplayVsRecovery that more explicitly demonstrates the bug via TestInjection.updateLogReplayRandomPause
2020-01-03 15:12:23 -07:00
Mikhail Khludnev 8fba8eba13 SOLR-12490: Introducing json.queries to define many named queries in Query DSL. 2020-01-03 23:28:11 +03:00
Jason Gerlowski 479e736469 SOLR-13985: Bind to localhost interface by default
Prior to this commit, Solr's Jetty listened for connections on all
network interfaces.  This commit changes it to only listen on localhost,
to prevent incautious administrators from accidentally exposing their
Solr deployment to the world.

Administrators who wish to override this behavior can set the
SOLR_JETTY_HOST property in their Solr include file
(solr.in.sh/solr.in.cmd) to "0.0.0.0" or some other value.
2020-01-03 15:17:24 -05:00
Nick Vercammen 1e0471a247
SOLR-14153: Return correct isolation level when retrieving it from the SQL Connection
As transactions are not supported a request to getTransactionIsolation() should return TRANSACTION_NONE (https://docs.oracle.com/javase/8/docs/api/java/sql/Connection.html#TRANSACTION_NONE)

Signed-off-by: Kevin Risden <krisden@apache.org>
2020-01-03 14:24:55 -05:00
Eric Pugh 50176fd6fc SOLR-14157: Document backup/restore 'name' param (#1133) 2020-01-03 10:18:27 -05:00
Joel Bernstein 8df304d12e SOLR-14130: Harden parsing logic 2020-01-03 08:47:19 -05:00
Joel Bernstein 8784d7c787 SOLR-14130: Fix precommit 2020-01-03 08:47:19 -05:00
Joel Bernstein 29c00d4fe7 SOLR-14130: Add postlogs command line tool for indexing Solr logs 2020-01-03 08:47:19 -05:00
Dawid Weiss d2409fe499 Follow-up unused import removal. 2020-01-03 14:20:52 +01:00
Dawid Weiss 6d1e34d0cc Follow-up unused import removal. 2020-01-03 14:20:21 +01:00
Dawid Weiss 985af95732 SOLR-13778: Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection) 2020-01-03 14:12:23 +01:00
Dawid Weiss f789e053d2 Solrj client will retry requests on SSLException with a suppressed SocketException (very likely a hard-closed socket connection) 2020-01-03 14:09:37 +01:00
Dawid Weiss 2bab5ea442 Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-03 11:02:55 +01:00
Andrzej Bialecki 7d0cf0df32 SOLR-13817: Clean up config files to remove the default 'class=' attribute in
standard caches.
2020-01-02 20:58:47 +01:00
Andrzej Bialecki 15d5e6662c SOLR-14122: add unit test. 2020-01-02 14:02:54 +01:00
Andrzej Bialecki 38b9af21f1 SOLR-14122: SimUtils converts v2 to v1 request params incorrectly. 2020-01-02 13:54:45 +01:00
Dawid Weiss 1a690d95ad Merge remote-tracking branch 'origin/master' into gradle-master 2020-01-02 10:49:19 +01:00
Nándor Mátravölgyi 4c9cc2cefd LUCENE-9093: UnifiedHighlighter LengthGoalBreakIterator frag align
Matches in passages should be centered better on average.
 Closes #1123
2020-01-01 00:57:00 -05:00
Dawid Weiss a40b3e755b Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-31 10:08:07 +01:00
Dawid Weiss 5bb5f7eddf Upgrade Randomizedtesting to 2.7.6 2019-12-31 09:42:44 +01:00
Jan Høydahl c4993bc99c
SOLR-14129: Reuse Jackson ObjectMapper in AuditLoggerPlugin (#1104) 2019-12-30 17:40:32 +01:00
Cassandra Targett 6d24cacf78 Ref Guide: fix upgrade notes version typo 2019-12-30 10:03:13 -06:00
Jan Høydahl 33bd811fb8
SOLR-14109: Always log to stdout from server/scripts/cloud-scripts/zkcli.{bat|sh} (#1130) 2019-12-30 16:28:24 +01:00
Dawid Weiss ca8661bc3a Reworked dependency resolution for license checks to work around a problem with gradle. Consolidated licenses with the ant build (excluding some jars from the ref-guide). 2019-12-30 14:05:08 +01:00
Eric Pugh 5a50eaa2c6 Word choice should be starting, not staring (#1128) 2019-12-30 12:45:19 +01:00
Dawid Weiss d79b678b39 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-30 09:24:46 +01:00
Robert Muir 1cb6e35058 SOLR-14141: eliminate JKS keystore from solr ssl docs.
Currently the documentation pretends to create a JKS keystore. It is
only actually a JKS keystore on java 8: on java9+ it is a PKCS12
keystore with a .jks extension (because PKCS12 is the new java default).
It works even though solr explicitly tells the JDK
(SOLR_SSL_KEY_STORE_TYPE=JKS) that its JKS when it is in fact not, due
to how keystore backwards compatibility was implemented.

Fix docs to explicitly create a PKCS12 keystore with .p12 extension and
so on instead of a PKCS12 keystore masquerading as a JKS one. This
simplifies the SSL steps since the "conversion" step (which was doing
nothing) from .JKS -> .P12 can be removed.
2019-12-29 09:34:00 -05:00
Mikhail Khludnev 3ae1a0b3ba SOLR-13808: remove redundant @Repeat 2019-12-28 23:43:37 +03:00
Mikhail Khludnev 3f29fe0b80 SOLR-13808: caching {!bool filter=..} by default. 2019-12-28 21:48:11 +03:00
Dawid Weiss 0fce50593b Add commons-csv to extraction deps. 2019-12-25 19:55:27 +01:00
Dawid Weiss 7350f03cd1 Reordered some lines and comments to make it easier to manually diff/ merge with gradle branch. 2019-12-25 13:29:11 +01:00
Dawid Weiss 584f564c91 Reordered some lines and comments to make it easier to manually diff/ merge with gradle branch. 2019-12-25 13:26:16 +01:00
Dawid Weiss 23f3fd2d48 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-25 13:14:57 +01:00
Jan Høydahl aa43f352d9
SOLR-14146: Zookeeper version not resolved in RefGuide (#1119) 2019-12-24 23:06:27 +01:00
Robert Muir 3ab59aa1c9 SOLR-14120: Solr Admin UI breaks when using IE11 2019-12-24 11:27:44 -08:00
Robert Muir b73e27d1ca SOLR-14144: add IP-based access control to securing solr page 2019-12-24 07:55:42 -08:00
Robert Muir b87e1f5843 SOLR-14143: add request logging to securing solr page 2019-12-24 06:46:29 -08:00
Robert Muir efd13f2884 SOLR-13984: docs, changes.txt 2019-12-24 06:41:14 -08:00
Robert Muir 126d6b7767
SOLR-13984: add (experimental, disabled by default) security manager support (#1082)
* SOLR-13984: add (experimental, disabled by default) security manager support.

User can set SOLR_SECURITY_MANAGER_ENABLED=true to enable security manager at runtime.

The current policy file used by tests is moved to solr/server
Additional permissions are granted for the filesystem locations set by bin/solr, and networking everywhere is enabled.

This takes advantage of the fact that permission entries are ignored if properties are not defined:
https://docs.oracle.com/javase/7/docs/technotes/guides/security/PolicyFiles.html#PropertyExp
2019-12-24 06:30:31 -08:00
Bruno Roustant 27840562a6
SOLR-14131: Add maxQueryLength option to DirectSolrSpellchecker.
Closes #1113
2019-12-24 15:05:00 +01:00
Robert Muir 72c99e921c
SOLR-14136: ip whitelist/blacklist via env vars (#1111)
SOLR-14136: ip whitelist/blacklist via env vars

This makes it easy to restrict access to Solr by IP. For example SOLR_IP_WHITELIST="127.0.0.1, 192.168.0.0/24, [::1], [2000:123:4:5::]/64" would restrict access to v4/v6 localhost, the 192.168.0 ipv4 network, and 2000:123:4:5 ipv6 network. Any other IP will receive a 403 response.

Blacklisting functionality can deny access to problematic addresses or networks that would otherwise be allowed. For example SOLR_IP_BLACKLIST="192.168.0.3, 192.168.0.4" would explicitly prevent those two specific addresses from accessing solr.
2019-12-23 19:26:11 -05:00
Nándor Mátravölgyi 1be5b68964 LUCENE-9091: UnifiedHighlighter HTML escaping should only
escape essentials
2019-12-23 17:20:48 -05:00
Robert Muir 403fd05646 SOLR-14138: changes.txt 2019-12-23 10:49:18 -08:00
Robert Muir 1425d6cbf8
SOLR-14138: enable request log via environ var, remove deprecated jetty class usage, respect SOLR_LOGS_DIR (#1110)
User can now set SOLR_REQUESTLOG_ENABLED=true to enable the jetty request log, instead of editing XML. The location of the request logs will respect SOLR_LOGS_DIR if that is set. The deprecated NCSARequestLog is no longer used, instead it uses CustomRequestLog with NCSA_FORMAT.
2019-12-23 10:37:31 -05:00
Noble Paul ef15ae9805
SOLR-14125 : Streaming expressions to be loadable from packages (#1108)
SOLR-14125: Make <expressible> plugins work with packages
2019-12-23 15:20:26 +11:00
Tomas Fernandez Lobbe c4f68bdab9
SOLR-14095: Let the overseer use javabin to store responses in ZooKeeper (#1095)
The Overseer used java serialization to store command responses in ZooKeeper. This commit changes the code to use Javabin instead, while allowing Java serialization with a System property in case it's needed for compatibility
2019-12-20 14:55:01 -08:00
Cassandra Targett 53423462f2 Ref Guide: various little typos; clean up Solr CLI section on bin/solr export 2019-12-20 15:00:22 -06:00
Dawid Weiss 5897b78572 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-20 17:35:40 +01:00
Andy Vuong e428628054 SOLR-14107: Ensure bin/solr -q/-v args work with -e/example (#1093)
Co-authored-by: Andy Vuong <andyvvv.101@gmail.com>
2019-12-20 11:31:16 -05:00
Robert Muir b7b6b0f3bf SOLR-14112: do not display load average of -1.00 on windows in admin UI 2019-12-20 05:42:00 -05:00
Kevin Risden aab3c5faa3
SOLR-14106: Cleanup Jetty SslContextFactory usage
Jetty 9.4.16.v20190411 and up introduced separate
client and server SslContextFactory implementations.
This split requires the proper use of of
SslContextFactory in clients and server configs.

This fixes the following
* SSL with SOLR_SSL_NEED_CLIENT_AUTH not working since v8.2.0
* Http2SolrClient SSL not working in branch_8x

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-19 23:05:47 -05:00
Chris Hostetter bc2770ebb8 SOLR-14128: SystemCollectionCompatTest - increase logging to aid in debuging future (jenkins) failures 2019-12-19 17:14:56 -07:00
Mike Drob 93585ba1d3 SOLR-13190 Surface Fuzzy term errors in Solr
Use newly added exceptions in Lucene for too complex fuzzy terms to
provide better error reporting for Solr queries.
2019-12-19 10:58:28 -06:00
Gus Heck 2f7276f935 Fix attribution 2019-12-19 10:50:37 -05:00
Jason Gerlowski 7cfa31b103 SOLR-14042: Fix varargs precommit warnings 2019-12-19 10:03:04 -05:00
Adrien Grand 868e41bc99 Minor improvements to the Solr changes. 2019-12-19 08:41:36 +01:00
Ishan Chattopadhyaya cbfa781fe3 SOLR-14108: Handle missing verify commands or missing default params in Package Manager 2019-12-19 10:38:34 +05:30
Robert Muir 7490bfd828 SOLR-14085: remove solr fork of lucene test securitymanager 2019-12-18 23:06:31 -05:00
Chris Hostetter d30f90e349 SOLR-14099: expanded comment on static final variable based on followup questions in Jira from Dawid 2019-12-18 16:36:34 -07:00
Matthias Krueger 1e5100d5a5
SOLR-14091: Removing deprecated configuration of Jetty's soLingerTime option
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-12-18 17:24:43 -05:00
Cassandra Targett fc2fbb2f7e SOLR-13662: Improvements for Ref Guide package-manager.adoc 2019-12-18 09:28:16 -06:00
Dawid Weiss 206d62b9d5 Merge remote-tracking branch 'origin/master' into gradle-master 2019-12-18 15:10:04 +01:00
Robert Muir 56839f6ace SOLR-13983: remove or replace process execution in SystemInfoHandler 2019-12-18 09:03:07 -05:00
Robert Muir 612cba38ca SOLR-14110: sandbox javax.script usage in tests 2019-12-18 06:30:24 -05:00
Dawid Weiss 2e453afa28 Merge tika upgrade monster-patch. commons-csv excluded from gradle. 2019-12-18 09:51:57 +01:00
Dawid Weiss 28b19c2af2 Merge with master. 2019-12-18 09:32:35 +01:00
Dawid Weiss 71a5714e29 SOLR-14103: remove extra unused dependencies (jersey-core, jersey-server, netty-all). 2019-12-18 09:18:32 +01:00
Mikhail Khludnev b0e532b7f3 SOLR-14051: removing Block Join Facet Component in favor of uniqueBlock(\_root_). 2019-12-18 11:16:53 +03:00
Gus Heck 46e5e13728 SOLR-13749 Cross collection join filter (XCJF)
Squashed commit of the following:  commit ffa68a8adb9c5dc16578ab26f731da247533c980
2019-12-18 03:01:24 -05:00
Chris Hostetter cc4262a8ec SOLR-14099: Fixed @LogLevel annotation in test-framework to correctly 'unset' Loggers after test 2019-12-17 14:58:45 -07:00
Tim Allison 279a391cf3
SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies) (#1092)
* SOLR-14054 -- upgrade to Tika 1.23 (and its dependencies)

* fix CHANGES.txt file
2019-12-17 16:09:08 -05:00
Chris Hostetter 8493cf18cb Harden (Cloud)ExitableDirectoryReaderTest
Thread.sleep() is "subject to the precision and accuracy of system timers and schedulers."

But tests using DelayingSearchComponent need to ensure that it sleeps *at least* as long as they request, in order to trigger the timeAllowed constraint
2019-12-17 13:54:33 -07:00
Cassandra Targett 3e8872738a Ref Guide: fix typos & standardize spellings 2019-12-17 12:59:17 -06:00
Cassandra Targett 3d4246089f Ref Guide: make section headings in Headline Case 2019-12-17 12:12:34 -06:00
Cassandra Targett 6785650317 Ref Guide: Upgrade notes for 8.4 2019-12-17 12:02:26 -06:00
Chris Hostetter 33e44b2fd6 SOLR-13696: AwaitsFix RoutedAliasUpdateProcessorTest (and subclasses)
The helper method RoutedAliasUpdateProcessorTest.addDocsAndCommit doesn't garuntee docs have been committed when it returns, causing threading/timing bugs in tests that use it as a gate for making subsequent assertions -- causing a steady stream of jenkins test failures
2019-12-17 11:00:03 -07:00
Dawid Weiss 4b7bb7cf29 SOLR-14103: remove unused dependencies and their checksums, licenses. 2019-12-17 15:52:12 +01:00
Dawid Weiss 0f7a046e85 SOLR-14104: clean up asm license. 2019-12-17 15:11:57 +01:00
Dawid Weiss 868d5b4ae6 SOLR-14104: clean up asm license. 2019-12-17 15:07:44 +01:00
Dawid Weiss 98965b6c98 SOLR-14104: clean up asm license. 2019-12-17 15:07:38 +01:00
Dawid Weiss 0e2a493446 Add transitive Lucene dependencies so that Solr licenses/ folder is (more) consistent with ant. This is an insane hack at the build-level. Mark it for removal once we get rid of ant. 2019-12-17 15:02:08 +01:00
Dawid Weiss 079ddeb1f4 SOLR-14104: Remove a truckload of unused licenses and notice files. 2019-12-17 14:41:12 +01:00
Dawid Weiss 893f802e51 Remove a truckload of unused licenses and notice files. 2019-12-17 14:30:08 +01:00
Dawid Weiss faadb65202 Regenerate checksum for a single dependency once. Add trailing newline for consistency with ant code. 2019-12-17 14:27:25 +01:00