7570 Commits

Author SHA1 Message Date
Jan Høydahl
d05e7b3df4 SOLR-13398: Move log "Processing SSL Credential Provider chain" from INFO to DEBUG to prevent leaking into bin/solr printout
(cherry picked from commit 03f5a5e7a1d75d6502087dbcc1ca86450875a233)
2019-04-12 11:55:22 +02:00
Jan Høydahl
de432003a7 SOLR-12860: MetricsHistoryHandler now uses PKI Auth for metrics collection in background thread
(cherry picked from commit f2c59db2736ecdded9601acf0549094769781a4a)
2019-04-12 10:23:08 +02:00
Jan Høydahl
43f5e6170c SOLR-12121: Refresh JWK from IdP on invalid sig. Some logging improvements. Minor test fixes
(cherry picked from commit 3b3879d8809685ef611101e1b61295982bd2db23)
2019-04-12 09:51:21 +02:00
Cao Manh Dat
5691f87ecc SOLR-13339: Prevent recovery, fetching index being kicked off after SolrCores already closed 2019-04-11 09:22:35 +01:00
Andrzej Bialecki
f83098752c SOLR-13262: Add collection RENAME command and support using aliases in most collection admin commands. 2019-04-10 18:57:16 +02:00
Uwe Schindler
4fe1f410f4 SOLR-13388: Fix FileExchangeRateProvider to be a public class, as it appears in schema.xml 2019-04-10 18:55:42 +02:00
Andrzej Bialecki
a81d2c4a45 Release static solrClient after the test is done (occasionally caused failures on jenkins). 2019-04-10 12:26:33 +02:00
Moshe
d01b13c8ed SOLR-12638: Partial/Atomic updates of nested docs.
and [child] now works in RTG.

(cherry picked from commit 8527ec11af8099f86953ffad1182ad43c752f95b)
2019-04-10 03:03:58 -04:00
Jan Høydahl
77a4604c39 SOLR-12120: Do not fail the main request if synchronous auditing fails, log ERROR
Document that sub classes should call super.close() or a new waitForQueueToDrain() before closing itself

(cherry picked from commit 3e628b562cb57349503e8ccdfe4909aedcbe78b2)
2019-04-09 15:39:19 +02:00
Chris Hostetter
90ae5c1956 SOLR-13369: disable TriLevelCompositeIdRoutingTest until someone who actually understands how the /bits option is *suppose* to work can assess it to determine if the test is flawed or it there is a bug in the underlying CompositeIdRouter
(cherry picked from commit 2533fd1edeb5cccfd835d9999adcd288f98722b5)
2019-04-08 18:17:39 -07:00
Chris Hostetter
deb7987272 SOLR-13376: Disable test until it can be re-written to reflect actual expected behavior of how/when node markers will be cleaned up
(cherry picked from commit ab55b6386b701ec91afb92b269decd081f398ca8)
2019-04-08 18:06:21 -07:00
Chris Hostetter
ea2a91ef1f BlockCacheTest uses BlockCache which uses the common ForkJoinPool so we need to ensure the SolrIgnoredThreadsFilter is used
(cherry picked from commit 6bc360ee67582e42c0211ac1767a9c0ed8bfaad3)
2019-04-08 10:57:23 -07:00
Andrzej Bialecki
f3cdd326bd SOLR-13368: Tentative fix for a race condition in managed schema initialization. 2019-04-08 11:30:36 +02:00
Chris Hostetter
afe1df1c22 set the lastmod of the files to be deleted to be 1 day ago so that '-remove_old_solr_logs 0' doesn't run afoul of coarse granularity timestamps on windows jenkins machines if the test starts and runs quickly
(cherry picked from commit 0b7421eca6715602c6233106a7501eaa29a91eb5)
2019-04-05 16:46:01 -07:00
Chris Hostetter
fe1a994fe2 Use FSDirectory for TestDocTermOrdsUninvertLimit to reduce the amount of RAM the test needs.
This lowers the risk of OOM, w/o needing to sacrifice testing of how the randomized merging/segments might impact the uninversion

(cherry picked from commit 37166ce4e9c4b9595f4c39be9b7b6d0947819f85)
2019-04-05 15:07:23 -07:00
Erick Erickson
18dc7a5c96 SOLR-13075: Harden SaslZkACLProviderTest. Put AwaitsFix back
(cherry picked from commit 03d76c611b2ebe368edd4e3245d5be2a36cd73b0)
2019-04-05 08:49:43 -07:00
Jan Høydahl
4d95746b01 SOLR-12120: Harden AuditLoggerIntegrationTest, timing issues
(cherry picked from commit aadc94a6e3887955ed08439d32e29fe31b622a45)
2019-04-05 11:35:26 +02:00
Jan Høydahl
b0f4b5dc75 SOLR-12120: New AuditLoggerPlugin type allowing custom Audit logger plugins
(cherry picked from commit 361502da8ade7dbb4516da9816e8bafe22eb79a3)
2019-04-05 11:34:03 +02:00
Simon Willnauer
28e8a30b53 LUCENE-8671: Expose FST off/on-heap options on Lucene50PostingsFormat (#613)
Before we can expose options to configure this postings format
on a per-reader basis we need to expose the option to load the terms
index FST off or on heap on the postings format. This already allows to
change the default in a per-field posting format if an expert user
wants to change the defaults. This essentially provides the ability to change
defaults globally while still involving some glue code.
2019-04-04 17:00:32 +02:00
Jan Høydahl
9dd51915fa SOLR-13344: Admin UI inaccessible with RuleBasedAuthorizationPlugin
(cherry picked from commit 96ef35cd2cac71b8cc282e85419ca9846f3580e3)
2019-04-04 16:26:19 +02:00
Jason Gerlowski
4b86a39680 SOLR-13331: Fix AtomicUpdate 'remove' ops in SolrJ
The racent change introducing ByteArrayUtf8CharSequence altered the
NamedLists produced by atomic-update requests so that they include
instances of this class for requests coming in as javabin.  This is a
problem for 'remove' atomic-updates, which need to be able to compare
these ByteArrayUtf8CharSequence instances with existing field values
represented as Strings.  equals() would always return false, and
'remove' operations would have no effect.

This commit converts items as necessary to allow atomic-update
operations to work as expected.
2019-04-04 06:53:01 -04:00
Chris Hostetter
de1f62e52f Fix test to use solr.disable.shardsWhitelist=true rather then trying to whitelist the set of servers
The previous version of this test had a chicken/egg problem (needed to init the servers w/the whitelist but didn't know the port nums until after init)

that caused it to require 'restarting' the servers -- leading to the possibility of 'Address already in use' errors from jenkins machines if the OS reclaimed the port between the stop/start of the jetty instance

(cherry picked from commit 3fe4d0a30aab2fbe979c5d42014ac7d78260d0a4)
2019-04-03 15:15:36 -07:00
Kevin Risden
9f2e04b3f2
SOLR-13075: Harden SaslZkACLProviderTest (Kevin Risden, Hrishikesh Gadre, Peter Cseh)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-04-03 11:09:24 -04:00
Jason Gerlowski
d5b9fbee37 SOLR-13355: Obey 'ALL' for handlers with other predefined perms
Prior to this commit, RuleBasedAuthorizationPlugin would check for the
predefined 'ALL' permission only when the endpoint being hit wasn't
associated with another predefined-permission.

This resulted in some very unintuitive behavior. For example, the
permission {name:all, role:admin} would correctly prevent a
role:foo user from accessing /admin/info/properties, but would allow
write access to /admin/authorization because of the SECURITY_EDIT
predefined perm associated with that endpoint.

This commit fixes this bug so that the 'all' permission is always
consulted whether or not the endpoint is associated with other predefined
permissions.
2019-04-03 07:34:49 -04:00
Jason Gerlowski
68918206f5 SOLR-13355: Small refactors to RuleBasedAuthorizationPlugin 2019-04-03 07:34:37 -04:00
erick
a248bc209e SOLR-13075: Harden SaslZkACLProviderTest. Testing new ZK version
(cherry picked from commit 3810d5e)
2019-04-02 21:46:08 -07:00
Chris Hostetter
c18da4c6bc SOLR-13352: Remove risk of deadlock/threadleak when shutting down an Overseer(TriggerThread)
(cherry picked from commit 1071d093360b2c5869a918de743c7089952094f4)
2019-04-01 10:35:12 -07:00
Erick Erickson
d420382d04 SOLR-12028: BadApple and AwaitsFix annotations usage
(cherry picked from commit e04a28e1400514e104a867f5d6c76f8761ff348a)
2019-04-01 09:28:25 -07:00
Kevin Risden
1ad668e0bf
SOLR-13359: Make UpdateHandler support other prefixes (besides hdfs:/)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-31 10:47:17 -04:00
Kevin Risden
ae95487db6
SOLR-11473: Make HDFSDirectoryFactory support other prefixes (besides hdfs:/)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-30 14:27:32 -04:00
erick
03a3562f78 SOLR-13349:High CPU usage in Solr due to Java 8 bug
(cherry picked from commit b2941ff)
2019-03-28 15:51:14 -07:00
Kevin Risden
e99fd063b0
SOLR-13353: Add SolrCli AuthTool test
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-28 18:36:33 -04:00
Joel Bernstein
843763db06 SOLR-13294: Change test file name 2019-03-27 15:50:29 -04:00
Joel Bernstein
168e409d6d SOLR-13294: TestSQLHandler failures on windows jenkins machines 2019-03-27 15:50:08 -04:00
Ishan Chattopadhyaya
b08566cacc SOLR-7414: CSVResponseWriter & XLSXResponseWriter return empty field when fl alias is combined with * selector 2019-03-27 16:29:25 +05:30
Henning Andersen
251d64a557 LUCENE-8735: Avoid FileAlreadyExistsException on windows. (#619)
FilterDirectory.getPendingDeletions() did not delegate the call, which
resulted in a new IndexWriter on same directory not considering pending
delete files. This could in turn result in a FileAlreadyExistsException
when running windows.
2019-03-26 15:04:52 +01:00
Kevin Risden
862a755d67
SOLR-13342: Remove dom4j from Solr
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-25 08:31:26 -04:00
Gus Heck
cbaa68e9c0 sysout checking SOLR-13322 2019-03-24 21:29:16 -04:00
Gus Heck
33edce88f1 SOLR-13323 - remove unused csv related classes/tests 2019-03-24 20:35:15 -04:00
Andrzej Bialecki
62c6e8d5d9 SOLR-13322: Properly log exceptions. 2019-03-21 22:22:34 +01:00
Kevin Risden
96c293ec1b
SOLR-9079: Remove commons-lang as a dependency
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-20 19:51:34 -04:00
David Smiley
8f25ded16f SOLR-13253: avoid using IndexSchema.getResourceLoader for non-schema things.
Furthermore it's reference to SolrConfig was removed.

(cherry picked from commit 85a702cdff23a6352945dd78eb54ff6db68f6965)
2019-03-19 13:52:38 -04:00
Bar Rotstein
de58717183 SOLR-12955: Refactored DistributedUpdateProcessor to put SolrCloud specifics into a subclass
Closes #528

(cherry picked from commit 5b7866b0851eff66cb7e929beef5249e3c72ac36)
2019-03-19 13:28:27 -04:00
Andrzej Bialecki
b778417054 SOLR-11127: REINDEXCOLLECTION command for re-indexing of existing collections. 2019-03-19 13:47:44 +01:00
Kevin Risden
105979fb4c
SOLR-8033: Remove debug if branch in HdfsTransactionLog
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-19 06:20:47 -04:00
Kevin Risden
6064b03ac6
SOLR-13330: Improve HDFS tests
Related JIRAs:
* SOLR-11010
* SOLR-11381
* SOLR-12040
* SOLR-13297

Changes:
* Consolidate hdfs configuration into HdfsTestUtil
* Ensure socketTimeout long enough for HDFS tests
* Ensure HdfsTestUtil.getClientConfiguration used in tests
* Replace deprecated HDFS calls
* Use try-with-resources to ensure closing of HDFS resources

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-19 05:27:46 -04:00
erick
0894e39ceb SOLR-13268: Patch that flushes when shutting down 2019-03-18 11:53:54 -07:00
Chris Hostetter
695bfa3c90 SOLR-12923: Mea culpa: Remove useless import of java.lang... that breaks precommit
(cherry picked from commit 5c143022e7abcdf14a570786afec4ff099fd581c)
2019-03-15 14:39:42 -07:00
Chris Hostetter
87ec0c3600 SOLR-12923: fix SimClusterStateProvider to use lock.lockInterruptibly() exclusively, and make SimCloudManager's Callable checks tollerant of Callables that may have failed related to interrupts w/o explicitly throwing InterruptedException
(cherry picked from commit 1a54c6b19db9dcb1081e43614bf479e0ac7bf177)
2019-03-15 14:24:07 -07:00
Chris Hostetter
0ac45c1668 SOLR-12923: tweak the randomization in testCreateLargeSimCollections to reduce the max possible totalCores
also decrease the number of iters while increase the cluster shape wait time to reduce the risk of spurious failures on machines under heavy contention w/o making the the test any slower on average

(cherry picked from commit c79aeee5f9a013c280a76a8d6b04bea63f212909)
2019-03-15 14:24:07 -07:00