Commit Graph

13092 Commits

Author SHA1 Message Date
Ishan Chattopadhyaya 67e4b0c517 SOLR-13410: Fix for test failure of the newly added test 2019-05-04 20:32:20 +05:30
Ishan Chattopadhyaya 1882a17115 SOLR-13410: Designated overseer wasn't able to rejoin election queue upon restart 2019-05-04 00:29:07 +05:30
Jan Høydahl cdd130ccb6 SOLR-12120: Fix bug in draining queue before shutdown 2019-05-02 23:26:16 +02:00
noble 8908205b42 SOLR-13441: Refactor code to minimize direct use of noggit 2019-05-03 07:20:05 +10:00
Ishan Chattopadhyaya 29a98825d0 SOLR-13348: Speed up collapsing by avoiding scoring of ineligible documents 2019-05-03 02:45:15 +05:30
Ishan Chattopadhyaya ceeac409a5 SOLR-12833: Fix PeerSyncTest and TestInPlaceUpdatesDistrib failures 2019-05-03 02:36:52 +05:30
Ishan Chattopadhyaya 91969f40fe SOLR-13394: Tweaking G1 parameters and adding ref guide documentation 2019-05-03 00:36:32 +05:30
Andrzej Bialecki e54610ce33 SOLR-13427: Delete duplicate package description. 2019-05-02 18:39:21 +02:00
David Smiley 1f91932ba4 SOLR-12833: Test should use ExecutorUtil 2019-05-01 14:30:35 -04:00
moshebla 093990e744 SOLR-12638: ref-guide notes for partial/atomic updates of nested docs 2019-05-01 14:29:42 -04:00
Ishan Chattopadhyaya c808b2f5fe Adding 8.2 version 2019-05-01 15:15:49 +05:30
David Smiley a32decde6a SOLR-12833: DistributedUpdateProcessorTest assumeWorkingMockito() 2019-05-01 00:30:04 -04:00
Andrzej Bialecki 70e090717d SOLR-12833: Avoid unnecessary memory cost when DistributedUpdateProcessor timed-out lock is not used. 2019-04-30 22:31:44 +02:00
Andrzej Bialecki 710e15cec5 SOLR-13427: Add missing package description. 2019-04-30 19:19:49 +02:00
Mikhail Khludnev 5ca0602d28 SOLR-12291: fixing premature completion of async tasks
* extract async tracking methods from OverseerCollectionMessageHandler into the separate class
* replacing hashmap to named list to avoid entry loss
2019-04-30 09:57:42 +03:00
Andrzej Bialecki 6eccf2bf53 SOLR-13427: Support simulating the execution of autoscaling suggestions. 2019-04-29 23:14:38 +02:00
Noble Paul 25bd1cbb82 SOLR-13429: HashBasedRouter logs the entire state.json when a slice is not found 2019-04-30 06:07:51 +10:00
Andrzej Bialecki ced0243a3e SOLR-13407: Fix NPE and be consistent about returning empty instead of null properties. 2019-04-29 12:19:29 +02:00
Shalin Shekhar Mangar f77c56dbc6 SOLR-13432: Add .toString methods to BitDocSet and SortedIntDocSet so that enabling "showItems" on the filter caches shows some useful information about the values in the cache 2019-04-29 12:34:03 +05:30
Ishan Chattopadhyaya 8dd22bc056 SOLR-5970: Fix precommit 2019-04-28 23:29:11 +05:30
Ishan Chattopadhyaya dd9899b1c1 SOLR-5970: Return correct status upon collection creation failure 2019-04-28 23:16:29 +05:30
Ishan Chattopadhyaya 4b49bd99ca SOLR-12248, SOLR-4647: Grouping is broken on docValues-only fields 2019-04-28 23:01:58 +05:30
Erick Erickson a6262af842 SOLR-11035: (at least) 2 distinct failures possible when clients attempt searches during SolrCore reload. More fixes, bad test. 2019-04-28 10:26:01 -04:00
Jason Gerlowski 9d97ef1027 SOLR-13343: Fix minor web UI spacing issue
Closes #592
2019-04-27 10:37:58 -04:00
Kevin Risden 35aeb7f623
SOLR-13414: SolrSchema - Avoid NPE if Luke returns field with no type defined
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-04-26 09:27:47 -04:00
Jan Høydahl ef79dd548d
SOLR-13425: Wrong color in horizontal definition list (#653) 2019-04-25 15:57:16 +02:00
Mikhail Khludnev 6d94631538 SOLR-13081: Let in-place update work with route.field 2019-04-25 14:05:42 +03:00
Ishan Chattopadhyaya 9c77889217 SOLR-13394: Switch default GC from CMS to G1 2019-04-25 13:58:43 +05:30
Erick Erickson 48dc020dda SOLR-13268: Clean up any test failures resulting from defaulting to async logging 2019-04-24 09:23:11 -07:00
Ishan Chattopadhyaya 33c94562a6 SOLR-12167: Throw an exception, instead of just a warning, upon unknown atomic update 2019-04-24 16:20:10 +05:30
Andrzej Bialecki 170f5fb7a3 SOLR-13423: Upgrade RRD4j to version 3.5. 2019-04-24 12:33:48 +02:00
Gus Heck 80d3ac8709 SOLR-13418 - safer synchronization and zk version checking for collection properties 2019-04-23 12:29:08 -04:00
Jan Høydahl 2261b4e8e1 SOLR-12120: Harden AuditLoggerIntegrationTest 2019-04-23 15:18:16 +02:00
Cao Manh Dat bc8985d031 SOLR-13276: Improving CloudHttp2SolrClientTest 2019-04-23 10:07:20 +01:00
Mikhail Khludnev a95e68e13b SOLR-13337: faster /terms response in distributed mode. 2019-04-22 23:26:12 +03:00
Uwe Schindler 377ac573dd SOLR-13415, SOLR-13322: Add CLIO.class file to post.jar 2019-04-22 20:17:53 +02:00
Cao Manh Dat c533988874 SOLR-13413: Adding debug log for HttpConnection 2019-04-22 10:39:05 +01:00
Shalin Shekhar Mangar 4571a2d666 SOLR-13392: Add all solr dependencies to prometheus exporter classpath to make sure that it can start.
SOLR-13234 broke prometheus exporter startup from the startup scripts because there was a mismatch between the dependency list in ant/ivy and those actually added to the classpath by the script. This commit changes the script to add all solr dependencies to the classpath.
2019-04-22 12:18:56 +05:30
Uwe Schindler 5aaa923e36 LUCENE-8738, SOLR-13400: Remove obsolete changes entry (replaced by SOLR-13400) 2019-04-20 02:35:04 +02:00
Erick Erickson d87196c141 SOLR-13400: Replace Observable pattern in TransientSolrCoreCache 2019-04-19 17:00:41 -07:00
Chris Hostetter dbf90a6e7b Reduce the upper bounds on some randomized variables in FullSolrCloudDistribCmdsTest to reduce risk of OOM 2019-04-19 14:48:37 -07:00
Uwe Schindler c70d4700c9 SOLR-12461: Remove obsolete license files 2019-04-19 23:36:35 +02:00
Uwe Schindler 5b0d8877cc SOLR-12461: Remove obsolete checksum file 2019-04-19 23:31:56 +02:00
Chris Hostetter 1c3d23e58a SOLR-13336: fix CloudInspectUtil to use filter to eliminate risk of TooManyClausesException 2019-04-19 10:59:53 -07:00
Tomas Fernandez Lobbe 9f644b1c69 SOLR-13281: Fix NPE in DocExpirationUpdateProcessor 2019-04-18 22:22:26 -07:00
Erick Erickson 2a3bd8e864 SOLR-11035: (at least) 2 distinct failures possible when clients attempt searches during SolrCore reload bandaid for DocValuesNotIndexedTest 2019-04-18 21:38:01 -07:00
Andrzej Bialecki bd8905150d SOLR-12461: Upgrade Dropwizard Metrics to 4.0.5 release. 2019-04-18 19:08:20 +02:00
Andrzej Bialecki f46ba5227e SOLR-13407: Reject update requests sent to non-routed multi collection aliases. 2019-04-18 14:53:06 +02:00
erick a9771a5849 SOLR-13408: Cannot start/stop DaemonStream repeatedly, other API improvements 2019-04-17 16:02:06 -07:00
Uwe Schindler fb28958bc8 LUCENE-8738: Add Java 11 under "Getting Started" in CHANGES.txt 2019-04-17 11:22:52 +02:00
Uwe Schindler df27ccf01d SOLR-13409: Disable HTML directory listings in admin interface to prevent possible security issues 2019-04-17 11:04:13 +02:00
Uwe Schindler faaee86efb LUCENE-8738: Move to Java 11 as minimum Java version (merged branch: jira/LUCENE-8738)
Co-authored-by: Adrien Grand <jpountz@apache.org>
2019-04-16 14:00:09 +02:00
Uwe Schindler 0a2b85534a SOLR-12121: Fix precommit failure 2019-04-16 08:36:52 +02:00
Jan Høydahl 9707bb6fa9 SOLR-12371: Editing authorization config via REST API now works in standalone mode 2019-04-15 21:09:30 +02:00
Simon Willnauer a302be381e
LUCENE-8671: Introduce Reader attributes (#640)
Reader attributes allows a per IndexReader configuration of codec internals.
For instance this allows a per reader configuration if FSTs are loaded into memory or are left
on disk.
2019-04-15 20:39:36 +02:00
markrmiller ecbf7daf56 SOLR-13386: OverseerTaskQueue#remove should not throw an exception when no node exists after an exists check and the Overseer work loop should not allow free spinning the loop when it hits a KeeperException. 2019-04-15 12:53:36 -05:00
Chris Hostetter d90034f0d6 SOLR-13336: add maxBooleanClauses (default to 1024) setting to solr.xml, reverting previous effective value of Integer.MAX_VALUE-1, to restrict risk of pathalogical query expansion. 2019-04-15 10:27:08 -07:00
Noble Paul e783207535 SOLR-13395: make DebugComponent.getRequestId() public 2019-04-15 11:10:06 +10:00
Christine Poerschke fe1a109476 SOLR-13366: Clarify 'Invalid stage name' warning logging in AutoScalingConfig 2019-04-12 16:01:55 +01:00
Joel Bernstein 6c62fbf25f SOLR-13391: Update CHANGES.txt 2019-04-12 10:06:38 -04:00
Joel Bernstein 58001bfc87 SOLR-13391: Add variance and standard deviation stream evaluators
Squashed commit of the following:

commit 406d4b959a42e4830ac1c52836ccbcfc1b614b46
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:03:34 2019 +0200

    added missing package

commit 32c239687c39c5da3e4f2d0f25df73127331fa99
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:03:14 2019 +0200

    added package

commit 7b3f9bd415002969a4ec5d87a9ffbfd6fcff6e92
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:02:28 2019 +0200

    added var and stddev functions

commit 77c4f9fdd9f111862a55b645aad960457291414c
Author: Nazerke <seinaz1997@gmail.com>
Date:   Fri Apr 12 14:00:59 2019 +0200

    added test for the variance and standard deviation stream evaluators

commit 2d9692c178590b65e46cfd9e04ca0384c7d39ec5
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:50:30 2019 +0200

    added var and stddev new evaluators

commit d265225747bce9a0eabd713994ddd4990dbbbfa2
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:49:23 2019 +0200

    variance streaming evaluator

commit a3330064bb62b5723b9125334ef1d61fc3b098d3
Author: naz <nazerke.seidan@cloudera.com>
Date:   Wed Apr 10 19:49:02 2019 +0200

    standard deviation streaming evaluator
2019-04-12 09:37:50 -04:00
Jan Høydahl 03f5a5e7a1 SOLR-13398: Move log "Processing SSL Credential Provider chain" from INFO to DEBUG to prevent leaking into bin/solr printout 2019-04-12 11:54:40 +02:00
Jan Høydahl f2c59db273
SOLR-12860: MetricsHistoryHandler now always uses PKI Auth (#642)
* SOLR-12860: MetricsHistoryHandler now uses PKI Auth for metrics collection in background thread
2019-04-12 10:21:13 +02:00
Jan Høydahl 3b3879d880 SOLR-12121: Refresh JWK from IdP on invalid sig. Some logging improvements. Minor test fixes 2019-04-12 09:49:11 +02:00
Chris Hostetter 980fd7d5c5 SOLR-13393: Fixed ZkClientClusterStateProvider to prevent risk of leaking ZkStateReader/threads when processing concurrent requests during shutdown.
This primarily affected tests, but may have also caused odd errors/delays when restart/shutting down solr nodes.
2019-04-11 14:22:50 -07:00
Cao Manh Dat a67a941e19 SOLR-13339: Prevent recovery, fetching index being kicked off after SolrCores already closed 2019-04-11 09:21:14 +01:00
Andrzej Bialecki 02c4503f8c SOLR-13262: Add collection RENAME command and support using aliases in most collection admin commands. 2019-04-10 18:56:39 +02:00
Uwe Schindler eafe42f090 SOLR-13388: Fix FileExchangeRateProvider to be a public class, as it appears in schema.xml 2019-04-10 18:53:51 +02:00
Andrzej Bialecki d40a6d4e95 Release static solrClient after the test is done (occasionally caused failures on jenkins). 2019-04-10 12:26:02 +02:00
Moshe 8527ec11af SOLR-12638: Partial/Atomic updates of nested docs.
and [child] now works in RTG.
2019-04-10 03:02:59 -04:00
Gus Heck 4a93199803 SOLR-13370 - Trying reduction of cluster size, but not clear that
should help from local tests/profile, but maybe it helps in more memory
constrained build servers, this and prior version both beasted success
10 rounds of 5 on a machine with lots of memory.
2019-04-09 10:02:16 -04:00
Jan Høydahl 3e628b562c SOLR-12120: Do not fail the main request if synchronous auditing fails, log ERROR
Document that sub classes should call super.close() or a new waitForQueueToDrain() before closing itself
2019-04-09 14:25:52 +02:00
Chris Hostetter 2533fd1ede SOLR-13369: disable TriLevelCompositeIdRoutingTest until someone who actually understands how the /bits option is *suppose* to work can assess it to determine if the test is flawed or it there is a bug in the underlying CompositeIdRouter 2019-04-08 18:17:29 -07:00
Chris Hostetter ab55b6386b SOLR-13376: Disable test until it can be re-written to reflect actual expected behavior of how/when node markers will be cleaned up 2019-04-08 18:06:09 -07:00
Chris Hostetter 6bc360ee67 BlockCacheTest uses BlockCache which uses the common ForkJoinPool so we need to ensure the SolrIgnoredThreadsFilter is used 2019-04-08 10:57:02 -07:00
Andrzej Bialecki 0859be134d SOLR-13368: Tentative fix for a race condition in managed schema initialization. 2019-04-08 10:47:29 +02:00
Cassandra Targett ef7be67ba1 Ref Guide: fix numbered list to resolve build warnings 2019-04-06 08:10:44 -05:00
Chris Hostetter 0b7421eca6 set the lastmod of the files to be deleted to be 1 day ago so that '-remove_old_solr_logs 0' doesn't run afoul of coarse granularity timestamps on windows jenkins machines if the test starts and runs quickly 2019-04-05 16:45:41 -07:00
Chris Hostetter 37166ce4e9 Use FSDirectory for TestDocTermOrdsUninvertLimit to reduce the amount of RAM the test needs.
This lowers the risk of OOM, w/o needing to sacrifice testing of how the randomized merging/segments might impact the uninversion
2019-04-05 15:06:50 -07:00
Erick Erickson 7602f3c78e SOLR-12809: Document recommended Java/Solr combinations 2019-04-05 10:20:57 -07:00
Erick Erickson 03d76c611b SOLR-13075: Harden SaslZkACLProviderTest. Put AwaitsFix back 2019-04-05 08:47:36 -07:00
Joel Bernstein 32fe892293 SOLR-13374: Update CHANGES.txt 2019-04-05 09:08:30 -04:00
Joel Bernstein 46131e9cda SOLR-13374: Add fetchSize parameter to the jdbc Streaming Expression 2019-04-05 08:52:52 -04:00
Jan Høydahl aadc94a6e3 SOLR-12120: Harden AuditLoggerIntegrationTest, timing issues 2019-04-05 10:35:34 +02:00
Simon Willnauer 1ec229b604
LUCENE-8671: Expose FST off/on-heap options on Lucene50PostingsFormat (#613)
Before we can expose options to configure this postings format
on a per-reader basis we need to expose the option to load the terms
index FST off or on heap on the postings format. This already allows to
change the default in a per-field posting format if an expert user
wants to change the defaults. This essentially provides the ability to change
defaults globally while still involving some glue code.
2019-04-04 16:59:37 +02:00
Jan Høydahl 96ef35cd2c SOLR-13344: Admin UI inaccessible with RuleBasedAuthorizationPlugin 2019-04-04 16:07:23 +02:00
Jan Høydahl 361502da8a SOLR-12120: New AuditLoggerPlugin type allowing custom Audit logger plugins 2019-04-04 15:48:51 +02:00
Jason Gerlowski 9b44fba0d4 SOLR-13331: Fix AtomicUpdate 'remove' ops in SolrJ
The racent change introducing ByteArrayUtf8CharSequence altered the
NamedLists produced by atomic-update requests so that they include
instances of this class for requests coming in as javabin.  This is a
problem for 'remove' atomic-updates, which need to be able to compare
these ByteArrayUtf8CharSequence instances with existing field values
represented as Strings.  equals() would always return false, and
'remove' operations would have no effect.

This commit converts items as necessary to allow atomic-update
operations to work as expected.
2019-04-04 06:51:28 -04:00
Chris Hostetter 3fe4d0a30a Fix test to use solr.disable.shardsWhitelist=true rather then trying to whitelist the set of servers
The previous version of this test had a chicken/egg problem (needed to init the servers w/the whitelist but didn't know the port nums until after init)

that caused it to require 'restarting' the servers -- leading to the possibility of 'Address already in use' errors from jenkins machines if the OS reclaimed the port between the stop/start of the jetty instance
2019-04-03 15:15:03 -07:00
Kevin Risden 6596ed1c16
SOLR-13075: Harden SaslZkACLProviderTest (Kevin Risden, Hrishikesh Gadre, Peter Cseh)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-04-03 10:14:49 -04:00
Jason Gerlowski ec1d13a372 SOLR-13355: Add missing CHANGES.txt entry 2019-04-03 07:42:27 -04:00
erick 3810d5e7ac SOLR-13075: Harden SaslZkACLProviderTest. Testing new ZK version 2019-04-02 21:45:30 -07:00
erick 58376874aa SOLR-13363: Upgrade to ZooKeeper 3.4.14 2019-04-02 20:18:01 -07:00
Gus Heck 2d690885e5 SOLR-13322 - let forbidden apis check for sysout in solr core 2019-04-02 22:45:33 -04:00
Christine Poerschke 1bf413ebc8 minor stream-decorator-reference.adoc tweak w.r.t. parallel function's partitionKeys 2019-04-02 19:28:54 +01:00
Christine Poerschke c62db30597 s/reduce/rollup wording correction in stream-decorator-reference.adoc 2019-04-02 19:25:52 +01:00
Jason Gerlowski 2480b74887 SOLR-13362: Add 'includeIndexFieldFlags' in LukeRequest 2019-04-01 20:40:18 -04:00
Chris Hostetter 1071d09336 SOLR-13352: Remove risk of deadlock/threadleak when shutting down an Overseer(TriggerThread) 2019-04-01 10:34:51 -07:00
Erick Erickson e04a28e140 SOLR-12028: BadApple and AwaitsFix annotations usage 2019-04-01 09:27:33 -07:00
Cassandra Targett cc23cd9d55 SOLR-13259: clarify language around *must* reindex vs *should* reindex 2019-04-01 10:06:01 -05:00
Kevin Risden a99cec0402
SOLR-13359: Make UpdateHandler support other prefixes (besides hdfs:/)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-31 10:45:57 -04:00
Jason Gerlowski 1204d212d1 Improve docs on using basic-auth in SolrJ 2019-03-31 10:36:50 -04:00
Kevin Risden 42f8203fc3
SOLR-11473: Make HDFSDirectoryFactory support other prefixes (besides hdfs:/)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-30 14:26:00 -04:00
Jason Gerlowski 07b37ff26b SOLR-13355: Obey 'ALL' for handlers with other predefined perms
Prior to this commit, RuleBasedAuthorizationPlugin would check for the
predefined 'ALL' permission only when the endpoint being hit wasn't
associated with another predefined-permission.

This resulted in some very unintuitive behavior. For example, the
permission {name:all, role:admin} would correctly prevent a
role:foo user from accessing /admin/info/properties, but would allow
write access to /admin/authorization because of the SECURITY_EDIT
predefined perm associated with that endpoint.

This commit fixes this bug so that the 'all' permission is always
consulted whether or not the endpoint is associated with other predefined
permissions.
2019-03-29 22:33:12 -04:00
Jason Gerlowski 5fe03bcd01 SOLR-13355: Small refactors to RuleBasedAuthorizationPlugin 2019-03-29 22:33:00 -04:00
erick b2941ff0da SOLR-13349:High CPU usage in Solr due to Java 8 bug 2019-03-28 15:49:54 -07:00
Kevin Risden 8d658a8cfb
SOLR-13353: Add SolrCli AuthTool test
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-28 14:08:07 -04:00
Kevin Risden 90d983cf7c
SOLR-13351: Workaround for VELOCITY-908
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-27 17:42:55 -04:00
Joel Bernstein 98cadcf9f6 SOLR-13294: Change test file name 2019-03-27 15:36:47 -04:00
Joel Bernstein d407d556cc SOLR-13294: TestSQLHandler failures on windows jenkins machines 2019-03-27 15:36:47 -04:00
Ishan Chattopadhyaya e7939d5907 SOLR-7414: CSVResponseWriter & XLSXResponseWriter return empty field when fl alias is combined with * selector 2019-03-27 14:38:36 +05:30
Henning Andersen 04afdb6442 LUCENE-8735: Avoid FileAlreadyExistsException on windows. (#619)
FilterDirectory.getPendingDeletions() did not delegate the call, which
resulted in a new IndexWriter on same directory not considering pending
delete files. This could in turn result in a FileAlreadyExistsException
when running windows.
2019-03-26 14:56:45 +01:00
Cassandra Targett 65165c7c87 SOLR-11959: Add docs on CDCR limitation with Basic Auth 2019-03-26 08:00:39 -05:00
Kevin Risden 361d1e84ce
SOLR-13112: Upgrade jackson to 2.9.8
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-25 10:38:00 -04:00
Kevin Risden 11542aebce
Fix solr/CHANGES.txt
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-25 10:21:02 -04:00
Kevin Risden 4e230388ba
SOLR-13335: Upgrade to velocity 2.0 and velocity-tools 3.0
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-25 09:58:44 -04:00
Kevin Risden 0231c1ecb6
SOLR-13342: Remove dom4j from Solr
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-25 08:15:01 -04:00
Gus Heck dad414ca22 SOLR-13323 - remove unused csv related classes/tests 2019-03-24 20:01:46 -04:00
Gus Heck c60685f9e4 SOLR-13324 - Don't swallow/print exception in URLClassifyProcessor anymore 2019-03-24 19:07:26 -04:00
Shalin Shekhar Mangar bca22d58e2 SOLR-11126: Move change log entry under 8.0 2019-03-22 07:31:06 +05:30
Andrzej Bialecki 863d34bff5 SOLR-13322: Properly log exceptions. 2019-03-21 22:22:03 +01:00
Kevin Risden 6222abf448
SOLR-9079: Remove commons-lang as a dependency
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-20 19:37:19 -04:00
David Smiley 85a702cdff SOLR-13253: avoid using IndexSchema.getResourceLoader for non-schema things.
Furthermore it's reference to SolrConfig was removed.
2019-03-19 13:51:44 -04:00
Bar Rotstein 5b7866b085 SOLR-12955: Refactored DistributedUpdateProcessor to put SolrCloud specifics into a subclass
Closes #528
2019-03-19 13:26:31 -04:00
Andrzej Bialecki 6f2b7bf5c0 SOLR-11127: REINDEXCOLLECTION command for re-indexing of existing collections. 2019-03-19 13:42:59 +01:00
Kevin Risden 9fea3060b9
SOLR-8033: Remove debug if branch in HdfsTransactionLog
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-19 06:20:09 -04:00
Kevin Risden cf828163bd
SOLR-13330: Improve HDFS tests
Related JIRAs:
* SOLR-11010
* SOLR-11381
* SOLR-12040
* SOLR-13297

Changes:
* Consolidate hdfs configuration into HdfsTestUtil
* Ensure socketTimeout long enough for HDFS tests
* Ensure HdfsTestUtil.getClientConfiguration used in tests
* Replace deprecated HDFS calls
* Use try-with-resources to ensure closing of HDFS resources

Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-18 15:25:36 -04:00
erick 3ac07b8dfb SOLR-13268: Patch that flushes when shutting down 2019-03-18 11:52:39 -07:00
Chris Hostetter 5c143022e7 SOLR-12923: Mea culpa: Remove useless import of java.lang... that breaks precommit 2019-03-15 14:39:19 -07:00
Chris Hostetter 1a54c6b19d SOLR-12923: fix SimClusterStateProvider to use lock.lockInterruptibly() exclusively, and make SimCloudManager's Callable checks tollerant of Callables that may have failed related to interrupts w/o explicitly throwing InterruptedException 2019-03-15 12:06:53 -07:00
Chris Hostetter c79aeee5f9 SOLR-12923: tweak the randomization in testCreateLargeSimCollections to reduce the max possible totalCores
also decrease the number of iters while increase the cluster shape wait time to reduce the risk of spurious failures on machines under heavy contention w/o making the the test any slower on average
2019-03-15 10:43:28 -07:00
Jan Høydahl 8f29d1eaad
SOLR-13244: Nodes view fails when a node is temporarily down 2019-03-15 13:30:02 +01:00
Andrzej Bialecki 571b307266 SOLR-13292: Fix a logic bug when point types are present, add more details to the unit test. 2019-03-15 11:52:37 +01:00
Chris Hostetter 76babf876a SOLR-12923: Fix some issues w/concurrency and exception swallowing in SimClusterStateProvider/SimCloudManager
There are 3 tightly related bug fixes in these changes:

1) ConcurrentModificationExceptions were being thrown by some SimClusterStateProvider methods when
   creating collections/replicas due to the use of ArrayLists nodeReplicaMap. These ArrayLists were changed
   to use synchronizedList wrappers.
2) The Exceptions from #1 were being swallowed/hidden by code using SimCloudManager.submit() w/o checking
   the result of the resulting Future object. (As a result, tests waiting for a particular ClusterShape
   would timeout regardless of how long they waited.)   To protect against "silent" failures like this,
   this SimCloudManager.submit() has been updated to wrap all input Callables such that any uncaught errors
   will be logged and "counted."  SimSolrCloudTestCase will ensure a suite level failure if any such failures
   are counted.
3) The changes in #2 exposed additional concurrency problems with the Callables involved in leader election:
   These would frequently throw IllegalStateExceptions due to assumptions about the state/existence of
   replicas when the Callables were created vs when they were later run -- notably a Callable may have been
   created that held a reference to a Slice, but by the time that Callable was run the collection (or a
   node, etc...) refered to by that Slice may have been deleted.  While fixing this, the leader election
   logic was also cleaned up such that adding a replica only triggers leader election for that shard, not
   every shard in the collection.

While auditing this code, cleanup was also done to ensure all usage of SimClusterStateProvider.lock was
also cleaned up to remove all risky points where an exception may have been possible after aquiring the
lock but before the try/finally that ensured it would be unlocked.
2019-03-14 22:27:48 -07:00
Alan Woodward fbd05167f4
LUCENE-3041: QueryVisitor (#581)
This commit adds an introspection API to Query, allowing users to traverse
the nested structure of a query and examine its leaves.  It replaces the existing
`extractTerms` method on Weight, and alters some highlighting code to use
the new API
2019-03-14 15:04:33 +00:00
Moshe c2a6772f1e SOLR-13129: nested docs: add more/better documentation in Solr ref-guide 2019-03-14 09:11:24 -04:00
Jan Høydahl a18aa2118b SOLR-12121: Remove a System.out.println in JWTAuthPlugin 2019-03-14 10:48:09 +01:00
Shalin Shekhar Mangar 6d0386c901 SOLR-13234: Fix for turkish locales
WhenSolrExporterIntegrationTest.jvmMetrics ran on a JVM with the Turkish locale, (test seed: 62880F3B9F140C89). The JVM metric for terminated thread-count has a dotless-i e.g. termınated.
This causes the check for matching metrics to fail.

We could normalize the text in this case, however I think it's better to ensure we have the correct total number of JVM thread metrics rather than looking at Prometheus labels which maybe localized.

This closes #605.
2019-03-14 11:10:49 +05:30
Gus Heck d8f2a02fdb SOLR-13131 Category Routed Aliases 2019-03-13 01:32:23 -04:00
Gus Heck cf88f54a29 Remove inadvertently included println 2019-03-12 16:09:04 -04:00
Gus Heck 9edc557f45 SOLR-12891 MacroExpander will no longer will expand URL parameters by
default inside of the 'expr' parameter, add InjectionDefense class
for safer handling of untrusted data in streaming expressions and add
-DStreamingExpressionMacros system property to revert to legacy behavior
2019-03-12 10:46:30 -04:00
Erick Erickson b893548d97 SOLR-13268: Clean up any test failures resulting from defaulting to async logging. Put TestXmlQParser back 2019-03-11 21:40:23 -07:00
Erick Erickson 28c8171fe6 SOLR-12732: TestLogWatcher failure on Jenkins. Deal with superclass logging bleeding into first watcher in the test 2019-03-11 12:55:08 -07:00
Chris Hostetter 7eb728a611 SOLR-13300: DistributedFacetExistsSmallTest should not attempt to compare results of a query that is known to differ in behavior in distributed mode 2019-03-11 10:02:46 -07:00
Kevin Risden 6777af074f
SOLR-13307: Ensure HDFS tests clear System properties they set (Kevin Risden)
Signed-off-by: Kevin Risden <krisden@apache.org>
2019-03-11 11:13:37 -04:00
Mikhail Khludnev e353dcfe7d SOLR-13284: fallback to json instead of NPE and 500 code, when wt is omitted or wrong. 2019-03-10 23:10:38 +03:00
erick 9272c29539 SOLR-13268: Clean up any test failures resulting from defaulting to async logging 2019-03-10 11:05:00 -07:00
Andrzej Bialecki 27df824a4b SOLR-13292: Provide extended per-segment status of a collection. 2019-03-09 14:08:01 +01:00
Erick Erickson 8c6e305365 SOLR-12732: TestLogWatcher failure on Jenkins. Added more logging 2019-03-08 21:40:06 -08:00
Chris Hostetter 3b2d836142 Merge remote-tracking branch 'refs/remotes/origin/master' 2019-03-08 14:54:54 -07:00