Apache
/
lucene
mirror of https://github.com/apache/lucene.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
31,868 Commits 29 Branches 469 Tags 751 MiB
Commit Graph

13102 Commits

Author SHA1 Message Date
Jason Gerlowski ec1d13a372 SOLR-13355: Add missing CHANGES.txt entry 2019-04-03 07:42:27 -04:00
erick 3810d5e7ac SOLR-13075: Harden SaslZkACLProviderTest. Testing new ZK version 2019-04-02 21:45:30 -07:00
erick 58376874aa SOLR-13363: Upgrade to ZooKeeper 3.4.14 2019-04-02 20:18:01 -07:00
Gus Heck 2d690885e5 SOLR-13322 - let forbidden apis check for sysout in solr core 2019-04-02 22:45:33 -04:00
Christine Poerschke 1bf413ebc8 minor stream-decorator-reference.adoc tweak w.r.t. parallel function's partitionKeys 2019-04-02 19:28:54 +01:00
Christine Poerschke c62db30597 s/reduce/rollup wording correction in stream-decorator-reference.adoc 2019-04-02 19:25:52 +01:00
Jason Gerlowski 2480b74887 SOLR-13362: Add 'includeIndexFieldFlags' in LukeRequest 2019-04-01 20:40:18 -04:00
Chris Hostetter 1071d09336 SOLR-13352: Remove risk of deadlock/threadleak when shutting down an Overseer(TriggerThread) 2019-04-01 10:34:51 -07:00
Erick Erickson e04a28e140 SOLR-12028: BadApple and AwaitsFix annotations usage 2019-04-01 09:27:33 -07:00
Cassandra Targett cc23cd9d55 SOLR-13259: clarify language around *must* reindex vs *should* reindex 2019-04-01 10:06:01 -05:00
Kevin Risden a99cec0402
SOLR-13359: Make UpdateHandler support other prefixes (besides hdfs:/) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-31 10:45:57 -04:00
Jason Gerlowski 1204d212d1 Improve docs on using basic-auth in SolrJ 2019-03-31 10:36:50 -04:00
Kevin Risden 42f8203fc3
SOLR-11473: Make HDFSDirectoryFactory support other prefixes (besides hdfs:/) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-30 14:26:00 -04:00
Jason Gerlowski 07b37ff26b SOLR-13355: Obey 'ALL' for handlers with other predefined perms 
Prior to this commit, RuleBasedAuthorizationPlugin would check for the
predefined 'ALL' permission only when the endpoint being hit wasn't
associated with another predefined-permission.

This resulted in some very unintuitive behavior. For example, the
permission {name:all, role:admin} would correctly prevent a
role:foo user from accessing /admin/info/properties, but would allow
write access to /admin/authorization because of the SECURITY_EDIT
predefined perm associated with that endpoint.

This commit fixes this bug so that the 'all' permission is always
consulted whether or not the endpoint is associated with other predefined
permissions.
 2019-03-29 22:33:12 -04:00
Jason Gerlowski 5fe03bcd01 SOLR-13355: Small refactors to RuleBasedAuthorizationPlugin 2019-03-29 22:33:00 -04:00
erick b2941ff0da SOLR-13349:High CPU usage in Solr due to Java 8 bug 2019-03-28 15:49:54 -07:00
Kevin Risden 8d658a8cfb
SOLR-13353: Add SolrCli AuthTool test 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-28 14:08:07 -04:00
Kevin Risden 90d983cf7c
SOLR-13351: Workaround for VELOCITY-908 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-27 17:42:55 -04:00
Joel Bernstein 98cadcf9f6 SOLR-13294: Change test file name 2019-03-27 15:36:47 -04:00
Joel Bernstein d407d556cc SOLR-13294: TestSQLHandler failures on windows jenkins machines 2019-03-27 15:36:47 -04:00
Ishan Chattopadhyaya e7939d5907 SOLR-7414: CSVResponseWriter & XLSXResponseWriter return empty field when fl alias is combined with * selector 2019-03-27 14:38:36 +05:30
Henning Andersen 04afdb6442 LUCENE-8735: Avoid FileAlreadyExistsException on windows. (#619) 
FilterDirectory.getPendingDeletions() did not delegate the call, which
resulted in a new IndexWriter on same directory not considering pending
delete files. This could in turn result in a FileAlreadyExistsException
when running windows.
 2019-03-26 14:56:45 +01:00
Cassandra Targett 65165c7c87 SOLR-11959: Add docs on CDCR limitation with Basic Auth 2019-03-26 08:00:39 -05:00
Kevin Risden 361d1e84ce
SOLR-13112: Upgrade jackson to 2.9.8 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-25 10:38:00 -04:00
Kevin Risden 11542aebce
Fix solr/CHANGES.txt 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-25 10:21:02 -04:00
Kevin Risden 4e230388ba
SOLR-13335: Upgrade to velocity 2.0 and velocity-tools 3.0 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-25 09:58:44 -04:00
Kevin Risden 0231c1ecb6
SOLR-13342: Remove dom4j from Solr 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-25 08:15:01 -04:00
Gus Heck dad414ca22 SOLR-13323 - remove unused csv related classes/tests 2019-03-24 20:01:46 -04:00
Gus Heck c60685f9e4 SOLR-13324 - Don't swallow/print exception in URLClassifyProcessor anymore 2019-03-24 19:07:26 -04:00
Shalin Shekhar Mangar bca22d58e2 SOLR-11126: Move change log entry under 8.0 2019-03-22 07:31:06 +05:30
Andrzej Bialecki 863d34bff5 SOLR-13322: Properly log exceptions. 2019-03-21 22:22:03 +01:00
Kevin Risden 6222abf448
SOLR-9079: Remove commons-lang as a dependency 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-20 19:37:19 -04:00
David Smiley 85a702cdff SOLR-13253: avoid using IndexSchema.getResourceLoader for non-schema things. 
Furthermore it's reference to SolrConfig was removed.
 2019-03-19 13:51:44 -04:00
Bar Rotstein 5b7866b085 SOLR-12955: Refactored DistributedUpdateProcessor to put SolrCloud specifics into a subclass 
Closes #528
 2019-03-19 13:26:31 -04:00
Andrzej Bialecki 6f2b7bf5c0 SOLR-11127: REINDEXCOLLECTION command for re-indexing of existing collections. 2019-03-19 13:42:59 +01:00
Kevin Risden 9fea3060b9
SOLR-8033: Remove debug if branch in HdfsTransactionLog 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-19 06:20:09 -04:00
Kevin Risden cf828163bd
SOLR-13330: Improve HDFS tests 
Related JIRAs:
* SOLR-11010
* SOLR-11381
* SOLR-12040
* SOLR-13297

Changes:
* Consolidate hdfs configuration into HdfsTestUtil
* Ensure socketTimeout long enough for HDFS tests
* Ensure HdfsTestUtil.getClientConfiguration used in tests
* Replace deprecated HDFS calls
* Use try-with-resources to ensure closing of HDFS resources

Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-18 15:25:36 -04:00
erick 3ac07b8dfb SOLR-13268: Patch that flushes when shutting down 2019-03-18 11:52:39 -07:00
Chris Hostetter 5c143022e7 SOLR-12923: Mea culpa: Remove useless import of java.lang... that breaks precommit 2019-03-15 14:39:19 -07:00
Chris Hostetter 1a54c6b19d SOLR-12923: fix SimClusterStateProvider to use lock.lockInterruptibly() exclusively, and make SimCloudManager's Callable checks tollerant of Callables that may have failed related to interrupts w/o explicitly throwing InterruptedException 2019-03-15 12:06:53 -07:00
Chris Hostetter c79aeee5f9 SOLR-12923: tweak the randomization in testCreateLargeSimCollections to reduce the max possible totalCores 
also decrease the number of iters while increase the cluster shape wait time to reduce the risk of spurious failures on machines under heavy contention w/o making the the test any slower on average
 2019-03-15 10:43:28 -07:00
Jan Høydahl 8f29d1eaad
SOLR-13244: Nodes view fails when a node is temporarily down 2019-03-15 13:30:02 +01:00
Andrzej Bialecki 571b307266 SOLR-13292: Fix a logic bug when point types are present, add more details to the unit test. 2019-03-15 11:52:37 +01:00
Chris Hostetter 76babf876a SOLR-12923: Fix some issues w/concurrency and exception swallowing in SimClusterStateProvider/SimCloudManager 
There are 3 tightly related bug fixes in these changes:

1) ConcurrentModificationExceptions were being thrown by some SimClusterStateProvider methods when
   creating collections/replicas due to the use of ArrayLists nodeReplicaMap. These ArrayLists were changed
   to use synchronizedList wrappers.
2) The Exceptions from #1 were being swallowed/hidden by code using SimCloudManager.submit() w/o checking
   the result of the resulting Future object. (As a result, tests waiting for a particular ClusterShape
   would timeout regardless of how long they waited.)   To protect against "silent" failures like this,
   this SimCloudManager.submit() has been updated to wrap all input Callables such that any uncaught errors
   will be logged and "counted."  SimSolrCloudTestCase will ensure a suite level failure if any such failures
   are counted.
3) The changes in #2 exposed additional concurrency problems with the Callables involved in leader election:
   These would frequently throw IllegalStateExceptions due to assumptions about the state/existence of
   replicas when the Callables were created vs when they were later run -- notably a Callable may have been
   created that held a reference to a Slice, but by the time that Callable was run the collection (or a
   node, etc...) refered to by that Slice may have been deleted.  While fixing this, the leader election
   logic was also cleaned up such that adding a replica only triggers leader election for that shard, not
   every shard in the collection.

While auditing this code, cleanup was also done to ensure all usage of SimClusterStateProvider.lock was
also cleaned up to remove all risky points where an exception may have been possible after aquiring the
lock but before the try/finally that ensured it would be unlocked.
 2019-03-14 22:27:48 -07:00
Alan Woodward fbd05167f4
LUCENE-3041: QueryVisitor (#581) 
This commit adds an introspection API to Query, allowing users to traverse
the nested structure of a query and examine its leaves.  It replaces the existing
`extractTerms` method on Weight, and alters some highlighting code to use
the new API
 2019-03-14 15:04:33 +00:00
Moshe c2a6772f1e SOLR-13129: nested docs: add more/better documentation in Solr ref-guide 2019-03-14 09:11:24 -04:00
Jan Høydahl a18aa2118b SOLR-12121: Remove a System.out.println in JWTAuthPlugin 2019-03-14 10:48:09 +01:00
Shalin Shekhar Mangar 6d0386c901 SOLR-13234: Fix for turkish locales 
WhenSolrExporterIntegrationTest.jvmMetrics ran on a JVM with the Turkish locale, (test seed: 62880F3B9F140C89). The JVM metric for terminated thread-count has a dotless-i e.g. termınated.
This causes the check for matching metrics to fail.

We could normalize the text in this case, however I think it's better to ensure we have the correct total number of JVM thread metrics rather than looking at Prometheus labels which maybe localized.

This closes #605.
 2019-03-14 11:10:49 +05:30
Gus Heck d8f2a02fdb SOLR-13131 Category Routed Aliases 2019-03-13 01:32:23 -04:00
Gus Heck cf88f54a29 Remove inadvertently included println 2019-03-12 16:09:04 -04:00
Gus Heck 9edc557f45 SOLR-12891 MacroExpander will no longer will expand URL parameters by 
default inside of the 'expr' parameter, add InjectionDefense class
for safer handling of untrusted data in streaming expressions and add
-DStreamingExpressionMacros system property to revert to legacy behavior
 2019-03-12 10:46:30 -04:00
Erick Erickson b893548d97 SOLR-13268: Clean up any test failures resulting from defaulting to async logging. Put TestXmlQParser back 2019-03-11 21:40:23 -07:00
Erick Erickson 28c8171fe6 SOLR-12732: TestLogWatcher failure on Jenkins. Deal with superclass logging bleeding into first watcher in the test 2019-03-11 12:55:08 -07:00
Chris Hostetter 7eb728a611 SOLR-13300: DistributedFacetExistsSmallTest should not attempt to compare results of a query that is known to differ in behavior in distributed mode 2019-03-11 10:02:46 -07:00
Kevin Risden 6777af074f
SOLR-13307: Ensure HDFS tests clear System properties they set (Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-03-11 11:13:37 -04:00
Mikhail Khludnev e353dcfe7d SOLR-13284: fallback to json instead of NPE and 500 code, when wt is omitted or wrong. 2019-03-10 23:10:38 +03:00
erick 9272c29539 SOLR-13268: Clean up any test failures resulting from defaulting to async logging 2019-03-10 11:05:00 -07:00
Andrzej Bialecki 27df824a4b SOLR-13292: Provide extended per-segment status of a collection. 2019-03-09 14:08:01 +01:00
Erick Erickson 8c6e305365 SOLR-12732: TestLogWatcher failure on Jenkins. Added more logging 2019-03-08 21:40:06 -08:00
Chris Hostetter 3b2d836142 Merge remote-tracking branch 'refs/remotes/origin/master' 2019-03-08 14:54:54 -07:00
Chris Hostetter 4335ad97af Delete OpenCloseCoreStressTest 
This is a fairly old test that isn't particularlay valuable, all it really does is stress test indexing, but w/o actually validating the results.

In it's current state, it can suffer from exceeding file handle limits depending on merge settings, and isn't reliably reproducible due to it's
approach of "do (a variable) amount of work until a fixed amount of wall clock time has elapsed"
 2019-03-08 14:52:33 -07:00
Jan Høydahl 9eabaf46a2 SOLR-12121: Move CHANGES entry from Improvements to New Features section 2019-03-08 22:08:31 +01:00
Chris Hostetter 20de3d2ee0 SOLR-12923: harden TestSimLargeCluster 
- added logging
- ensure start/finish trigger action counters are incremented before latches are released
- replace arbitrary sleep calls with a trigger listener countdown latch
- increase all await() times: This means that 'real' failures (which should be rare and hopefully
  reproducible) will be 'slow', but the trade off will be less hard to reproduce 'false failures'
  due to thread contention on slow or heavily loaded (ie: jenkins) machines
 2019-03-07 15:40:57 -07:00
Christine Poerschke 683aa3d3e9 SOLR-13254: Correct message that is logged in solrj's ConnectionManager when an exception occurred while reconnecting to ZooKeeper. (hu xiaodong via Christine Poerschke) 2019-03-07 20:17:31 +00:00
Erick Erickson 1e09268e78 SOLR-13261: Make SortableTextField work with export/streaming, now requires useDocValuesAsStored='true' 2019-03-07 10:59:20 -08:00
Uwe Schindler db5f1af59b Fix Windows startup script to disable HTTP/2 if TLS is enabled on Java 8. 2019-03-07 14:16:36 +01:00
Gus Heck d2d3942721 SOLR-13296 fix doc example so that it can be accepted by Solr 
(previously caused error due to decreasing offsets)
 2019-03-07 08:01:01 -05:00
Cao Manh Dat 002a4aac3e SOLR-13302: Adding HttpPartitionTest and ForceLeaderTest for TLOG replicas 2019-03-07 12:18:41 +00:00
Cao Manh Dat 583ae97067 SOLR-12313: Fix precommit 2019-03-07 12:00:33 +00:00
Cao Manh Dat 4eb1c6f3c6 SOLR-12313: Removing TestInjection#waitForInSyncWithLeader 2019-03-07 11:25:32 +00:00
Chris Hostetter e827dc2234 SOLR-13237: AwaitsFix LeaderTragicEventTest until we can make the underlying corruption detection reliable 2019-03-06 13:29:29 -07:00
Joel Bernstein 38005350d1 SOLR-13287: Remove System.out debugging 2019-03-06 13:56:02 -05:00
erick 5f91670a49 Clean up any test failures resulting from defaulting to async logging, reenable shutdown hook 2019-03-05 14:10:36 -08:00
Erick Erickson 558c515bf3 SOLR-13295: Reproducible failure in TestDistributedGrouping 2019-03-05 13:56:40 -08:00
Mikhail Khludnev de030178b5 SOLR-9882: picking results for mergeIds even after partial ones occurred 2019-03-05 23:26:47 +03:00
Ishan Chattopadhyaya aeb0774b38 Adding 7.7.1 version 2019-03-06 01:00:20 +05:30
Andrzej Bialecki 0bc26d07ad SOLR-13271: Read-only mode for SolrCloud collections. 2019-03-05 17:16:25 +01:00
Joel Bernstein 34382407ef SOLR-13287: Update CHANGES.txt 2019-03-05 10:11:59 -05:00
Joel Bernstein c34c56b7b2 SOLR-13287: Allow zplot to visualize probability distributions in Apache Zeppelin 2019-03-05 09:19:14 -05:00
Chris Hostetter 7bfe7b265a SOLR-13294: refactor test to include more loging to help diagnose some windows jenkins failures 2019-03-04 14:16:02 -07:00
Noble Paul 7771d7bb84 SOLR-13285: Updates with enum fields and javabin cause ClassCastException 2019-03-05 06:11:50 +11:00
Cassandra Targett 876fcb7f7b
SOLR-13259: Add new section on Reindexing in Solr (#594) 
Add new reindexing.adoc page; standardize on "reindex" vs "re-index"
 2019-03-04 12:24:58 -06:00
Chris Hostetter 7f7357696f SOLR-12923: harden testEventQueue by replacing the arbitrary sleep call with a countdown latch 2019-03-04 09:54:23 -07:00
Chris Hostetter 235b15acfc SOLR-12923: increase all await() times in TriggerIntegrationTest 
This means that 'real' failures (which should be rare and hopefully reproducile) will be 'slow', but the trade off will be less hard to reproduce 'false failures' due to thread contention on slow or heavily loaded (ie: jenkins) machines
 2019-03-04 09:54:23 -07:00
Cao Manh Dat f4f3277980 SOLR-13276: Move change entry to 8.1 2019-03-04 15:50:53 +00:00
Jason Gerlowski 3b326e6244 SOLR-13256: Add ref-guide upgrade notes for 7.7 2019-03-04 09:43:26 -05:00
Mikhail Khludnev b8d569aff0 SOLR-9882: reporting timeAllowed breach as partialResults instead of 500 error 2019-03-04 17:41:57 +03:00
Cao Manh Dat e99934b240 SOLR-13276: Adding Http2 equivalent classes of CloudSolrClient and HttpClusterStateProvider 2019-03-04 09:41:45 +00:00
Shalin Shekhar Mangar 1f9c767aac SOLR-13234: Prometheus Metric Exporter not threadsafe. 
This changes the prometheus exporter to collect metrics from Solr on a fixed interval controlled by this tool and prevents concurrent collections. This change also improves performance slightly by using the cluster state instead of sending multiple HTTP requests to each node to lookup all the cores.

This closes #571.
 2019-03-04 11:02:47 +05:30
Chris Hostetter fed80599a6 SOLR-12923: increase all await() times in TestSimTriggerIntegration 
This means that 'real' failures (which should be rare and hopefully reproducile) will be 'slow', but the trade off will be less hard to reproduce 'false failures' due to thread contention on slow or heavily loaded (ie: jenkins) machines
 2019-03-01 11:38:18 -07:00
Noble Paul 3ae52e1fe6 SOLR-13282: JDBCStreamTest should use assertEquals(double, double, delta) instead of '==' to compare 2 double values 2019-03-01 10:13:14 +11:00
Chris Hostetter 5e28e94a93 fix AfterClass in OverseerTest to not fail with NPE if assumeWorkingMockito() call short circuited the BeforeClass 2019-02-28 15:17:12 -07:00
Joel Bernstein f9b3004d01 SOLR-10436: Update CHANGES.txt 2019-02-28 09:32:24 -05:00
Joel Bernstein dcb022bc67 SOLR-10436: Add hashRollup Streaming Expression 2019-02-28 09:20:08 -05:00
Kevin Risden 15f3c3b0e6
SOLR-7321: Remove reflection in FSHDFSUtils.java (Mike Drob, Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-27 13:57:40 -05:00
Cao Manh Dat 00c02290d5 SOLR-12297: Remove debugging System.out line 2019-02-27 09:50:59 +00:00
Mikhail Khludnev 58beaeb74d SOLR-13227: don't throw exceptions for counting facet.range.other. 2019-02-26 23:38:51 +03:00
Kevin Risden 8f78c0591c
SOLR-9762: Remove the workaround implemented for HADOOP-13346 (Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-26 14:52:32 -05:00
Kevin Risden 9753e00294
SOLR-13074: MoveReplicaHDFSTest leaks threads, falls into an endless loop, logging like crazy (Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-26 14:48:47 -05:00
Kevin Risden 6a886b274d
SOLR-13060: Improve HdfsAutoAddReplicasIntegrationTest and HdfsCollectionsAPIDistributedZkTest 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-25 11:14:37 -05:00
Kevin Risden 9e7ec87f23
SOLR-9763: Remove the workaround implemented for HADOOP-12767 (Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-24 14:23:27 -05:00
erick fe5a96a284 SOLR-13268: Clean up any test failures resulting from SOLR-12055 (async logging). Kevin's upgrades 2019-02-24 09:50:04 -08:00
Mikhail Khludnev 52097627f8 SOLR-11883: reporting syntax errors as Bad Request instead of 500. 2019-02-23 23:55:55 +03:00
Erick 0de3905ce7 SOLR-12055: Enable async logging by default SOLR-12753: Async logging ring buffer and OOM error 2019-02-22 12:27:02 -08:00
Erick Erickson 6b4e90617d SOLR-13261: Make SortableTextField work with export/streaming 2019-02-22 11:04:31 -08:00
Tomas Fernandez Lobbe 906a08838b Fix TestTlogReplica 
At some point got broken and nobody noticed since it's not running
 2019-02-21 21:33:49 -08:00
Jason Gerlowski 5ab5ba773a Minor cleanup to ExportWriter 2019-02-21 16:05:48 -05:00
Tomas Fernandez Lobbe 6e81def01c Fix TestPullReplica.testKillLeader 
Somewhere along the way, this was broken and since the test is being excluded, nobody noticed
 2019-02-20 21:15:29 -08:00
Tomas Fernandez Lobbe bcd90f1561
SOLR-12708: CREATE collection request doesn't fail or cleanup when the request fails (#568) 
When performing an async CREATE requests, responses to internal requests are also included inside the "success" or "failed" elements of the general response. This will make the operation cleanup in case of failure, the same way as we do when the request is synchronous.
 2019-02-20 13:24:46 -08:00
Christine Poerschke 9251d45706 Fix typo in 'Index Size Trigger' example JSON. 2019-02-20 20:23:24 +00:00
Kevin Risden 86fe24cbef
SOLR-13222: Improve logging in StreamingSolrClients (Peter Cseh via Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-20 10:29:22 -05:00
Noble Paul a89b065c1f SOLR-13255 : ClasscastException when URPs try to read a String field which returns a ByteArrayUTF8CHarSequence . This is a regression in release 7.7 2019-02-20 22:19:18 +11:00
Kevin Risden af3ff118ef
SOLR-11763: Upgrade Guava to 25.1-jre (Markus Jelsma, Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-19 17:27:58 -05:00
shalinmangar 97875af3f9 SOLR-13248: Adding upgrade notes which explain the problem and the mitigation as well as steps to revert to the old behavior 2019-02-18 13:56:24 -08:00
shalinmangar 7e2d40197c SOLR-13248: Autoscaling based replica placement is broken out of the box. 
Solr 7.5 enabled autoscaling based replica placement by default but in the absence of default cluster policies, autoscaling can place more than 1 replica of the  same shard on the same node. Also, the maxShardsPerNode and createNodeSet was not respected. Due to these reasons,  this issue reverts the default replica placement policy to the 'legacy' assignment policy that was the default until Solr 7.4.
 2019-02-18 13:46:05 -08:00
Ishan Chattopadhyaya 6a0f7b251d SOLR-11876: In-place updates fail during resolution if required fields are present 2019-02-18 14:33:28 +05:30
Erick Erickson 3235c61e77 SOLR-12028: BadApple and AwaitsFix annotations usage. 2019-02-17 10:40:58 -08:00
Tomas Fernandez Lobbe 8ac34c2d6d SOLR-13229: Cleanup replicasMetTragicEvent after all exceptions 2019-02-15 14:51:35 -08:00
Simon Willnauer 4a513fa99f
LUCENE-8292: Make TermsEnum fully abstract (#574) 2019-02-15 17:32:55 +01:00
Alan Woodward 10acaf02f8 SOLR-13126: Correctly combine multiplicative query boosts 2019-02-15 10:09:26 +00:00
Cassandra Targett 52a9241232 Ref Guide: fix "cloud mode" to "SolrCloud mode" 2019-02-14 15:35:10 -06:00
Cassandra Targett e1959956c5 SOLR-12770: make docs on shards param a little more clear, fix a couple typos 2019-02-14 14:56:24 -06:00
Andrzej Bialecki b4b9c39392 SOLR-13252: Fix an NPE when setting a "policy" property for an existing collection. 2019-02-14 21:38:22 +01:00
Christine Poerschke e63ac04de6 further solr-ref-guide grammar fixes (s/rather then/rather than/g) 2019-02-14 18:59:05 +00:00
Ken Geis 1654b32345 fix grammar in streaming-expressions.adoc 
(Ken Geis via Christine Poerschke)

This closes #572 pull request, thank you.
 2019-02-14 18:46:13 +00:00
Andrzej Bialecki abcda8282c SOLR-13155: Minor addition to the "stats" section to make it easier to 
estimate the distribution of cores across nodes.
 2019-02-14 11:35:53 +01:00
Jason Gerlowski a084cc1e33 SOLR-13241: Add 'autoscaling' tool to solr.cmd 
Prior to this commit, SOLR-13155 added support for an 'autoscaling' tool
to bin/solr, but not to the Windows equivalent bin/solr.cmd.  This
commit adds the necessary plumbing to the Windows version of this
script.  It also removes some dead help-text from the bin/solr script.
 2019-02-13 10:48:31 -05:00
Noble Paul cfefdade5f SOLR-13171 : A true streaming parser for javabin payload/stream without creating any objects 2019-02-13 18:23:43 +11:00
Bruno P. Kinoshita 5310152450 Fix some spell check issues 2019-02-12 21:35:30 -08:00
Andrzej Bialecki 242ff88e02 SOLR-13155: Add command-line option for testing autoscaling configurations. 2019-02-12 11:53:15 +01:00
Mikhail Khludnev cd4cf7008d SOLR-12330: clarifying domain.(filter,query) for json.facet in the ref guide. 2019-02-10 23:37:58 +03:00
Mikhail Khludnev bf69a40d16 SOLR-12330: rethow NPEs and other json.facet syntax errors properly as 400 2019-02-09 23:57:30 +03:00
yyuan2 a3a4ecd80b LUCENE-8662: Change TermsEnum.seekExact(BytesRef) to abstract 2019-02-08 15:10:38 -08:00
Cassandra Targett 32443cf8e3 Ref Guide: fix typos & abbreviated words 2019-02-08 13:10:12 -06:00
Alan Woodward b80df5bbc0 Fix escaping in Solr Reference Guide 2019-02-08 13:45:25 +00:00
Tomas Fernandez Lobbe f2b84577a2 Set types in ZkController callables 2019-02-07 22:26:39 -08:00
Konstantin Perikov 87564a3e19 Update language-analysis.adoc 2019-02-07 22:11:18 -08:00
Chris Hostetter 956772b7ef disable TestInjection in RestartWhileUpdatingTest 
work around for SOLR-13189 and SOLR-13212
 2019-02-07 18:27:32 -07:00
Kevin Risden 475f2fd36b
SOLR-9515 - Remove pom dependency kerby-kerb 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-07 11:38:18 -05:00
Jason Gerlowski f30f9b49bf SOLR-13042: Miscellaneous JSON Faceting ref-guide improvements 2019-02-06 21:09:13 -05:00
Chris Hostetter 87ad59f826 SOLR-13210: Fix TriLevelCompositeIdRoutingTest to actually make sense 2019-02-06 14:42:30 -07:00
Chris Hostetter ea2956fda3 Harden OrderedExecutorTest to use concurrent latches/barriers for testing parallelism instead of making assumpions about how milliseconds something should take in another thread 2019-02-06 14:32:12 -07:00
Tomas Fernandez Lobbe 0add3bb0ac Removed some unused variables from DistributedUpdateProcessor 2019-02-06 11:31:55 -08:00
Noble Paul 1d13d3df03 SOLR-12999: Index replication could delete segments before downloading segments from master if there is not enough disk space 2019-02-06 23:16:05 +11:00
Noble Paul b061947e91 SOLR-12999: Index replication could delete segments before downloading segments from master if there is not enough disk space 2019-02-06 23:15:07 +11:00
Jan Høydahl 430a810006 SOLR-12121: Move CHANGES entry to 8.1.0 after merge to branch_8x 2019-02-06 09:16:58 +01:00
Joel Bernstein 49dc7a9cf7 SOLR-13146: Update CHANGES.txt 2019-02-03 18:22:49 -05:00
Kevin Risden 1a23ab005b
SOLR-10199: Solr's Kerberos functionality does not work in Java9 due to dependency on hadoop's AuthenticationFilter which attempt access to JVM protected classes 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-02 12:03:20 -05:00
Kevin Risden e8a24bc1c9
SOLR-8182: Update TestSolrCloudWithKerberosAlt to work with JDK9+ 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-02 12:03:00 -05:00
Kevin Risden 429481bc82
Fix precommit - unused import 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-01 15:32:07 -05:00
David Smiley 372d68f7f6 SOLR-5211: Document that delete-by-id (and updates) don't affect child/nested docs 2019-02-01 15:21:16 -05:00
markrmiller 4a3ddc94d8
SOLR-9515: Update to Hadoop 3 (Mark Miller, Kevin Risden) 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-02-01 15:04:56 -05:00
Kevin Risden e4f202c1e3
Revert "SOLR-9515: Update to Hadoop 3" 
This reverts commit 6bb24673f4.
 2019-01-31 19:46:02 -05:00
markrmiller 6bb24673f4
SOLR-9515: Update to Hadoop 3 
Signed-off-by: Kevin Risden <krisden@apache.org>
 2019-01-31 13:00:20 -05:00
Chris Hostetter 806744b0f1 reduce number of nodes/shards used in TriLevelCompositeIdRoutingTest to prevent (incredibly frequent) OOM in nightly 2019-01-31 10:45:12 -07:00
Dawid Weiss 4fc218e74e SOLR-13193: LeaderTragicEventTest doesn't catch NoSuchFileException when corrupting files 2019-01-31 11:55:05 +01:00
Joel Bernstein 2beb853cb3 SOLR-13147: Update CHANGES.txt 2019-01-30 14:49:45 -05:00
Chris Hostetter 0a01b9e127 disable TestInjection in TestStressCloudBlindAtomicUpdates 
work around for SOLR-13189
 2019-01-29 21:23:04 -07:00
Joel Bernstein 79d0dabed4 SOLR-13104: Update CHANGES.txt 2019-01-29 22:01:05 -05:00
Joel Bernstein 25478979b1 SOLR-13134: Update CHANGES.txt 2019-01-29 21:55:21 -05:00
Joel Bernstein a10a989263 SOLR-13088: Update CHANGES.txt 2019-01-29 21:45:55 -05:00
Joel Bernstein 239905edf7 SOLR-12984: Update CHANGES.txt 2019-01-29 21:30:19 -05:00
jimczi cf39708609 Add next minor release version 8.1.0 2019-01-29 14:12:38 +01:00
Andrzej Bialecki 1cfbd3e1c8 SOLR-13072: Make sure the new overseer leader is present. 2019-01-29 11:22:28 +01:00
Chris Hostetter 8bee03f490 Add logging and impoved cleanup to TestStressCloudBlindAtomicUpdates setup/teardown codepaths that occasionally cause suite level failures in jenkins 
The use of closeQuietly should hopefully prevent failures closing one HttpClient from resulting in other client objects being leaked

The setup changes are unlikey to improve test reliability, but will hopefully help diagnose where/how NPEs are coming from that currently cause some suite failures.
 2019-01-28 16:22:28 -07:00
David Smiley 381a30b26c SOLR-12768: added _nest_path_ to the default schema (thereby enabling nested docs) 
* new NestPathField encapsulating details for how _nest_path_ is indexed
** tweaked the analysis to index 1 token instead of variable
* TokenizerChain has new CustomAnalyzer copy-constructor
 2019-01-28 13:25:06 -05:00
Dawid Weiss d7dc53ff7c LUCENE-8474: Remove deprecated RAMDirectory. 2019-01-28 13:49:03 +01:00
Mikhail Khludnev 43f2723213 SOLR-13156: support facet.sort for facet.field={!terms=foo,bar}field 2019-01-28 15:27:09 +03:00
Noble Paul 250d21da94 SOLR-13130: during the ResponseBuilder.STAGE_GET_FIELDS directly copy string bytes and avoid creating String Objects 2019-01-27 16:02:11 +11:00
Tommaso Teofili 000785e68e LUCENE-8659 - updated sha1 for OpenNLP dependency 2019-01-26 23:32:59 +01:00
Chris Hostetter ec68359065 SOLR-13168: Fixed a bug in TestInjection that caused test only code to be invoked when TLOG replicas recieved commits if java assertions were enabled 
(see also: SOLR-12313)
 2019-01-25 15:50:46 -07:00
Tomas Fernandez Lobbe ef81dadc7d SOLR-12373: Remove deprecated constructor 2019-01-25 13:48:40 -08:00
Tomas Fernandez Lobbe 0bd1911db6 SOLR-12373: Let DocBasedVersionConstraintsProcessor define fields to use in tombstones 
A new config option, "tombstoneConfig" allows the DocBasedVersionConstraintsProcessor
to add extra fields to the tombstone generated when a document is deleted. This can
be useful when the schema has required fields.
 2019-01-25 13:38:18 -08:00
Chris Hostetter e2b8b0e5b1 SOLR-12801: completely prevent tlog replicas from being used. 
This follows the spirit of the change Mark intended in his previous commit to this test, but his solution wasn't covering all cases on backcompat to branch_7x

(see also: SOLR-12313)
 2019-01-25 10:18:55 -07:00
Mikhail Khludnev c317119654 SOLR-13029: configure buffer size in HdfsBackupRepository. 2019-01-24 18:06:09 +03:00
Jan Høydahl d09c724a0e SOLR-12121: Fix test fails in JWTAuthPluginIntegrationTest.testMetrics 2019-01-24 12:43:27 +01:00
Andrzej Bialecki 84819c8379 SOLR-13072: Fix precommit. 2019-01-24 10:47:44 +01:00
Andrzej Bialecki 72a99e9c5c SOLR-13072: Enable this test again. 2019-01-23 15:46:25 +01:00
Andrzej Bialecki a3fe51ffac SOLR-9735: Update CHANGES and the ref guide. 2019-01-23 15:10:22 +01:00
Jan Høydahl ea2c8ba38e SOLR-12121: JWT Token authentication plugin with OpenID Connect implicit flow login through Admin UI 2019-01-23 13:03:01 +01:00
Chris Hostetter 15e5ca999f SOLR-13140: harden SearchRateTriggerIntegrationTest by using more absolute rate thresholds and latches to track when all events have been processed so we don't need to 'guess' about sleep calls 
This commit also disables testDeleteNode pending an AwaitsFix on SOLR-13163
 2019-01-22 11:47:11 -07:00
Mikhail Khludnev e68697a6de SOLR-13156: documenting functionality gap. 2019-01-22 14:44:33 +03:00
Joel Bernstein 2aa2c16b88 SOLR-131476: Add double value to test vector 2019-01-21 14:01:13 -05:00
Joel Bernstein 732281c4cc SOLR-131476: Add movingMAD Stream Evaluator 2019-01-21 13:46:33 -05:00
Erick Erickson 60aef389cf SOLR-11998:RebalanceLeaders API broken response format with wt=JSON 2019-01-20 23:13:19 -06:00
Jimmy Casey 8b1c7296b7 Fixed Spelling. 2019-01-20 11:50:16 -08:00
Sascha Szott 28d54d5faf fixed invalid CSS files in Solr's Angular UI 2019-01-20 11:32:29 -08:00
Joel Bernstein cbfc9cccf6 SOLR-13146: Allow derivatives to be computed for the oscillate Stream Evaluator 2019-01-20 13:19:34 -05:00
Erick Erickson a692d05a90 SOLR-13091: REBALANCELEADERS is broken 2019-01-19 19:20:39 -08:00
Mikhail Khludnev c51838479a SOLR-13139: removing illegal date range syntax from the ref guide. 2019-01-19 20:39:51 +03:00
Cassandra Targett f140971bdf Ref Guide: fix typos and clarify some language for autoscaling docs 2019-01-18 20:57:32 -06:00
Eric Pugh 512cfd886d Fix parameter name in example 2019-01-18 14:54:56 -08:00
Toke Eskildsen c13645bd4c LUCENE-8585: Create jump-tables for DocValues at index-time 2019-01-18 22:42:04 +01:00
Gus Heck 68ed797c94 SOLR-13145 fail faster and more clearly when Jekyll is not available for ref guide build 2019-01-18 11:47:06 -05:00
Erick Erickson c0d8b75be9 SOLR-13144: Reference guide section on IndexUpgraderTool needs to be updated 2019-01-18 08:05:44 -08:00
fabric8-cd 63268000fb SOLR-13053: Adding test for assert that times nodes were removed and added was actually restored 2019-01-18 11:00:15 +00:00
Cao Manh Dat 75a7827bf4 Add note about removing of LIR in Solr 8 2019-01-17 16:37:19 +00:00
Cao Manh Dat 8e7a135496 Upgrade CHANGES.txt for http2 changes 2019-01-17 16:31:09 +00:00
Jan Høydahl e515a91406 SOLR-13116: Add Admin UI login support for Kerberos 2019-01-17 14:25:08 +01:00
Tomas Fernandez Lobbe 8b54b20fc4 SOLR-12770: Make it possible to configure a host whitelist for distributed search 2019-01-15 11:44:57 -08:00
Jan Høydahl b7f99fe55a SOLR-13137: NPE when /admin/zookeeper/status endpoint hit in standalone mode 2019-01-15 16:17:10 +01:00
Chris Hostetter d970375cd2 SOLR-12923: add a latch to TestTriggerListener to harden test that use it so they can deterministically know when all events have been proceeded 
This hardens several flakey tests, and allows the removal of a several arbitrary sleep calls
 2019-01-14 18:16:40 -07:00
Joel Bernstein 570d573c00 SOLR-13104: Add natural and repeat Stream Evaluators 2019-01-13 13:13:33 -05:00
Joel Bernstein 292e26bc2d SOLR-13134: Allow the knnRegress Stream Evaluator to more easily perform bivariate regression 2019-01-12 15:25:45 -05:00
Gus Heck dcc9ffe186 SOLR-13051 improve TRA update processor test 
- remove some timeouts
  - better async mechanism linked to SolrCore lifecycle
  - add some additional tests to be a bit more thorough
 2019-01-11 14:47:57 -05:00
Cassandra Targett 4d23ca2a19 Ref Guide: fix double footer in page layout for index.html 2019-01-10 09:13:26 -06:00
Noble Paul 0635c657c1 SOLR-13016: precommit errors 2019-01-10 11:58:53 +11:00
Noble Paul 3ffc9099bf SOLR-13016: test errors fixed 2019-01-10 11:57:58 +11:00
Cassandra Targett 7112d6f061 Ref Guide: Fix leftover getting-assistance refs that are breaking the build 2019-01-09 16:32:50 -06:00
Cassandra Targett a5403a3382 SOLR-7896: add login screen info & screenshot to overview-of-the-solr-admin-ui; remove getting-assistance.adoc and move its content to same overview page 2019-01-09 16:02:05 -06:00
Andrzej Bialecki 9423bdb0cf SOLR-13072: Document the "splitFuzz" parameter. 2019-01-09 17:21:47 +01:00
Noble Paul 1e14a6c6d6 SOLR-13016: Computing suggestions when policy have "#EQUAL" or "#ALL" rules take too long 2019-01-09 23:18:05 +11:00
David Smiley df119573db SOLR-12888: Run URP now auto-registers NestedUpdateProcessor before it. 2019-01-08 23:23:02 -05:00
Noble Paul d814d862b0 SOLR-12983: Create DocValues fields directly from byte[] 2019-01-09 13:44:41 +11:00
Cao Manh Dat 951b4e4c83 SOLR-13053: Upgrade CHANGES.txt 2019-01-08 18:42:14 +00:00
Andrzej Bialecki 7db4121b45 SOLR-13072: Use the same wait in other simulated tests where the same race condition may occur. 2019-01-08 19:12:38 +01:00
Andrzej Bialecki a37e2c609c SOLR-13072: Wait for autoscaling config refresh to finish before modifying the cluster 
and enable the tests for now.
 2019-01-08 16:16:55 +01:00
Noble Paul 825e63c00b SOLR-12983: tests don't need to use the optimization 2019-01-08 17:26:19 +11:00
Noble Paul 3932a4cc6c SOLR-12983: JavabinLoader should avoid creating String Objects and create UTF8CharSequence fields from byte[] 2019-01-08 15:27:48 +11:00
Chris Hostetter 5a513fab83 SOLR-13118: Fix various nodeAdded/nodeLost trigger (integration) tests related to restoriung state 
This includes some cleanup and refactoring of unrelated test methods in the same classes to use new helper methods
 2019-01-07 17:53:04 -07:00
Andrzej Bialecki 6e745bd250 SOLR-12730: Implement staggered SPLITSHARD requests in IndexSizeTrigger. 2019-01-07 19:14:54 +01:00
Alan Woodward 906f94a8cc Remove unnecessary back compatibility 2019-01-07 13:20:01 +00:00
Alan Woodward 04f48dba8b Move to version 9.0.0 2019-01-07 13:04:01 +00:00
Jan Høydahl 0b6ea3f108 SOLR-7896: Avoid browser basicAuth dialogue when blockUnknown=false. Always show Dashboard menu. Clarify refGuide 2019-01-07 13:09:26 +01:00
Shalin Shekhar Mangar 2bd6f246b0 SOLR-11126: New Node-level health check handler at /admin/info/healthcheck and /node/health paths that checks if the node is live, connected to zookeeper and not shutdown 2019-01-06 12:41:49 +05:30
Shalin Shekhar Mangar 46592e981f SOLR-12365: Fix compilation failure in prometheus-exporter 2019-01-06 09:34:22 +05:30
David Smiley 84264c7410 SOLR-12365: moved parseLuceneVersionString to SolrConfig class 2019-01-05 17:14:37 -05:00
David Smiley ff19a3a261 SOLR-12365: Renamed class Config to XmlConfigFile 2019-01-05 10:08:36 -05:00
David Smiley ca23040baa SOLR-12365: Renamed class Config to XmlConfigFile 2019-01-05 09:51:02 -05:00
Noble Paul 000d0c1364 SOLR-12514: FIxed the test and another bug 2019-01-05 19:31:28 +11:00
Jason Gerlowski 73797f60ad SOLR-13090: Add missing CHANGES.txt entry 2019-01-04 09:53:47 -05:00
noble 669ca8f283 SOLR-12514: Adding a positive testcase also 2019-01-04 14:56:17 +11:00
noble 663fa0e17f SOLR-12514: Adding a positive testcase also 2019-01-04 14:50:52 +11:00
Mike McCandless 63dfba4c7d LUCENE-8601: attributes added to IndexableFieldType during indexing will now be preserved in the index and accessible at search time via FieldInfo attributes 2019-01-03 18:44:41 -05:00
Cassandra Targett ec43d100d1 SOLR-13050: make italicized note into a real NOTE block 2019-01-03 13:48:58 -06:00
Christine Poerschke 63a6c250d7 Update copyright year(s) in lucene/NOTICE.txt and solr/NOTICE.txt files. 2019-01-03 18:46:30 +00:00
Jan Høydahl 9488c8f688 SOLR-12237: Fix incorrect SOLR_SSL_KEYSTORE_TYPE variable in solr start script 2019-01-03 19:40:47 +01:00
Jan Høydahl 00f8f3a13a SOLR-11774: langid.map.individual now works together with langid.map.keepOrig 2019-01-03 18:27:24 +01:00
David Smiley 6342ec699e SOLR-12633: remove anonChildDocs update parameter used in nested docs in JSON. 2019-01-03 10:58:59 -05:00
Andrzej Bialecki 0a7a478c1f SOLR-12514: Properly close a SolrClient to fix the test teardown. 2019-01-03 14:59:31 +01:00
Andrzej Bialecki dbcb245062 SOLR-13050: Add a note to the ref guide. 2019-01-03 11:55:09 +01:00
Andrzej Bialecki e5fda5d6f1 SOLR-13050: Fix the test so that .system events are collected again. 2019-01-02 22:11:57 +01:00
Jan Høydahl a1c6e642aa SOLR-11853: Solr installer fails on SuSE linux 2019-01-02 17:24:22 +01:00
Jason Gerlowski c34f29a4b4 SOLR-13090: Add sysprop override for maxBooleanClauses 2019-01-02 10:58:32 -05:00
Andrzej Bialecki b9457b78d5 SOLR-13050: Fix another test that could accidentally kill the .system leader node. 
Improve fallback in SystemLogListener when target collection is not present.
 2019-01-02 16:55:16 +01:00
Noble Paul 302184dd7f SOLR-12514: Rule-base Authorization plugin skips authorization if querying node does not have collection replica 2019-01-02 19:49:40 +11:00
Noble Paul 619b38a19b SOLR-12514: Rule-base Authorization plugin skips authorization if querying node does not have collection replica 2019-01-02 19:44:03 +11:00
Shalin Shekhar Mangar 5016959ce8 SOLR-13082: A trigger that creates trigger events more frequently than the cool down period can starve other triggers. 
This is mitigated to some extent by randomly choosing the trigger to resume after cool down. It is recommended that scheduled triggers not be used for very frequent operations to avoid this problem.
 2019-01-02 11:59:00 +05:30
Gus Heck 752989fd74 SOLR-13086 improve error message in DocumentObjectBinder 2018-12-31 07:54:56 -05:00
Christine Poerschke 6a2de771bf SOLR-13096: rename TestRankQueryPlugin to RankQueryTestPlugin 2018-12-31 11:05:31 +00:00