Commit Graph

12971 Commits

Author SHA1 Message Date
noble 669ca8f283 SOLR-12514: Adding a positive testcase also 2019-01-04 14:56:17 +11:00
noble 663fa0e17f SOLR-12514: Adding a positive testcase also 2019-01-04 14:50:52 +11:00
Mike McCandless 63dfba4c7d LUCENE-8601: attributes added to IndexableFieldType during indexing will now be preserved in the index and accessible at search time via FieldInfo attributes 2019-01-03 18:44:41 -05:00
Cassandra Targett ec43d100d1 SOLR-13050: make italicized note into a real NOTE block 2019-01-03 13:48:58 -06:00
Christine Poerschke 63a6c250d7 Update copyright year(s) in lucene/NOTICE.txt and solr/NOTICE.txt files. 2019-01-03 18:46:30 +00:00
Jan Høydahl 9488c8f688 SOLR-12237: Fix incorrect SOLR_SSL_KEYSTORE_TYPE variable in solr start script 2019-01-03 19:40:47 +01:00
Jan Høydahl 00f8f3a13a SOLR-11774: langid.map.individual now works together with langid.map.keepOrig 2019-01-03 18:27:24 +01:00
David Smiley 6342ec699e SOLR-12633: remove anonChildDocs update parameter used in nested docs in JSON. 2019-01-03 10:58:59 -05:00
Andrzej Bialecki 0a7a478c1f SOLR-12514: Properly close a SolrClient to fix the test teardown. 2019-01-03 14:59:31 +01:00
Andrzej Bialecki dbcb245062 SOLR-13050: Add a note to the ref guide. 2019-01-03 11:55:09 +01:00
Andrzej Bialecki e5fda5d6f1 SOLR-13050: Fix the test so that .system events are collected again. 2019-01-02 22:11:57 +01:00
Jan Høydahl a1c6e642aa SOLR-11853: Solr installer fails on SuSE linux 2019-01-02 17:24:22 +01:00
Jason Gerlowski c34f29a4b4 SOLR-13090: Add sysprop override for maxBooleanClauses 2019-01-02 10:58:32 -05:00
Andrzej Bialecki b9457b78d5 SOLR-13050: Fix another test that could accidentally kill the .system leader node.
Improve fallback in SystemLogListener when target collection is not present.
2019-01-02 16:55:16 +01:00
Noble Paul 302184dd7f SOLR-12514: Rule-base Authorization plugin skips authorization if querying node does not have collection replica 2019-01-02 19:49:40 +11:00
Noble Paul 619b38a19b SOLR-12514: Rule-base Authorization plugin skips authorization if querying node does not have collection replica 2019-01-02 19:44:03 +11:00
Shalin Shekhar Mangar 5016959ce8 SOLR-13082: A trigger that creates trigger events more frequently than the cool down period can starve other triggers.
This is mitigated to some extent by randomly choosing the trigger to resume after cool down. It is recommended that scheduled triggers not be used for very frequent operations to avoid this problem.
2019-01-02 11:59:00 +05:30
Gus Heck 752989fd74 SOLR-13086 improve error message in DocumentObjectBinder 2018-12-31 07:54:56 -05:00
Christine Poerschke 6a2de771bf SOLR-13096: rename TestRankQueryPlugin to RankQueryTestPlugin 2018-12-31 11:05:31 +00:00
Christine Poerschke 345a655f21 SOLR-12973: Admin UI Nodes view support for replica* replica names. (Daniel Collins, Christine Poerschke, janhoy) 2018-12-28 12:23:53 +00:00
Erick Erickson 24ae0d16cd SOLR-12028: Catching up with annotations after recent Solr test work 2018-12-27 18:03:50 -08:00
Joel Bernstein d018cd18f4 SOLR-13088: Add zplot Stream Evaluator to plot math expressions in Apache Zeppelin 2018-12-27 14:42:27 -05:00
David Smiley 106d300052 SOLR-12535: index time boosts in JSON are no longer accepted 2018-12-26 09:39:42 -05:00
David Smiley 1d0a086217 SOLR-13080: TermsQParserPlugin automaton method should (must?) sort input 2018-12-21 13:26:03 -05:00
Jason Gerlowski 207b3f4453 SOLR-13045: Sim node versioning should start at 0
Prior to this commit, new ZK nodes being simulated by the sim framework
were started with a version of -1.  This causes problems, since -1 is
also coincidentally the flag value used to ignore optimistic concurrency
locking and force overwrite values.
2018-12-21 08:04:44 -05:00
Jason Gerlowski 272178eff5 SOLR-13045: Allow SimDistribStateManager to create top-level data nodes
While working on a related issue in SimDistribStateManager, I noticed
that `createData()` only worked successfully on nodes nested more than
one level under root.  (i.e. `createData("/foo", someData, mode)` would
fail, while the same with "/foo/bar" wouldn't).  This was due to an edge
case in SimDistribStateManager's path building logic.  This commit fixes
this issue.
2018-12-20 14:09:05 -05:00
Andrzej Bialecki 846dfbef39 SOLR-13072: Fix an api change. 2018-12-20 15:49:59 +01:00
Andrzej Bialecki 1f0e875db6 SOLR-13072: Management of markers for nodeLost / nodeAdded events is broken. 2018-12-20 13:16:28 +01:00
Dawid Weiss 71f024ac8f SOLR-13074: clean up static variables properly, avoiding NPEs. 2018-12-18 23:20:55 +01:00
Chris Hostetter 73299f0f22 SOLR-13079: refactor and harden common 'suspend-trigger' patern in autoscaling test setup 2018-12-18 11:28:31 -07:00
Erick Erickson 3be5b59907 SOLR-12727: Added Dat to the credits, partly as a test of whether infra has fixed a commit attribution error 2018-12-17 16:49:21 -08:00
Andrzej Bialecki f5479383b1 SOLR-13076: TimeOut breaks the simulation framework. 2018-12-17 16:49:27 +01:00
Adrien Grand 785d02208a Remove duplicate package info. 2018-12-17 11:29:34 +01:00
Adrien Grand 6f08eee2fd Fix compilation. 2018-12-17 10:07:36 +01:00
markrmiller 5e305e2f00 SOLR-13075: Add @AwaitsFix annotation to SaslZkACLProviderTest. 2018-12-16 14:49:07 -06:00
Cao Manh Dat f80e8e1167 Merge jira/http2 branch to master 2018-12-16 16:58:20 +00:00
Steve Rowe a62b5941b0 SOLR-13060: Annotate never-terminating HDFS Nightly tests with AwaitsFix 2018-12-15 12:24:57 -05:00
Dawid Weiss e916f1fb86 LUCENE-8611: Update randomizedtesting to 2.7.2, JUnit to 4.12, add hamcrest-core dependency. 2018-12-15 09:49:36 +01:00
Simon Willnauer e974311d91 LUCENE-8609: Allow getting consistent docstats from IndexWriter
Today we have #numDocs() and #maxDoc() on IndexWriter. This is enough
to get all stats for the current index but it's subject to concurrency
and might return numbers that are not consistent ie. some cases can
return maxDoc < numDocs which is undesirable. This change adds a getDocStats()
method to index writer to allow fetching consistent numbers for these stats.

This change also deprecates IndexWriter#numDocs() and IndexWriter#maxDoc()
and replaces all their usages wiht IndexWriter#getDocStats()
2018-12-14 19:36:25 +01:00
Jason Gerlowski 1d601ed646 SOLR-13065: Harden TestSimExecutePlanAction 2018-12-14 12:22:09 -05:00
Jason Gerlowski 655e9ecf7c Fix active replica count reporting in SimClusterStateProvider
One codepath assumed all replicas were active, instead of checking the
state of each individually.
2018-12-14 12:21:47 -05:00
Jason Gerlowski dd910d1a06 Indicate collection in `clusterShape` log messages
Many of Solr's tests use CloudTestUtils' `waitForState` and
`clusterShape` methods to wait until a SolrCloud cluster matches a
particular expected shape.  The code periodically checks on the cluster
state, and logs a message if a collection doesn't match the state we
expect of it.  Prior to this commit, these log messages omitted the
collection name though, which makes things a little confusing when a
test is checking on the state of multiple collections simultaneously (as
can happen when Triggers fire in the background).
2018-12-14 12:21:19 -05:00
Erick Erickson 3ca7e65388 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/lucene-solr 2018-12-14 07:43:06 -08:00
Erick Erickson 15b36299c4 SOLR-12727: Fix tests to work with 'interesting' entries in the hosts file like 'fe80::1%lo0 localhost' 2018-12-14 07:42:57 -08:00
Jan Høydahl bfd28a8b3a SOLR-10975: New Admin UI Query does not URL-encode the query produced in the URL box 2018-12-14 15:30:39 +01:00
Jan Høydahl f8fcdbb208 Revert "SOLR-11296: Spellcheck parameters not working in new UI" due to wrong commit message
This reverts commit bb2405a
2018-12-14 15:29:27 +01:00
Jan Høydahl bb2405aec8 SOLR-11296: Spellcheck parameters not working in new UI
(cherry picked from commit 62edbf2e7d)
2018-12-14 15:27:18 +01:00
Jan Høydahl 62edbf2e7d SOLR-11296: Spellcheck parameters not working in new UI 2018-12-14 15:07:28 +01:00
Jan Høydahl 04e05782a3 SOLR-7896: Followup fix to non-working core dropdown 2018-12-14 14:40:02 +01:00
Chris Hostetter df07fb33bb SOLR-13043: cleanup suspicious ExecutorService lifecycles in MiniSolrCloudCluster 2018-12-13 19:59:35 -07:00
Chris Hostetter f844461357 SOLR-13072: disable flawed test of flawed functionality 2018-12-13 15:32:09 -07:00
Chris Hostetter 46516b7077 SOLR-13068: Update many cloud/autoscaling tests to use TimeSource.NANO_TIME (instead of CURRENT_TIME) for comparisons
as much as possible, the tests actual use the time source directly from the cluster, so that even if the cluster is changed to use an alternate time source, the tests will be consistent
2018-12-13 11:02:24 -07:00
Jason Gerlowski d7ad2f46c3 SOLR-13037: Harden TestSimGenericDistributedQueue 2018-12-13 06:27:34 -05:00
Jan Høydahl 81dbad54e0 SOLR-12799: Allow Authentication Plugins to intercept internode requests on a per-request basis
Add 'forwardCredentials' parameter to BasicAuth which will then skip using PKI on sub requests
2018-12-13 10:51:56 +01:00
markrmiller 42f13731b3 SOLR-12801: Harden SimSolrCloudTests. 2018-12-12 18:50:23 -06:00
markrmiller 44b51cd041 SOLR-13067: Harden BasicAuthIntegrationTest. 2018-12-12 18:50:23 -06:00
markrmiller 7de72c9bc7 SOLR-13066: A failure while reloading a SolrCore can result in the SolrCore not being closed. 2018-12-12 18:49:06 -06:00
Jan Høydahl 9728dbc167 SOLR-12791, SOLR-13067: Fix test failure for BasicAuthIntegrationTest
Make PkiAuthenticationIntegrationTest beast-able
2018-12-13 00:14:37 +01:00
Joel Bernstein 1e68726831 SOLR-12801: Suppress SSL and older codecs 2018-12-12 15:38:40 -05:00
Joel Bernstein 7e4555a2fd SOLR-13057: Allow search, facet and timeseries Streaming Expressions to accept a comma delimited list of collections 2018-12-12 09:16:08 -05:00
Jan Høydahl ef2f0cd88c SOLR-12791: Add Metrics reporting for AuthenticationPlugin 2018-12-12 11:33:32 +01:00
Jan Høydahl 280f67927e SOLR-7896: Add a login page to Admin UI, with initial support for Basic Auth 2018-12-12 10:37:23 +01:00
Jan Høydahl 5affe7421f SOLR-13025: SchemaSimilarityFactory fallback to LegacyBM25Similarity for luceneMatchVersion < 8.0 2018-12-12 10:33:50 +01:00
markrmiller bcdc6dadbb SOLR-13040: Fix TestSQLHandler, remove delete core calls. 2018-12-12 02:06:26 -06:00
Steve Rowe ec1bd0da2f SOLR-13060: set suite timeout on non-terminating HDFS Nightly tests to one hour 2018-12-11 18:49:06 -08:00
Gus Heck a7859ff62a SOLR-13058 Fix synchronized block 2018-12-11 18:45:42 -05:00
Chris Hostetter ade7546ad2 Merge remote-tracking branch 'refs/remotes/origin/master' 2018-12-11 13:21:52 -07:00
Chris Hostetter de65b45fca change NodeLostTrigger's initial run() log from INFO to DEBUG 2018-12-11 13:18:32 -07:00
markrmiller c852418148 SOLR-12801: Harden TestSimLargeCluster. 2018-12-11 14:17:10 -06:00
Chris Hostetter 3147c131e0 SOLR-13054: rewrite TriggerSetPropertiesIntegrationTest
test no longer depends on changing static non-final non-volatile variables used by multiple threads

test also no longer depends on arbitrary sleep calls, instead threads await/poll on concurrent signaling objects/queues
2018-12-11 10:39:00 -07:00
markrmiller 274a6eba90 SOLR-12801: Try to harden CdcrBootstrapTest. 2018-12-11 08:58:42 -06:00
markrmiller 19d968dc3d SOLR-12801: Harden OverseerTaskQueueTest and DistributedQueueTest. 2018-12-11 08:58:42 -06:00
markrmiller b9278d7c99 SOLR-12923: Harden TestSimTriggerIntegration. 2018-12-11 08:58:42 -06:00
markrmiller eb1735ece9 SOLR-12923: Harden TestSimLargeCluster. 2018-12-11 08:58:42 -06:00
markrmiller a25ddcd4f3 SOLR-12801: Harden InfixSuggestersTest#testShutdownDuringBuild. 2018-12-11 08:58:42 -06:00
markrmiller 05d728f57a SOLR-12801: Add @AwaitsFix to TestHierarchicalDocBuilder#testThreeLevelHierarchy. 2018-12-11 06:05:26 -06:00
markrmiller ab891fa472 SOLR-12801: Harden TestCloudRecovery. 2018-12-11 05:45:34 -06:00
markrmiller 496c627882 SOLR-12801: Raise this test socket timeout to 30 seconds. 2018-12-11 05:45:28 -06:00
markrmiller 3205491beb SOLR-12923: Harden TestSimTriggerIntegration. 2018-12-11 05:45:19 -06:00
markrmiller 7605427481 SOLR-12801: Harden BasicDistributedZk2Test. 2018-12-11 05:45:12 -06:00
Cao Manh Dat 40502b9ba8 SOLR-13028: Remove AwaitsFix for AutoAddReplicasPlanActionTest.testSimple to get log failure 2018-12-11 10:31:59 +00:00
Cao Manh Dat d26c237e35 Remove BadApple for TestSimTriggerIntegration.testListeners to get log failure 2018-12-11 09:53:58 +00:00
Noble Paul c651cbfd9a SOLR-12885: BinaryResponseWriter (javabin format) should directly copy from BytesRef to output 2018-12-11 18:35:57 +11:00
Chris Hostetter a2199c72d4 SOLR-13050: add workaround for issue to SystemLogListenerTest
make sure the node we kill isn't the .system collection leader
2018-12-10 19:06:42 -07:00
Jason Gerlowski f89f109ec1 SOLR-13045: Harden TestSimPolicyCloud
This commit fixes a race condition in SimClusterStateProvider, fixing
several fails in TestSimPolicyCloud.
2018-12-10 17:39:12 -05:00
Cao Manh Dat af6e15e838 SOLR-13053: NodeAddedTrigger and NodeLostTrigger do not reserve added/removed time populated by restoreState 2018-12-10 20:08:07 +00:00
markrmiller d96475a0bb SOLR-12801: Fix TestSolrCloudWithKerberosAlt. 2018-12-10 11:46:34 -06:00
Jan Høydahl b6cbb8494e SOLR-13014: URI Too Long with large streaming expressions in SolrJ 2018-12-10 18:22:52 +01:00
markrmiller 202dad8c88 SOLR-12923: Harden TestSimLargeCluster. 2018-12-10 10:02:58 -06:00
markrmiller a1657616bb SOLR-12923: Harden TestSimTriggerIntegration. 2018-12-10 10:02:58 -06:00
markrmiller 56b959141f SOLR-12801: Try to harden closing of zk db in TestConfigSetsAPIZkFailure. 2018-12-10 10:02:58 -06:00
markrmiller 18356de837 SOLR-12923: Harden TestSimTriggerIntegration. 2018-12-09 22:55:32 -06:00
markrmiller 5405b2f1c3 SOLR-12801: Try to harden TestReplicatinHandler#doTestIndexFetchOnMasterRestart. 2018-12-09 22:55:25 -06:00
markrmiller f47976a219 SOLR-12801: Try to harden SolrRrdBackendFactoryTest. 2018-12-09 22:55:19 -06:00
markrmiller 6f8d598781 SOLR-12801: Harden CollectionsAPISolrJTest#testCreateCollWithDefaultClusterPropertiesNewFormat. 2018-12-09 20:52:03 -06:00
markrmiller 665517d3bf SOLR-12801: Harden CollectionsAPISolrJTest#testCreateCollWithDefaultClusterPropertiesOldFormat. 2018-12-09 18:50:47 -06:00
markrmiller 1d5ae9857f SOLR-12801: Raise timeout in CollectionsAPIAsyncDistributedZkTest. 2018-12-09 18:31:28 -06:00
markrmiller 5d529802c4 SOLR-12801: harden DocValuesNotIndexedTest 2018-12-09 18:31:28 -06:00
markrmiller 0824f7b045 SOLR-12801: use waitForActiveCollection call 2018-12-09 18:31:28 -06:00
markrmiller f6063a1461 SOLR-12801: boost wait to try and harden 2018-12-09 18:31:28 -06:00
markrmiller 4133ce4cc1 SOLR-12923: Harden TestSimTriggerIntegration.testNodeMarkersRegistration. 2018-12-09 18:31:28 -06:00
markrmiller 3eb2612e67 SOLR-12988: Disable SSL on Java 11/12 for now. 2018-12-09 18:31:28 -06:00
markrmiller 0aef561245 SOLR-12923: Harden TestSimNodeLostTrigger#testTrigger. 2018-12-09 18:31:28 -06:00
markrmiller 3f1b75ab82 SOLR-12801: harden MultiThreadedOCPTest 2018-12-09 18:31:28 -06:00
markrmiller a9a5cdc34d SOLR-12801: raise jetty idle socket timeout 2018-12-09 18:31:28 -06:00
markrmiller 40432cdfbc SOLR-12801: tweak shard count specificiation 2018-12-09 18:31:28 -06:00
markrmiller eac3f58c43 SOLR-12801: wait 60 seconds instead of 30 for cores to close 2018-12-09 18:31:28 -06:00
markrmiller 906e32af13 SOLR-12801: harden CollectionsAPIDistributedZkTest 2018-12-09 18:31:28 -06:00
markrmiller 65bfb1639c SOLR-12801: harden CollectionsAPISolrJTest 2018-12-09 18:31:28 -06:00
markrmiller 1184fbed63 SOLR-12923: Harden AutoScalingHandlerTest. 2018-12-09 18:31:28 -06:00
markrmiller b94911b260 SOLR-12801: don't do single index check here on windows. 2018-12-09 18:31:28 -06:00
markrmiller e25d6850c4 SOLR-13037: Add @AwaitsFix annotation to TestSimGenericDistributedQueue. 2018-12-09 18:31:28 -06:00
Erick Erickson 54ca26abe9 SOLR-12727: CHANGES.txt, updated ZooKeeper dependency 2018-12-09 09:15:42 -08:00
Erick Erickson f690302e05 SOLR-12727: Upgrade ZooKeeper dependency to 3.4.13 2018-12-09 08:50:51 -08:00
Joel Bernstein 17fca051c5 SOLR-13046: Suppress SSL for StreamingTest 2018-12-07 09:19:40 -05:00
markrmiller 46d7994045 SOLR-13028: @AwaitsFix AutoAddReplicasPlanActionTest#testSimple. 2018-12-06 08:56:03 -06:00
markrmiller b9a966e5f7 SOLR-12833: Add configurable timeout to VersionBucket lock. 2018-12-06 08:36:56 -06:00
markrmiller 38cfd0e259 SOLR-13040: Add AwaitsFix annotation to TestSQLHandler and improve exception information related to that test. 2018-12-05 19:34:13 -06:00
Cassandra Targett c81822e157 SOLR-12422: Add section on performance issues with Solr Cell; Overhaul and re-organize entire page 2018-12-04 15:08:22 -06:00
Cassandra Targett ad373ff36e Ref Guide: typo in "parameter" 2018-12-04 15:08:22 -06:00
Jason Gerlowski a5fb6f8adc Add 'prelim_sort' helper to SolrJ's TermsFacetMap 2018-12-04 14:29:29 -05:00
Chris Hostetter 868e005760 SOLR-13032: harden MaxSizeAutoCommitTest to eliminate race conditions and eliminate use of arbitrary sleep 2018-12-04 10:44:05 -07:00
Jason Gerlowski f7faae075b SOLR-13019: Fix typo in MailEntityProcessor
Path provided by Tommy Marshment-Howell.

Closes #509
2018-12-04 08:49:58 -05:00
Gus Heck 59919b4ac0 SOLR-13036 Fix retry logic in JettySolrRunner 2018-12-03 21:54:34 -05:00
markrmiller e14432efd8 SOLR-12801: Wait for thread on close and add AwaitsFix annotation - most of these sim tests can fail to elect shard leaders. 2018-12-03 17:40:51 -06:00
markrmiller e3cbdd0505 SOLR-13032: Add @AwaitsFix annotation to test. 2018-12-03 11:07:40 -06:00
markrmiller 1408f5255f SOLR-12801: Disable TimeRoutedAliasUpdateProcessorTest because the feature leaks threads. 2018-12-03 09:07:27 -06:00
Gus Heck b6b9f9554e SOLR-12801 fix cut/paste oops in comment 2018-12-02 16:41:55 -05:00
Gus Heck cf4d749410 SOLR-12801 Revert breaking commit a3ec5b5fdf and improve test
to be more complete. Also, add comments to make it easier for
others to understand TimeRoutedAliasUpdateProcessorTest
2018-12-02 16:34:40 -05:00
Jason Gerlowski c951578fca SOLR-6117: Unify ReplicationHandler error handling
Prior to this commit, ReplicationHandler had a few inconsistencies
in how it reported errors:
  - Sometimes the 'status' field was used as an enum (e.g. 'success'
    v. 'failure'.  Elsewhere it is used to hold error messages.
  - Sometimes an explicit 'message' field was used, but often not.
  - Sometimes a stack trace was provided in place of an error message.

This commit tweaks the various error cases in ReplicationHandler to
report errors consistently.  'status' is always an enum-type value.  A
'message' field is provided for all errors, with an optional 'exception'
field.
2018-12-02 16:23:04 -05:00
Jason Gerlowski 6e4c9b3b58 SOLR-12555: Use `expectThrows` for expected exceptions
This commit replaces the `try { doX(); fail(); }` pattern with the
`expectThrows` test helper, which was created for this purpose.

This commit makes these changes in the core package:
`o.a.solr.core`.
2018-12-01 17:19:34 -05:00
markrmiller e5281ef3d5 SOLR-12801: Don't possibly block forever in this test in remaining spots. 2018-12-01 13:02:58 -06:00
markrmiller b294d8460f SOLR-12801: Don't possibly block forever in this test in another spot. 2018-12-01 12:55:05 -06:00
markrmiller b5a9cca168 SOLR-12801: Raise THREAD_POOL_MAX_IDLE_TIME_MS. 2018-12-01 12:42:28 -06:00
markrmiller cbe9f82202 SOLR-12801: Don't possibly block forever in this test. 2018-12-01 08:58:13 -06:00
markrmiller 755044b58f SOLR-12801: Wait for collection creation in test. 2018-12-01 08:09:03 -06:00
markrmiller 9b0b9032e2 SOLR-12801: Fix thread leak in test. 2018-12-01 00:53:12 -06:00
markrmiller 33c40a8da4 SOLR-13027: Change retries to work across JVM impls properly by looking for an IOException. 2018-12-01 00:26:15 -06:00
markrmiller 7f88bfa112 SOLR-12801: Wait for collections properly. 2018-12-01 00:26:03 -06:00
markrmiller a3ec5b5fdf SOLR-12801: Wait for executor to finish shutdown. 2018-12-01 00:26:03 -06:00
markrmiller d8f482f5fb SOLR-13030: Update executor usage to work correctly with Java 11 and update Mockito & HttpComponents to work with Java 11 and fix get remote info retry to work across jvms better. 2018-12-01 00:26:02 -06:00
markrmiller a01d0d9ef9 SOLR-13030: Close MetricsHistoryHandler inline. 2018-11-30 18:13:26 -06:00
Chris Hostetter 5dc988f5ee SOLR-12839: JSON 'terms' Faceting now supports a 'prelim_sort' option to use when initially selecting the top ranking buckets, prior to the final 'sort' option used after refinement. 2018-11-30 15:49:06 -07:00
Cassandra Targett 5c4ab188eb SOLR-13023: Ref Guide: Add section to blob store docs on how to delete blobs 2018-11-30 12:31:03 -06:00
javanna cf016f8987 LUCENE-8563: Remove k1+1 constant factor from BM25 formula numerator.
Signed-off-by: Adrien Grand <jpountz@gmail.com>
2018-11-30 09:42:49 +01:00
markrmiller 75b1831967 SOLR-12801: Make massive improvements to the tests.
SOLR-12804: Remove static modifier from Overseer queue access.

SOLR-12896: Introduce more checks for shutdown and closed to improve clean close and shutdown. (Partial)

SOLR-12897: Introduce AlreadyClosedException to clean up silly close / shutdown logging. (Partial)

SOLR-12898: Replace cluster state polling with ZkStateReader#waitFor. (Partial)

SOLR-12923: The new AutoScaling tests are way too flaky and need special attention. (Partial)

SOLR-12932: ant test (without badapples=false) should pass easily for developers. (Partial)

SOLR-12933: Fix SolrCloud distributed commit.
2018-11-29 11:58:51 -06:00
David Smiley 2611c22b6b SOLR-12398: retroactively add CHANGES.txt back-compat break for 7.5 2018-11-28 07:21:34 -08:00
Cassandra Targett 2715beb6df SOLR-12497: fix typo 2018-11-27 13:56:19 -06:00
Joel Bernstein c2cac88770 SOLR-12984: The search Streaming Expression should properly support and push down paging when using the /select handler 2018-11-27 11:22:02 -05:00
David Smiley 1534bbe4ae SOLR-5211: fix test 2018-11-27 07:50:01 -08:00
Cassandra Targett 68c0774458 SOLR-12740: revise migration docs for clarity and typos 2018-11-26 12:15:15 -06:00
David Smiley dc134be449 SOLR-5211: ignore temporarily pending moshe fixing 2018-11-26 10:11:21 -05:00
Moshe a346ba0d3c SOLR-5211: Always populate _root_ (if defined).
And, small refactor: Clarified how _version_ is transferred from root to children.
2018-11-25 21:47:49 -05:00
Mikhail Khludnev d7b878e90c SOLR-12546: Let csv response writer to handle docValues fields by default. 2018-11-25 11:26:39 +03:00
Alan Woodward 2459072286 SOLR-12775: Add deprecated versions of LowerCaseTokenizer and LowerCaseTokenizerFactory 2018-11-22 13:54:39 +00:00
Andrzej Bialecki 67cdd21996 SOLR-9856: Update the Ref Guide to no longer list this issue as unresolved. 2018-11-21 19:13:02 +01:00
Noble Paul 492c3440de SOLR-13006: ZkNodeProps to be able to load from both javabin and JSON 2018-11-21 18:20:03 +11:00
Christine Poerschke ea304a3a32 Remove excess <metrics> element in metrics-reporting.adoc file. 2018-11-20 18:50:25 +00:00
Cao Manh Dat 05167ed01d SOLR-12986: HttpPartitionTest reliably failing seed 2018-11-20 15:01:19 +00:00
Noble Paul 25bca6f165 SOLR-12992: When using binary format, ExportWriter to directly copy BytesRef instead of creating new String 2018-11-20 14:58:32 +11:00
Cassandra Targett 4efaecac34 SOLR-12746: Fix formatting for callout list numbers and preamble sections 2018-11-19 14:53:05 -06:00
Christine Poerschke eb8010405d SOLR-12972: remove deprecated, unused SolrIndexConfig.luceneVersion 2018-11-19 14:51:13 +00:00
Christine Poerschke 7abb25eff5 SOLR-12972: deprecate unused SolrIndexConfig.luceneVersion 2018-11-19 14:06:09 +00:00
Alan Woodward c2bd3aed22 LUCENE-8497: Fix reference to MultiTermAwareComponenent in Solr reference guide 2018-11-19 12:12:24 +00:00
Alan Woodward 65486442c4 LUCENE-8497: Replace MultiTermAwareComponent with normalize() method 2018-11-19 10:09:37 +00:00
Jim Ferenczi 759af0127c LUCENE-8464: Fix legacy.TestMultiValuedNumericRangeQuery to count the number of hits accurately 2018-11-19 09:42:48 +01:00
Joel Bernstein a0788a7b5e SOLR-12997: Fix broken link on admin Stream panel 2018-11-18 14:24:02 -05:00
Jason Gerlowski d17c6d8897 SOLR-12981: Introduce SolrJ type for JSON facet response parsing
Recent JIRA's (SOLR-12947, SOLR-12965) have added support making it
easier to compose JSON query/faceting requests using SolrJ.  But neither
made parsing the responses to these queries any easier.

This commit introduces NestableJsonFacet (along with several companion
types) which are Java representations of the JSON faceting response.
They can be accessed via the new QueryResponse method:
`getJsonFacetingResponse()`.
2018-11-17 17:14:40 -05:00
Jim Ferenczi dc2c7784e6 Fix legacy.TestNumericRangeQuery to count the number of hits accurately 2018-11-17 21:20:27 +01:00
Christophe Bismuth b4449c73e4 LUCENE-8464: ConstantScoreScorer now implements setMinCompetitveScore in order to early terminate the iterator if the minimum score is greater than the constant score.
Signed-off-by: Jim Ferenczi <jimczi@apache.org>
2018-11-16 15:14:11 +01:00
Adrien Grand 3302ed2ac6 LUCENE-8470: Remove legacy doc values APIs from lucene/core. 2018-11-16 14:24:34 +01:00
Cassandra Targett df5540acc9 SOLR-12497: Add documentation for Hadoop credential provider-based keystore/truststore 2018-11-15 00:35:25 -06:00
Erick Erickson 763e64260f SOLR-12881: Remove unneeded import statements 2018-11-14 17:48:15 -08:00
Cassandra Targett 95d01c6583 SOLR-12927: fix ByteBuffersDirectoryFactory name 2018-11-13 08:37:10 -06:00
Cassandra Targett c80726d968 SOLR-12913: small grammatical fixes 2018-11-13 08:03:29 -06:00
Cassandra Targett 92c83264c8 SOLR-12927: copy edits (i.e., e.g., capitalized titles, etc.) 2018-11-12 20:02:30 -06:00
Cassandra Targett 8791a38d75 SOLR-12927: Add upgrade notes for Solr 7.6 2018-11-12 20:02:30 -06:00
Noble Paul e81dd4e870 SOLR-12977: fixed bug 2018-11-13 00:10:04 +11:00
Cao Manh Dat f357c06276 SOLR-12969: Inconsistency with leader when PeerSync return ALREADY_IN_SYNC 2018-11-12 10:10:22 +00:00
Noble Paul cd1e829732 SOLR-12978: In autoscaling NPE thrown for nodes where value is absent 2018-11-12 18:53:16 +11:00
Noble Paul e6e6ad2c83 SOLR-12977: Autoscaling tries to fetch metrics from dead nodes 2018-11-12 18:44:26 +11:00
Noble Paul 605c3f6f1a SOLR-12977: Autoscaling tries to fetch metrics from dead nodes 2018-11-12 18:39:05 +11:00
Jason Gerlowski 52998fa50e SOLR-12965: Add facet support to JsonQueryRequest 2018-11-10 21:44:25 -05:00
Cao Manh Dat 397b88aefa SOLR-12313: No need to wait for in-sync with leader in RecoveryAfterSoftCommitTest since we only care about recovery 2018-11-10 06:01:19 +00:00
Nicholas Knize 6d9c714052 Add 7.7.0 version 2018-11-09 15:20:33 -06:00
David Smiley 0330372f04 SOLR-12759: fix regexp (case insensitive) 2018-11-09 15:58:40 -05:00
Jason Gerlowski 4410ef941a SOLR-12947: Misc JsonQueryRequest code cleanup 2018-11-09 13:15:08 -05:00
Chris Hostetter 77a4bfaa90 SOLR-12962: Added a new 'uninvertible' option for fields and fieldtypes. This defaults to 'true' for backcompat allowing a FieldCache to be built for indexed fields as needed, but users are encouraged to set this to false (using docValues as needed) to reduce the risk of large fluxuations in heap size due to unexpected attempts to sort/facet/function on non-docValue fields. 2018-11-09 08:30:04 -07:00
Tim Underwood fbb987282e SOLR-12880: Show the FacetProcessor class name instead of the
FacetRequest in the JSON Facets debug-trace output
2018-11-08 23:32:26 -05:00
Joel Bernstein 780305cf44 SOLR-12913: Fix typo in User Guide 2018-11-08 20:06:05 -05:00
Cassandra Targett 73005d482d Ref Guide: fix pages missing header license info 2018-11-08 15:02:33 -06:00
Joel Bernstein 01397c1b88 SOLR-12913: Add ltrim and rtrim to the Math Expressions User Guide 2018-11-08 15:29:15 -05:00
Tim Underwood 243a8a668a SOLR-12964: Use DocValuesIterator.advanceExact() instead of the advance()/docID() pattern 2018-11-08 14:34:17 -05:00
Jason Gerlowski 1b084db901 SOLR-12947: Add MapWriter compatibility to JsonQueryRequest
JsonQueryRequest had `setQuery` methods that took in a query either as a
String or as a Map.  But no such overload for MapWriter, a SolrJ
interface used to transmit Maps via "push writing" over the wire.  This
commit adds an overload taking this type, so that users can specify
their queries this way as well.

This commit also changes JsonQueryRequest writes out the request, to
ensure it uses "push writing" in non-MapWriter cases as well.
2018-11-07 21:40:06 -05:00
Joel Bernstein 65dc312daf SOLR-12975: Update CHANGES.txt 2018-11-07 21:03:01 -05:00
Joel Bernstein 2d0e565c62 SOLR-12975: Add ltrim and rtrim Stream Evaluators 2018-11-07 20:47:07 -05:00
Gus Heck 53482e510c SOLR-12938 - fix test case for handling of bogus collection names
that was failing when HttpClusterStateProvider is used instead of
ZkClusterStateProvider
2018-11-07 20:05:32 -05:00
Joel Bernstein 9594ee38bb SOLR-12913: grammer fix 2018-11-07 15:29:13 -05:00
Joel Bernstein 531b16633a SOLR-12913: Add new facet expression and pivot docs 2018-11-07 15:07:46 -05:00
Joel Bernstein f2cb93605c SOLR-12829: Update CHANGES.txt 2018-11-07 11:22:03 -05:00
Joel Bernstein a197904743 SOLR-12936: Update CHANGES.txt 2018-11-07 09:43:41 -05:00
Joel Bernstein 7bde5e2343 SOLR-11572: Update CHANGES.txt 2018-11-07 09:38:19 -05:00
Joel Bernstein bc88d78c84 SOLR-12795: Update CHANGES.txt 2018-11-07 09:28:47 -05:00
Joel Bernstein e1bdb9a751 SOLR-12971: Update CHANGES.txt 2018-11-07 09:20:33 -05:00
Joel Bernstein 259925d12f SOLR-12795: Require bucketSorts 2018-11-07 08:58:57 -05:00
Joel Bernstein 80efc23999 SOLR-12971: Add pivot Stream Evaluator to pivot facet co-occurrence counts into a matrix 2018-11-07 08:14:17 -05:00
Alexandre Rafalovitch 936ecf12fb Remove hyperlink to - now spammy - heliosearch domain 2018-11-07 07:26:12 -05:00
Alexandre Rafalovitch 50cf1cca26 SOLR-12600: Add missing name in CHANGES
Missed it on the last commit
2018-11-07 07:11:03 -05:00
Alexandre Rafalovitch 419d42bf7b SOLR-12600: Fix parameter names in Solr JSON documentation 2018-11-07 07:01:06 -05:00
Noble Paul 6f6a880ec2 SOLR-12023: correcting wrong git merge 2018-11-07 12:56:00 +11:00
David Smiley d0cd4245bd LUCENE-8557: LeafReader.getFieldInfos should always return the same instance
MemoryIndex: compute/cache up-front
Solr Collapse/Expand with top_fc: compute/cache up-front
Json Facets numerics / hash DV: use the cached fieldInfos on SolrIndexSearcher
SolrIndexSearcher: move the cached FieldInfos to SlowCompositeReaderWrapper
2018-11-06 14:45:32 -05:00
Joel Bernstein b230543b47 SOLR-12795: Fix precommit 2018-11-06 11:53:00 -05:00
Joel Bernstein 3d94213110 SOLR-12795: Introduce 'rows' and 'offset' parameter in FacetStream 2018-11-06 11:23:40 -05:00
Alexandre Rafalovitch 0ddbc4bf95 SOLR-12966: Add Javadoc @since tag to URP classes 2018-11-06 08:05:07 -05:00
Alexandre Rafalovitch c07df19666 SOLR-12956: Add Javadoc @since tag to Analyzer component classes 2018-11-06 07:38:20 -05:00
Jason Gerlowski 2d95b740db SOLR-12947: Add SolrJ helper for making JSON DSL requests
The JSON request API is great, but it's hard to use from SolrJ.  This
commit adds 'JsonQueryRequest', which makes it much easier to write
JSON API requests in SolrJ applications.
2018-11-06 07:34:53 -05:00
Noble Paul 08fcce4c98 SOLR-11997: Suggestions API/UI should show an entry where a violation could not be resolved 2018-11-06 22:27:26 +11:00
Cao Manh Dat 13a83564bb SOLR-12313: Make the test finish quicker by lower down intervals 2018-11-06 11:19:13 +00:00
Christine Poerschke be65b95e80 SOLR-12699: Make contrib/ltr LTRScoringModel immutable and cache its hashCode.
(Stanislav Livotov, Edward Ribeiro, Christine Poerschke)
2018-11-05 18:56:40 +00:00
Steve Rowe 01808eee93 SOLR-12243: Edismax missing phrase queries when phrases contain multiterm synonyms 2018-11-05 10:32:49 -05:00
Cassandra Targett 1e3cc4861a SOLR-12746: Simplify the Ref Guide HTML structure and use semantic HTML tags where possible. Adds new template files for Asciidoctor HTML conversion. 2018-11-05 09:07:01 -06:00
Gus Heck 45b772f4a9 SOLR-12938 - Cluster status now returns results for aliases instead of
throwing an exception
2018-11-04 12:01:51 -05:00
Noble Paul eb359ca079 SOLR-12023: Autoscaling policy engine shuffles replicas needlessly 2018-11-04 19:23:56 +11:00
Jason Gerlowski f669a1fb0e SOLR-12555: Use `expectThrows` for expected exceptions
This commit replaces the `try { doX(); fail(); }` pattern with the
`expectThrows` test helper, which was created for this purpose.

This commit makes these changes in the core package: `o.a.solr.search`.

Closes #464
2018-11-03 10:48:16 -04:00
Chris Hostetter c5ff4a4444 SOLR-12954: fix facet.pivot refinement bugs when using facet.sort=index and facet.mincount>1 2018-11-02 20:32:32 -07:00
Chris Hostetter 1e0e8d45e5 SOLR-7804: remove problematic assertions on lossy stats.field values that aren't fundemental to the purpose of the test anyway 2018-11-01 22:03:20 -07:00
Gus Heck 23595e5cc4 Supress an IDE warning with an annotation, and verify my commit karma 2018-11-01 21:27:16 -04:00
Tim Underwood cf445ba549 SOLR-12882: Eliminate excessive lambda allocation in json facet FacetFieldProcessorByHashDV.collectValFirstPhase 2018-11-01 15:05:16 -04:00
Chris Hostetter 05f72a77ef SOLR-12946: tighten up request/expectations in test
This should prevent some non-reproducible failures where (i think) the problem was inconsistnet background merges between collections being compared, resulting in facet counts (of 0) for terms that weren't in equivilent (merged) indexes.

since the purpose of the test has nothing to do with mincount, force facet.mincount=0 and be more exact about how many terms we expect (in case the root problem lies somewhere else, be more assertive about finding it)
2018-10-31 15:33:39 -07:00
Andrzej Bialecki 3ed64375ef SOLR-12942: Add an option in IndexSizeTrigger to select the split shard method. 2018-10-31 18:47:34 +01:00
Joel Bernstein 914c431987 SOLR-12913: Add recip and expand percentile docs 2018-10-31 08:48:04 -04:00
Joel Bernstein 856e28d8cf SOLR-11572: Add recip Stream Evaluator to support reciprocal transformations 2018-10-30 09:42:24 -04:00
Mikhail Khludnev 5aa8ad5b14 SOLR-12875: AIOOBE fix when unique()/uniqueBlock() is used with DVHASH method in json.facet 2018-10-30 10:56:34 +03:00
Joel Bernstein ac1925045d SOLR-12936: Allow percentiles Stream Evaluator to accept an array of percentiles to calculate 2018-10-29 16:29:04 -04:00
Joel Bernstein e618e831d3 SOLR-12935: Suppress SSL for StreamExpressionTest and StreamDecoratorTest 2018-10-29 13:49:31 -04:00
Steve Rowe c7c7b00ff9 SOLR-12861: In the upgrade note, specify the Solr version in which RAMDirectory will be removed. 2018-10-29 08:44:59 -04:00
Steve Rowe d362439e27 SOLR-12861: Add Solr factory for new ByteBuffersDirectory 2018-10-29 08:23:14 -04:00
Joel Bernstein 5fc4d516b1 SOLR-12862: Update CHANGES.txt 2018-10-28 17:08:26 -04:00
Joel Bernstein 416cc163ba SOLR-12840: Update CHANGES.txt 2018-10-28 14:26:57 -04:00
Joel Bernstein f8ffc1afd6 SOLR-12811: Update CHANGES.txt 2018-10-28 13:47:12 -04:00
Joel Bernstein 7a63e13a3b SOLR-11907: Update CHANGES.txt 2018-10-28 13:42:29 -04:00
Joel Bernstein 1abc38b40e SOLR-12828: Update CHANGES.txt 2018-10-28 13:30:43 -04:00
Noble Paul a298802516 SOLR-12868: test was making wrong assumption 2018-10-27 11:11:54 +11:00
Joel Bernstein 0c8675dccc SOLR-12913: RefGuide formatting 2018-10-26 13:41:09 -04:00
Joel Bernstein 4821b30598 SOLR-12913: RefGuide revisions 2018-10-26 13:31:53 -04:00
Marvin Bredal Lillehaug 6c419454a2 SOLR-7557: Fix parsing of child documents using queryAndStreamResponse 2018-10-26 14:59:31 +02:00
Noble Paul f33be7a172 SOLR-12868: Request forwarding for v2 API is broken 2018-10-26 12:50:45 +11:00
Cassandra Targett 8d10939349 SOLR-12423: fix Tika version in CHANGES 2018-10-25 11:56:19 -05:00
Cassandra Targett 93ccdce57c SOLR-5004: put param names and values in monospace 2018-10-25 11:06:25 -05:00
Joel Bernstein 7952cec99a SOLR-12913: Streaming Expressions / Math Expressions docs for 7.6 release 2018-10-25 09:17:25 -04:00
Tommaso Teofili 26e14986af SOLR-12879 - added missing test for min_hash qp to QueryEqualityTest 2018-10-25 09:57:16 +02:00
Varun Thacker 71988c756b SOLR-12793: Move TestCloudJSONFacetJoinDomain amd TestCloudJSONFacetSKG to the facet test package 2018-10-24 13:57:35 -07:00
Cassandra Targett 16ee847663 SOLR-12827: remove monospace in headings; correct formatting for heading level indicator; remove redundant "Example #" in the example titles 2018-10-24 15:04:33 -05:00
Cassandra Targett b72f05dac6 SOLR-9317: cleanup a couple of typos; add some description to addreplica examples 2018-10-24 14:41:36 -05:00
Christine Poerschke e62fe45983 SOLR-12772: Correct dotProduct parameters+syntax documentation 2018-10-24 19:49:35 +01:00
Christine Poerschke ab14cc9566 SOLR-9425: fix NullPointerException in TestSolrConfigHandlerConcurrent 2018-10-24 19:30:44 +01:00
Christine Poerschke c277674f0e SOLR-12873: Replace few remaining occurrences of LUCENE_CURRENT with LATEST for luceneMatchVersion. 2018-10-24 19:28:12 +01:00
Christine Poerschke 7fc91deaba SOLR-12905: MultiSolrCloudTestCase now clears static clusterId2cluster in @AfterClass 2018-10-24 19:25:10 +01:00
Christine Poerschke cebf7039ee Fix typo in stream-decorator-reference.adoc file. 2018-10-24 19:22:51 +01:00
Cao Manh Dat e083b1501e Add log.warn when a replica become leader after timeout 2018-10-24 08:56:01 +07:00
David Smiley 3e89b7a771 SOLR-12754: New hl.weightMatches for UnifiedHighlighter WEIGHT_MATCHES
(defaults to true in master/8)
2018-10-23 13:28:10 -04:00
Tommaso Teofili 2e757f6c25 SOLR-12879 - registered MinHashQParserPlugin to QParserPlugin as min_hash 2018-10-23 09:12:46 +02:00
Tommaso Teofili 9df96d2530 SOLR-12879 - added missing attribution in CHANGES.txt 2018-10-23 09:07:38 +02:00
Cao Manh Dat 7512cd9425 SOLR-11812: Remove LIROnShardRestartTest since the transition from old lir to new lir is no longer supported 2018-10-23 09:58:59 +07:00
noble 576d28f643 SOLR-11522: Moved the _get methods to a separate interafce and keep MapWriter clean 2018-10-23 12:35:23 +11:00
Anshum Gupta d799fd53c7 SOLR-5004: Allow a shard to be split into 'n' sub-shards using the collections API 2018-10-22 15:01:24 -07:00
Joel Bernstein fcaea07f3c SOLR-12829: Add plist (parallel list) Streaming Expression 2018-10-22 15:20:13 -04:00
Christine Poerschke c9776d88f9 Three minor variables.adoc edits. 2018-10-22 17:33:11 +01:00
Noble Paul c31a95d261 SOLR-12846: Added support for "host" variable in autoscaling policy rules 2018-10-23 00:03:59 +11:00
Andrzej Bialecki 8c70811f3a SOLR-12729: Unlock the shard on error. 2018-10-22 11:28:09 +02:00
Noble Paul 5de6332209 SOLR-12892: MapWriter to use CharSequence instead of String 2018-10-22 11:14:41 +11:00
Tommaso Teofili a7c9c9d8ce SOLR-12879 - MinHash query parser 2018-10-20 08:28:02 +02:00
Andrew Lundgren 1a8188d92b SOLR-10981: Support for stream.url or stream.file pointing to gzipped data 2018-10-18 19:53:21 -04:00
David Smiley fd9164801e LUCENE-7875: Moved MultiFields static methods to MultiTerms, FieldInfos and MultiBits.
MultiBits is now public and has getLiveDocs.
2018-10-18 19:49:14 -04:00
Jan Høydahl a3fc31e5d2 Remove unnecessary XML exclusions as Jetty handles these by default (janhoy) 2018-10-18 16:38:52 +02:00
Simon Willnauer 5a4fd86cce LUCENE-8535: Drop out of the box Block-Join highlight support
Highlighter doesn't support ToParent and ToChildBlockJoinQuery out of the
box anymore. In oder to highlight on Block-Join Queries a custom WeightedSpanTermExtractor
should be used.
2018-10-18 14:53:01 +02:00
Jason Gerlowski e6f6f352cf SOLR-12856: Small improvements to SolrJ javadocs 2018-10-17 19:10:56 -04:00
Uwe Schindler 4b2136eb3c SOLR-12874: Java 9+ GC Logging filesize parameter should use a unit
(merge branch 'java9plus_gc_logging_filesize' of https://github.com/tpunder/lucene-solr); this closes #470
2018-10-17 23:24:51 +02:00
Erick Erickson fc886497de SOLR-12423: Upgrade to Tika 1.19.1 when available. Fixes #468 2018-10-17 13:06:09 -04:00
Noble Paul 635d1ea535 SOLR-12740: fixed doc asciidoc errors 2018-10-17 12:16:17 +11:00
Christine Poerschke d2f7272b0e SOLR-12877: avoid NPE in TestUtilizeNode.getReplicaList 2018-10-16 12:54:00 -04:00
Christine Poerschke 15002eba2f SOLR-12877: avoid NPE in TestTlogReplica.testRealTimeGet 2018-10-16 12:52:51 -04:00
Christine Poerschke 95af8d6ac2 SOLR-12876: remove @BadApple from ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:51 -04:00
Christine Poerschke 7fa19d2676 SOLR-12876: upon failure report exception message in ShardParamsTest.testGetShardsTolerantAsBool 2018-10-16 10:52:11 -04:00
Noble Paul 761f8aaf79 SOLR-12740: adding a link 2018-10-17 00:22:54 +11:00
Noble Paul f1a30bfb00 SOLR-12792: extract test data into separate files in autoscaling tests 2018-10-16 19:11:08 +11:00
Shalin Shekhar Mangar aa0a5289e6 SOLR-12739: Clear all collections in TestCollectionStateWatchers setup so that the collections created by test methods are spread evenly in the cluster. 2018-10-16 12:14:22 +05:30
Noble Paul 8d3810df54 SOLR-12740: migration docs 2018-10-16 17:38:51 +11:00
Noble Paul 9c7b8564d8 SOLR-12806: use autoscaling policies with strict=false to prioritize node allocation 2018-10-16 16:56:51 +11:00
David Smiley 306065fca8 LUCENE-12357: Update ref guide notes 2018-10-15 23:38:09 -04:00
Tim Underwood 5202a713ba Java 9+ GC Logging filesize parameter should be 20M instead of 20000
JEP 158 (https://openjdk.java.net/jeps/158) says the filesize parameter is the “file size in kb” however that appears to not be the case since when it is set to a value of 20000 you end up with GC logs that are only 20000 bytes in length.  Setting the value to 20M produces the desired result of GC log files that are 20MB in size.
2018-10-15 12:52:40 -07:00
Joel Bernstein 73a413cd85 SOLR-12862: Fix TestLang 2018-10-15 15:47:03 -04:00
Joel Bernstein 6c0fbe5a9d SOLR-12862: Add log10 Stream Evaluator and allow the pow Stream Evaluator to accept a vector of exponents 2018-10-15 15:47:03 -04:00
Christine Poerschke 1ccd555862 Fix couple of typos. 2018-10-15 15:08:17 -04:00
Erick Erickson 6c5df58b5a SOLR-12028: BadApple and AwaitsFix annotations usage 2018-10-14 21:13:33 -04:00
Jason Gerlowski 6d1b2e2f38 SOLR-8808: Add null/empty check to SolrClient.deleteByIds 2018-10-13 22:15:36 -04:00
Christine Poerschke 9c8ffabfe3 SOLR-12780: Add support for Leaky ReLU and TanH activations in contrib/ltr NeuralNetworkModel class.
(Kamuela Lau, Christine Poerschke)
2018-10-12 17:08:35 +01:00
Jason Gerlowski 42ac07d11b SOLR-12565: Add SolrJ snippet to 'Using ZooKeeper to manage config' ref-guide page 2018-10-11 14:30:43 -04:00
Joel Bernstein d48f22c1ad SOLR-12851: Update CHANGES.txt 2018-10-11 11:19:57 -04:00
Joel Bernstein a0bb501772 SOLR-12851: Improvements and fixes to let and select Streaming Expressions 2018-10-11 10:43:57 -04:00
Shalin Shekhar Mangar 971a0e3f4a SOLR-12739: Use legacy assignment in AutoAddReplicasPlanActionTest 2018-10-11 08:58:47 +05:30
Jan Høydahl 80011d669a SOLR-12620: Remove the Admin UI Cloud -> Graph (Radial) view 2018-10-10 21:54:34 +02:00
Shalin Shekhar Mangar 095707d547 SOLR-12739: Remove unused import 2018-10-10 18:18:29 +05:30
Shalin Shekhar Mangar 50d1c7b481 SOLR-12739: Release the policy session as soon as we're done with the computation.
This fixes the CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes test failures. Due to the various tests for exceptional conditions, there were times where the session was not released causing stale data to remain in the policy session cache.
2018-10-10 17:12:50 +05:30
Shalin Shekhar Mangar 940a7303ee SOLR-12739: Use cluster instead of collection as the key for using legacy assignment. 2018-10-10 16:19:17 +05:30
Shalin Shekhar Mangar 9f34a7c776 SOLR-12739: Fix failures in AutoAddReplicasIntegrationTest and its sub-class.
This test too makes assumptions about how replicas are placed. In the legacy assignment strategy, the replica of a given collection are spread equally across all nodes but with the new policy based strategy, all cores across collections are spread out. Therefore the assumptions in this test were wrong. I've changed this test to use the legacy assignment policy because testing the autoAddReplicas feature doesn't have to depend on new replica assignment strategies. This change also fixes a bug in Assign which used "collection" key instead of "cluster" to figure out which strategy to use.
2018-10-10 15:38:52 +05:30
Shalin Shekhar Mangar a66a7f3197 SOLR-12739: Fix CloudSolrClientTest.testNonRetryableRequests failures.
The testNonRetryableRequests test makes an assumption that a collection's replicas are equally distributed among all nodes but with the policy engine it is not true. Instead the policy engine spreads out the cores belonging to all collections equally among all nodes. This is fixed by only creating the collection needed by tests in this class just-in-time.
2018-10-10 13:12:26 +05:30
Noble Paul 3629e76011 SOLR-12843: precommit errors 2018-10-10 15:38:20 +11:00
Steve Rowe 8d205ecd1c SOLR-12843: fix precommit 2018-10-09 17:42:41 -04:00
Steve Rowe 41e3d07369 SOLR-11812: fix precommit 2018-10-09 17:34:16 -04:00
Steve Rowe 50478ea72d SOLR-11812: fix precommit 2018-10-09 17:27:21 -04:00
Andrzej Bialecki 23e22e6460 SOLR-12729: SplitShardCmd should lock the parent shard to prevent parallel splitting requests. 2018-10-09 21:30:10 +02:00
Noble Paul a52d47a1a5 SOLR-12843: precommit errors 2018-10-09 23:17:09 +11:00
Cao Manh Dat a37a213975 SOLR-11812: Remove backward compatibility of old LIR implementation in 8.0 2018-10-09 16:20:49 +07:00
Shalin Shekhar Mangar 184ed88ecb SOLR-12845: Disable the test until we can add a default policy equivalent to the hard coded legacy assignment rules 2018-10-09 13:54:46 +05:30
Noble Paul b4d9b25f44 SOLR-12843: Implement a MultiContentWriter in SolrJ to post multiple files/payload at once 2018-10-09 17:44:40 +11:00
Shalin Shekhar Mangar dbed8bafe6 SOLR-12739: Autoscaling policy framework is now used as the default strategy to select the nodes on which new replicas or replicas of new collections are created.
Previously, the maxShardsPerNode parameter was not allowed on collections when autoscaling policy was configured. Also if an autoscaling policy was configured then the default was to set an unlimited maxShardsPerNode automatically. Now the maxShardsPerNode parameter is always allowed during collection creation and maxShardsPerNode should be set correctly (if required) regardless of whether autoscaling policies are in effect or not. The default value of maxShardsPerNode continues to be 1 as before. It can be set to -1 during collection creation to fall back to the old behavior of unlimited maxShardsPerNode when using autoscaling policy. This patch also fixes PolicyHelper to find the free disk space requirements of a new replica from the leader only if said leader node is alive.
2018-10-09 12:10:28 +05:30
Nicholas Knize 1118299c33 LUCENE-8496: Selective indexing - modify BKDReader/BKDWriter to allow users to select a fewer number of dimensions to be used for creating the index than the total number of dimensions used for field encoding. i.e., dimensions 0 to N may be used to determine how to split the inner nodes, and dimensions N+1 to D are ignored and stored as data dimensions at the leaves. 2018-10-08 18:51:03 -05:00
Joel Bernstein df07a43b56 SOLR-12749: Update CHANGES.txt 2018-10-08 13:05:26 -04:00
Joel Bernstein 6a702ee16b SOLR-12840: Add pairSort Stream Evaluator 2018-10-08 12:53:23 -04:00
David Smiley 49285e8423 Solr CHANGES.txt: forgot leading "*" 2018-10-07 23:17:33 -04:00
Jason Gerlowski 367bdf7f74 SOLR-12803: Ensure CUSC routes docs to right cores
ConcurrentUpdateSolrClient can batch together many documents when making
an indexing request to Solr.  When adding an update request to the
current batch being made, it checks that the query-parameters of the
docs being added match those already in the batch.  But prior to this
commit it never checked that the collections/cores were the same.

This could result in documents being sent to the wrong collection if the
same client is used to index documents to two different
cores/collections simultaneously.

This commit addresses this problem, ensuring that documents aren't added
to a batch directed at a different core/collection.
2018-10-07 10:08:50 -04:00
David Smiley e2b8beccb0 SOLR-12782: UninvertingReader avoids FieldInfo creation.
Wrapping is now a bit more lightweight: Does not create FieldInfo for fields that
can't be uninverted (saves mem) and can avoid wrapping the reader altogether if there's nothing to uninvert.
IndexSchema.getUninversionMap refactored to getUninversionMapper and no longer merges FieldInfos.
2018-10-05 20:40:39 -07:00
Shalin Shekhar Mangar eb47099ee2 SOLR-12836: ZkController creates a cloud solr client with no connection or read timeouts.
This changes ZkController to use the http client created by the update shard handler instead of creating a custom one.
2018-10-05 15:18:11 +05:30
Shalin Shekhar Mangar ace0db7a0a SOLR-12835: Document statistics exposed by the Query Result Cache when maxRamMB is configured 2018-10-05 08:20:31 +05:30
Noble Paul 14e6eb2c24 use MapWriter._get() 2018-10-05 08:32:00 +10:00
Jan Høydahl 5fb384c989 SOLR-12814: Metrics history causing "HttpParser URI is too large >8192" when many collections
This fixes #461
2018-10-04 18:32:38 +02:00
Joel Bernstein a0487b04ea SOLR-12811: Add enclosingDisk and associated geometric Stream Evaluators 2018-10-04 10:36:27 -04:00
Shalin Shekhar Mangar 793a677d0f SOLR-12827: Fix blurb in ref guide to say that the key is deprecated instead of saying that it is no longer supported. 2018-10-04 16:22:29 +05:30
Andrzej Bialecki 452c2dabf0 SOLR-12815: Implement maxOps limit for IndexSizeTrigger. 2018-10-04 12:48:25 +02:00
Shalin Shekhar Mangar 152fd966a7 SOLR-12827: Migrate cluster wide defaults syntax in cluster properties to a nested structure
The cluster wide defaults structure has changed from {collectionDefaults: {nrtReplicas : 2}} to {defaults : {collection : {nrtReplicas : 2}}}.  The old format continues to be supported and can be read from ZK as well as written using the V2 set-obj-property syntax but it is deprecated and will be removed in Solr 9. We recommend that users change their API calls to use the new format going forward.
2018-10-04 16:12:55 +05:30
Shalin Shekhar Mangar 05949a32c9 SOLR-12648: Use the information whether custom preferences were specified in the CloudUtil.usePolicyFramework method instead of comparing directly against default preferences. Comparing against default preferences was wrong because it ignores the case where the user explicitly added the same preferences as the default ones. 2018-10-04 13:26:51 +05:30
Shalin Shekhar Mangar 554ac64666 SOLR-12524: Marking the test as AwaitsFix 2018-10-04 06:53:10 +05:30
Tomas Fernandez Lobbe 46f753d7c6 SOLR-12767: Always include the achieved rf in the response
This commit deprecates the min_rf parameter. Solr now always includes the achieved replication
factor in the update requests (as if min_rf was always specified). Also, reverts the changes
introduced in SOLR-8034, replicas that don't ack an update will have to recover to prevent
inconsistent shards.
2018-10-03 09:40:15 -07:00
Joel Bernstein 751bf7db20 SOLR-12828: Add oscillate Stream Evaluator to support sine wave analysis 2018-10-03 12:25:35 -04:00
Noble Paul d8e40796e2 SOLR-12822: /autoscaling/suggestions to include suggestion to add-replica for lost replicas 2018-10-03 23:37:58 +10:00
Andrzej Bialecki abace2987a Fix the CHANGES entry - this is applicable only to 8.0 codebase. 2018-10-03 14:11:43 +02:00
Andrzej Bialecki eba7bedadf SOLR-12725: ParseDateFieldUpdateProcessorFactory should reuse ParsePosition. 2018-10-03 13:59:02 +02:00
Shalin Shekhar Mangar 84683b6aa0 SOLR-12750: Migrate API should lock the collection instead of shard 2018-10-03 16:24:26 +05:30
Shalin Shekhar Mangar 65105aa81b SOLR-12648: Autoscaling framework based replica placement is not used unless a policy is specified or non-empty cluster policy exists 2018-10-03 15:52:51 +05:30
Andrzej Bialecki e687748405 SOLR-12080: Disable this test until it's fixed. 2018-10-03 07:56:26 +02:00
Andrzej Bialecki 2201b65266 SOLR-12709: Several fixes to the simulator and its .system collection auto-creation. 2018-10-02 17:35:45 +02:00
Noble Paul 4ca885ac9e SOLR-12824: fixed test failure 2018-10-02 21:17:22 +10:00
Noble Paul 961d565955 SOLR-12824: NamedList to implement MapWriter interface 2018-10-02 17:34:58 +10:00
David Smiley fe844c739b LUCENE-8513: Remove MultiFields.getFields
SlowCompositeReaderWrapper now works with MultiTerms directly
2018-10-01 10:39:12 -04:00
Noble Paul 86e00405b0 SOLR-12792: extract out test data 2018-10-01 22:00:09 +10:00
Cao Manh Dat 93e2ae3fc4 SOLR-12774: IndexOutOfBoundsException on logging startupVersions 2018-10-01 15:25:30 +07:00
Joel Bernstein 3ece536d81 SOLR-11907: Change error message if ConvexHull2D is not provided as the first parameter 2018-09-30 21:11:23 -04:00
Joel Bernstein 3fc58f4a98 SOLR-11907: Add convexHull and associated geometric Stream Evaluators 2018-09-30 20:56:03 -04:00
David Smiley 964cc88cee SOLR-12593: remove date parsing from extract contrib
* added "ignored_*" to the default configSet
* Updated Ref Guide info on Solr Cell to demonstrate usage without using the techproducts configSet

Closes #438
2018-09-28 16:50:11 -04:00