Commit Graph

12120 Commits

Author SHA1 Message Date
Jan Høydahl 6845bbff55 SOLR-8207: Collections with underscores in name no longer cause a crash the Cloud->Nodes UI 2018-08-08 15:25:43 +02:00
Jan Høydahl 9306922d65 SOLR-7767: "ZK Status" sub menu under "Cloud" tab to see status of zookeeper ensemble 2018-08-08 12:43:19 +02:00
Moshe 38bf976cd4 SOLR-12485: Solr-Update XML format now accepts child documents under a field
thus providing a semantic relationship.  (like allowed for JSON).
Improved XML.java a bit
Closes #430
2018-08-07 13:52:11 -04:00
David Smiley c3887b351e SOLR-12586: Change ParseDateFieldUpdateProcessorFactory to use java.time.DateTimeFormatter, not Joda Time.
Note: slightly different pattern language!
Remove Joda Time.
Closes #428
2018-08-07 11:51:16 -04:00
Joel Bernstein 2ca5a6d12e SOLR-12629: The predict evaluator should work with the polyfit function 2018-08-07 10:31:53 -04:00
Andrzej Bialecki 208d59b5e3 SOLR-12541: Metrics handler throws an error if there are transient cores. 2018-08-07 13:21:41 +02:00
Erick Erickson 08ca54f1f8 SOLR-11770: NPE in tvrh if no field is specified and document doesn't contain any fields with term vectors, forgot to add CHANGES.txt 2018-08-06 20:05:52 -07:00
Erick Erickson 96e8392921 SOLR-11770: NPE in tvrh if no field is specified and document doesn't contain any fields with term vectors 2018-08-06 20:04:59 -07:00
Tomas Fernandez Lobbe 896fd0ebd5 SOLR-12222: Improve TestDistributedSearch search
Consider the case when the distributed requests fails with timeAllowed before it reaches the shards
2018-08-06 16:58:08 -07:00
Tomas Fernandez Lobbe db1e0642cb SOLR-12626: TestInjection.waitForInSyncWithLeader retries in case of errors
When waiting for follower replicas to be in sync with the leader, TestInjection.waitForInSyncWithLeader
now keeps waiting even if it gets an exception while trying to get leader's replication details. The
method will only exit when it exhausts the number of retries or succeeds.
2018-08-06 15:59:25 -07:00
Tomas Fernandez Lobbe c338cf61e7 SOLR-11881: Retry update requests from leaders to followers 2018-08-06 15:56:49 -07:00
Noble Paul ffedb99dc8 SOLR-12592: added javadoc 2018-08-05 11:56:22 +10:00
Varun Thacker 592899a419 SOLR-12615: HashQParserPlugin won't throw an NPE for string hash key and documents with empty value 2018-08-04 14:32:36 -07:00
Varun Thacker b33df4ecff SOLR-12622: Ref guide example for configuring SolrSlf4jReporter 2018-08-04 11:13:22 -07:00
noble 664187f73a SOLR-12592: added support for range , percentage and decimal 2018-08-04 16:34:23 +10:00
Jan Høydahl f8db5d0afd SOLR-12614: Make "Nodes" view the default in AdminUI "Cloud" tab 2018-08-03 23:20:48 +02:00
Varun Thacker 0b59b0ed1d SOLR-12617: remove beanutils license and notice files 2018-08-03 13:38:10 -07:00
Varun Thacker e3cdb395a4 SOLR-12617: Remove Commons BeanUtils as a dependency 2018-08-03 09:46:54 -07:00
Jan Høydahl 17a02c1089 SOLR-8207: Add "Nodes" view to the Admin UI "Cloud" tab, listing nodes and key metrics 2018-08-03 13:55:11 +02:00
Erick 6afd3d1192 SOLR-12028: BadApple and AwaitsFix annotations usage 2018-08-02 17:40:59 -07:00
Andrzej Bialecki b5ed6350a0 SOLR-12509: Fix a bug when using round-robin doc assignment. 2018-08-02 21:17:15 +02:00
Andrzej Bialecki d1173b8adc SOLR-12594: MetricsHistoryHandler.getOverseerLeader fails when hostname contains hyphen. 2018-08-02 18:47:58 +02:00
Andrzej Bialecki 5de10c7966 SOLR-12344: SolrSlf4jReporter doesn't set MDC context. 2018-08-02 14:29:47 +02:00
Noble Paul 868e970816 SOLR-12592: support #EQUAL function in cores in autoscaling policies 2018-08-02 15:20:46 +10:00
Shalin Shekhar Mangar 259bc2baf7 SOLR-12607: Fixed two separate bugs in shard splits which can cause data loss. The first case is when using TLOG replicas only, the updates forwarded from parent shard leader to the sub-shard leader are written only in tlog and not the index. If this happens after the buffered updates have been replayed then the updates can never be executed even though they remain the transaction log. The second case is when synchronously forwarding updates to sub-shard leader fails and the underlying errors are not propagated to the client 2018-08-02 08:24:32 +05:30
Andrzej Bialecki 1133bf98a5 SOLR-12509: Improve SplitShardCmd performance and reliability. 2018-08-01 16:30:59 +02:00
Cao Manh Dat 0dc124aa78 SOLR-12412: Fix precommit 2018-08-01 07:14:41 +07:00
Cao Manh Dat eada799f57 SOLR-12412: Leak transaction log on tragic event 2018-08-01 07:13:41 +07:00
Varun Thacker c9e3c456e3 SOLR-11807: Simply testing of createNodeSet with restoring collection and fixing the test failure 2018-07-31 15:19:23 -07:00
Christine Poerschke 8a4482805b SOLR-12609: include actual value in two MathExpressionTest.testMultiVariateNormalDistribution asserts 2018-07-31 19:29:50 +01:00
Christine Poerschke 4a1ee046c3 SOLR-12402: Factor out SolrDefaultStreamFactory class. 2018-07-31 19:29:43 +01:00
Cassandra Targett 13960594e4 SOLR-11870: Ref Guide: Add docs on filter param for ICU filters 2018-07-31 13:17:14 -05:00
Cassandra Targett ecad9198d8 SOLR-12448: Fix outdated docs that say autoAddReplicas is for shared FS only in Ref Guide and v2 API specs 2018-07-31 12:25:45 -05:00
Christine Poerschke 9262ed7e56 SOLR-12558: solr/core (private) logger renames 2018-07-31 16:58:51 +01:00
Alexandre Rafalovitch abd6b07ea9 SOLR-12574: Fix the SignificantTermStream to use the new bucket format 2018-07-31 08:18:39 -04:00
Noble Paul 4602e4de45 SOLR-12601: Refactor the autoscaling package to improve readability 2018-07-31 13:12:34 +10:00
Steve Rowe a08eadb480 Fix InfixSuggestersTest.testShutdownDuringBuild() failures 2018-07-30 22:49:49 -04:00
Varun Thacker 8d28bbc905 SOLR-12477: Return server error(500) for AlreadyClosedException instead of client Errors(400) . This closes PR #402 2018-07-30 17:42:03 -07:00
Cassandra Targett ea221069c3 SOLR-12164: Ref Guide - improve index.adoc so it's a nicer landing page for the Guide 2018-07-30 14:11:55 -05:00
Christine Poerschke 3583bdb324 SOLR-12558: solr/core (private) logger rename - ExportWriter 2018-07-30 18:48:58 +01:00
Christine Poerschke e1063b7f4b SOLR-12558: solr/core (private) logger rename - JettySolrRunner 2018-07-30 18:46:12 +01:00
Adrien Grand 61e89e3ca0 LUCENE-8431: Top-docs collectors now collect lower bounds of the hit count. 2018-07-30 16:38:05 +02:00
Adrien Grand 9ca053712a LUCENE-8430: TopDocs.totalHits may now be a lower bound of the hit count. 2018-07-30 16:38:05 +02:00
Adrien Grand 3a837ca374 LUCENE-8412: Further simplification. 2018-07-30 16:20:36 +02:00
Alexandre Rafalovitch e264d03920 SOLR-12574: Use a common bucket for all significantTerms outputs 2018-07-29 12:02:07 -04:00
Shalin Shekhar Mangar 179c8f9b48 SOLR-11990: Make it possible to co-locate replicas of multiple collections together in a node.
A collection may be co-located with another collection during collection creation time by specifying a
'withCollection' parameter. It can also be co-located afterwards by using the modify collection API.
The co-location guarantee is enforced regardless of future cluster operations whether they are invoked
manually via the Collection API or automatically by the Autoscaling framework.

Squashed commit of the following:

commit 3827703b38c598f1247c90ab57d3d640ab3a9e21
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Sat Jul 28 11:54:10 2018 +0530

    SOLR-11990: Added change log entry

commit 7977222e07ba47274062cb8d8a69e7956d644000
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Sat Jul 28 11:52:17 2018 +0530

    SOLR-11990: Added change log entry

commit 1857075fdb9d535b6149ad4369fed8b64b0c01f6
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Sat Jul 28 11:49:51 2018 +0530

    SOLR-11990: Added note about co-location guarantees being one way only

commit 8557cbc8a511f21d1fcad99e11ea9d2104d0bef4
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Sat Jul 28 10:43:37 2018 +0530

    SOLR-11990: Remove unused import

commit 864b013fd744edca9b6b84a8a7573fab3c5310d5
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Sat Jul 28 10:21:59 2018 +0530

    SOLR-11990: Fixing compilation issues after merging master

commit dd840a2f7e765ee96c899d4d9ea89b6b67c5ae62
Merge: bb4ffb3 828d281
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Sat Jul 28 10:03:50 2018 +0530

    Merge branch 'master' into jira/solr-11990

    # Conflicts:
    #	solr/solr-ref-guide/src/collections-api.adoc
    #	solr/solrj/src/java/org/apache/solr/client/solrj/cloud/autoscaling/Clause.java
    #	solr/solrj/src/java/org/apache/solr/client/solrj/cloud/autoscaling/Suggestion.java

commit bb4ffb32c4960a2809ac8927e214e1e012204a73
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Fri Jul 27 14:09:44 2018 +0530

    SOLR-11990: Ensure that the suggestion are validated by the policy engine otherwise move to the next candidate replica or the next candidate node

commit a97d45b22f9c232e939f979502c761001be9ae24
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Fri Jul 27 13:22:10 2018 +0530

    SOLR-11990: Autoscaling suggestions for withCollection violations should prefer moving replicas before adding replicas

commit 7b5a84338dfe7335599a5e96aff2d26cb4eeaac6
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Fri Jul 27 12:22:45 2018 +0530

    SOLR-11990: Fix statement about the behavior of the modify collection API when modifying the withCollection parameter

commit 63aec4fe0de7025c16b6ebc47dad1004531ecee1
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Thu Jul 26 07:29:07 2018 +0530

    SOLR-11990: Added new page to the reference guide describing how to colocate collections together including guarantees and limitations

commit 6bfcd0786bb30353de9c26a01ec97ce3191b58f8
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 25 21:42:25 2018 +0530

    SOLR-11990: Added another test which creates two collections which are colocated with two different collections and ensures that create collection and add replica operations work correctly

commit 4cead778f0044b6fb4012b085abf7b60350f495b
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 25 21:07:47 2018 +0530

    SOLR-11990: Stop or start jettys in test setup to ensure that we always have exactly 2 replicas running before a test starts

commit 70dbfd042c2164fcd76d406eeab1518e4d3147fb
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 25 19:19:07 2018 +0530

    SOLR-11990: Added description of the new withCollection parameter in the reference guide

commit 9d8260852b9d667d4d8e026432fd7727b7789393
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 25 19:16:46 2018 +0530

    SOLR-11990: Reset count down latch during test setup

commit ae508165571b1afde54337859b8d5fdbb1d67312
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 25 15:43:54 2018 +0530

    SOLR-11990: Add support for withCollection in simulated create collection API

commit 84f026b8c4cc25edb548430b8f5ad09d2486b3b5
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Tue Jul 24 17:21:33 2018 +0530

    SOLR-11990: Ported the refactoring made in CreateCollectionCmd to the simulated version so that simulation tests are able to create collections correctly

commit defe111c9d31c8e4f0f00b4f2f3c875f5b2fa602
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Tue Jul 24 16:17:52 2018 +0530

    SOLR-11990: Add missing javadoc for return statement

commit 8e47d5bc4545548c5441909c3fcc1a7901b38185
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Tue Jul 24 16:11:45 2018 +0530

    SOLR-11990: Replace usage of forbidden Charsets with StandardCharsets class

commit 2d1b9eb25ea96a3a42c000ae654400ed44c17554
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Tue Jul 24 16:07:36 2018 +0530

    SOLR-11990: Extract ConditionType to an interface VarType along with a WithCollectionVarType implementation

commit 1de2a4f52a59afca28de75bfa5156a3d6567a4f5
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Tue Jul 24 12:53:26 2018 +0530

    SOLR-11990: Pass strict-ness parameter to the ConditionType so that WITH_COLLECTION can choose not to project add replica in strict mode.

    This ensures that add replica or move replica suggesters always choose nodes that already have withCollection replicas first unless there are violations in doing so. Only if the first pass fails to find a suitable replica, do we go to the other nodes in the cluster. This also removes the need for the majority of changes in AddReplicaSuggester and so they've been reverted.

commit 0d616ed9e9bad791548c87086cba7760d724350d
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Tue Jul 24 11:36:34 2018 +0530

    SOLR-11990: Minor changes to formatting and code comments

commit 1228538f934f35f15797d89c2c66f2deb9cddd8c
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Mon Jul 23 14:26:19 2018 +0530

    SOLR-11990: Added a test which simulates a lost node and asserts that move replica suggester moves the replica on the lost node to a node already having the withCollection present

commit 582f1fd98de93ab73c74a1f623749dd031beb381
Author: Noble Paul <noble@apache.org>
Date:   Mon Jul 23 18:35:22 2018 +1000

    SOLR-11990: NPE removing unnecessary System.out.println

commit 501bc6c1d066321b344bbb8b1de3c2ead52f8c49
Author: Noble Paul <noble@apache.org>
Date:   Mon Jul 23 18:31:07 2018 +1000

    SOLR-11990: NPE during class init

commit acbf4a69321e16cff11cc7cf0a1f076fd9ac0037
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Mon Jul 23 13:55:30 2018 +0530

    SOLR-11990: Added asserts on the nodes that should be selected by the add replica suggester

commit 4824933fd6eb7d1773acbff1a1a0c5e670226e0b
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Fri Jul 20 14:30:52 2018 +0530

    SOLR-11990: Added WITH_COLLECTION to global tags. Fixed implementation of addViolatingReplicas and getSuggestions in the clause impl. Added more asserts in testWithCollectionSuggestions.

commit dbadb33211c190026e08d8e3ea587b6f8df8720b
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Fri Jul 20 13:44:36 2018 +0530

    SOLR-11990: Added support for comparing violations, generating suggestions and adding violating replicas

commit ada1f17d5c93a4186260473e4822d2bee1da0e16
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 18 19:14:56 2018 +0530

    SOLR-11990: Fix mock node state provider in TestPolicy to use the right cluster state. Added nocommits to ensure that we return the right suggestions for this feature.

commit ef2d61812e0d96eb2275b3411906d9de57ab835e
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 18 18:39:51 2018 +0530

    SOLR-11990: Add missing node in nodeValues configuration

commit 34841fc01fea4a9f1e6a9f64050e576f2247a72b
Author: Shalin Shekhar Mangar <shalin@apache.org>
Date:   Wed Jul 18 16:32:57 2018 +0530

    SOLR-11990: Make it possible to co-locate replicas of multiple collections together in a node
2018-07-29 07:26:13 +05:30
Varun Thacker 828d2815f1 SOLR-12599: Add more query routing params to the ref guide 2018-07-27 14:31:55 -07:00
Shalin Shekhar Mangar 3119fbb947 SOLR-12597: Migrate API should fail requests that do not specify split.key parameter 2018-07-27 11:53:53 +05:30
Noble Paul dfb18a6d72 SOLR-12536: ref guide typo fixed 2018-07-27 14:27:51 +10:00
Noble Paul 90424cbe27 SOLR-12536: ref guide 2018-07-27 12:37:32 +10:00