Commit Graph

4558 Commits

Author SHA1 Message Date
Robert Muir 914003d19a LUCENE-7077: fail precommit on useless assignment 2016-03-08 06:43:35 -05:00
Alan Woodward 761618727d SOLR-8782: Improve async collections API 2016-03-08 10:55:40 +00:00
Noble Paul c187c46437 Merge remote-tracking branch 'origin/branch_6x' into branch_6x 2016-03-07 22:49:51 +05:30
Noble Paul 5146e78a64 SOLR-8736: schema GET operations on fields, dynamicFields, fieldTypes, copyField are
reimplemented as a part of the bulk API with less details. The tests and write implementations are removed
2016-03-07 22:49:19 +05:30
Shalin Shekhar Mangar dd04b61739 SOLR-8745: Deprecate costly ZkStateReader.updateClusterState(), replace with a narrow forceUpdateCollection(collection)
(cherry picked from commit 093a8ce)
2016-03-07 18:38:09 +05:30
yonik 4d5a33e9ba SOLR-8155: fix UnInvertedField.collectDocsGeneric, used for facet.prefix or non-count sorting 2016-03-05 18:48:48 -05:00
Varun Thacker cb4a91eb7c SOLR-8449: Fix the core restore functionality to allow restoring multiple times on the same core 2016-03-06 04:13:55 +05:30
Noble Paul eab3a48ba2 Merge remote-tracking branch 'origin/branch_6x' into branch_6x 2016-03-05 11:31:05 +05:30
Noble Paul 1df8aca394 SOLR-8788: CollectionTooManyReplicasTest.testDownedShards failures 2016-03-05 11:30:44 +05:30
anshum 2055b64ca1 SOLR-8790: Ignoring failing CollectionsAPISolrJTest test until this is fixed 2016-03-04 19:26:35 -08:00
anshum 0ac5d724b2 SOLR-8789: Remove the *Tests regular expression from the build xml, and instead rename CollectionsAPISolrJTests to CollectionsAPISolrJTest 2016-03-04 16:36:23 -08:00
Noble Paul 8d835f1231 SOLR-8750 : Use lambdas in code where SAM type interfaces are used 2016-03-04 18:55:29 +05:30
Luc Vanlerberghe 948a388778 LUCENE-7064: Split MultiPhraseQuery into an immutable class and a Builder
This closes #19
2016-03-04 14:21:42 +01:00
Noble Paul 201b8b02a4 SOLR-8728: ReplicaAssigner throws NPE when a partial list of nodes are only participating in replica
placement. splitshard should preassign nodes using rules, if rules are present
2016-03-04 16:33:00 +05:30
Robert Muir bea235f711 LUCENE-7063: add tests/docs for numericutils, rename confusing methods, remove overlap with LegacyNumericUtils 2016-03-03 21:55:08 -05:00
anshum ba039f7c8c SOLR-8769: Fix document exclusion in mlt query parser in Cloud mode for schemas that have non-'id' unique field 2016-03-03 15:42:00 -08:00
anshum 638b145376 SOLR-8423: DeleteShard and DeleteReplica should cleanup instance and data directory by default and add support for optionally retaining the directories 2016-03-03 13:26:00 -08:00
anshum 7e59ba4220 SOLR-8725: Allow hyphen in shard, collection, core, and alias names but not the first char 2016-03-03 13:22:15 -08:00
Steve Rowe d0d75c448e SOLR-7010: Remove facet.date client functionality 2016-03-03 14:40:13 -05:00
Steve Rowe eb0c3bd90a SOLR-8778: Deprecate CSVStrategy's setters, and make its pre-configured strategies immutable 2016-03-03 10:57:03 -05:00
Shalin Shekhar Mangar e4712bb028 SOLR-8722: Don't force a full ZkStateReader refresh on every Overseer operation
(cherry picked from commit 93133f5)
2016-03-03 18:21:16 +05:30
Shalin Shekhar Mangar d346af3994 * SOLR-7516: Improve javadocs for JavaBinCodec, ObjectResolver and enforce the single-usage policy
This closes #17
(cherry picked from commit d87d8da)
2016-03-03 18:11:40 +05:30
Varun Thacker 6b2d176e48 SOLR-8780: Remove unused OverseerCollectionMessageHandler#getClusterStatus method 2016-03-03 18:05:12 +05:30
David Smiley 6dcb01ccb4 SOLR-8764: test schema-latest.xml spatial dist units should be kilometers
(no test uses yet?)
(cherry picked from commit deb6a49)
2016-03-02 23:05:37 -05:00
David Smiley b90dbd4b5d LUCENE-7060: Spatial4j 0.6 upgrade. Package com.spatial4j.core -> org.locationtech.spatial4j
(cherry picked from commit 569b6ca)
2016-03-02 21:08:43 -05:00
Steve Rowe 8bbb1dcace SOLR-8764: Remove deprecated methods and classes 2016-03-02 09:26:26 -05:00
Mark Miller 0f4f53a8f5 SOLR-8771: Multi-threaded core shutdown creates executor per core. 2016-03-01 12:13:56 -08:00
Chris Hostetter ff6557cbcb SOLR-8738: Fixed false success response when invalid deleteByQuery requests intially hit non-leader cloud nodes 2016-03-01 10:02:07 -07:00
Noble Paul e44eebf39d SOLR-8375: ReplicaAssigner rejects valid nodes 2016-03-01 10:49:47 +05:30
Mark Miller a9aec24236 SOLR-8696: Straighten out calls to ZkStateReader#createClusterStateWatchersAndUpdate. 2016-02-29 13:09:09 -08:00
Tomás Fernández Löbbe ae4d77ae48 SOLR-8671: Date statistics: make "sum" a double instead of a long/date 2016-02-27 14:02:30 -08:00
Alan Woodward 5c0240219a SOLR-8712: Variable solr.core.instanceDir was not being resolved 2016-02-27 10:03:01 +00:00
Shalin Shekhar Mangar c59ca69ec0 SOLR-8748: OverseerTaskProcessor limits number of concurrent tasks to just 10 even though the thread pool size is 100. The limit has now been increased to 100. 2016-02-27 14:05:07 +05:30
Shalin Shekhar Mangar 41eb5e8542 SOLR-8746: Renamed Overseer.getInQueue to getStateUpdateQueue, getInternalQueue to getInternalWorkQueue and added javadocs 2016-02-27 13:10:51 +05:30
Shalin Shekhar Mangar 06053fc01c SOLR-8752: Add a test for SizeLimitedDistributedMap and improve javadocs 2016-02-27 12:35:58 +05:30
Shalin Shekhar Mangar c2bc93822d SOLR-8697: Fix precommit failure 2016-02-27 12:19:50 +05:30
markrmiller 54e7bb5f58 SOLR-8497: Only mark diectory as done if it was not previously in the cache. 2016-02-26 15:47:12 -05:00
markrmiller efb7bb171b SOLR-8697: Add synchronization around registering as leader and canceling. 2016-02-26 12:32:12 -05:00
Christine Poerschke 0ed625b107 SOLR-8734: fix (maxMergeDocs|mergeFactor) deprecation warnings: in solrconfig.xml <maxMergeDocs|mergeFactor> may not be combined with <mergePolicyFactory> and <maxMergeDocs|mergeFactor> on their own or combined with <mergePolicy> is a warning. 2016-02-26 15:51:46 +00:00
Noble Paul 6c0846107a SOLR-8726 : typo in file name 2016-02-26 15:43:51 +05:30
Jan Høydahl 9bb9b7900f SOLR-8737: Managed synonym lists do not include the original term in the expand 2016-02-26 01:26:30 +01:00
Gregory Chanan de119f0b5d SOLR-8735: Fix CheckHdfsIndexTest test failure 2016-02-25 00:18:22 -08:00
Tomas Fernandez Lobbe 730d10f145 SOLR-8420: Fix long overflow in sumOfSquares for Date statistics
Casted operations to double. Changed the test to support a percentage error given the FUZZY flag in doubles
2016-02-24 19:02:17 -08:00
Noble Paul 405e084a6c SOLR-7362: enabling more logs 2016-02-24 15:53:11 +05:30
Noble Paul bba7b82ab9 Merge remote-tracking branch 'origin/master' 2016-02-24 14:59:42 +05:30
Noble Paul d77cd3287d SOLR-872: move the embedded xml for schema and solconfig for .system collection to individual files 2016-02-24 14:59:07 +05:30
markrmiller 18bb8caede SOLR-8720: ZkController#publishAndWaitForDownStates should use #publishNodeAsDown. 2016-02-23 14:51:01 -05:00
markrmiller 8ac4fdd6bb SOLR-8696: Start the Overseer before actions that need the overseer on init and when reconnecting after zk expiration and improve init logic. 2016-02-23 13:59:04 -05:00
markrmiller 7d32456efa SOLR-8497: Merge indexes should mark it's directories as done rather than keep them around in the directory cache. 2016-02-23 13:15:01 -05:00
Noble Paul 9ce2d0d25d SOLR-8698: params.json can now have appends and invariants as well. 'useParams' specified in the requestHandler is always applied 2016-02-23 17:40:49 +05:30
Noble Paul 4d9d0c0011 SOLR-8719 renamed classes to make their usage generic 2016-02-23 16:14:49 +05:30
Noble Paul cf96432630 SOLR-8522: Make it possible to use ip fragments in replica placement rules , such as ip_1, ip_2 etc 2016-02-23 13:31:08 +05:30
Noble Paul e069d31086 SOLR-7362 2016-02-23 11:21:59 +05:30
Noble Paul 982654b795 Merge remote-tracking branch 'origin/master' 2016-02-23 06:32:33 +05:30
Noble Paul eb1f8e2409 SOLR-8377 removed an unnecessary for loop 2016-02-23 06:12:33 +05:30
Dennis Gove d6105334a0 SOLR-8666: Adds header 'zkConnected' to response of SearchHandler and PingRequestHandler
Header is used to notify the client when a connection to zookeeper has been lost and there is a possibility of stale data on the node the request is coming from.
2016-02-22 19:25:17 -05:00
Dennis Gove 2c0a5e3036 SOLR-8599: After a failed connection during construction of SolrZkClient attempt to retry until a connection can be made 2016-02-22 19:25:16 -05:00
yonik 1203264640 SOLR-8691: Cache index fingerprints per searcher 2016-02-22 13:00:38 -05:00
yonik f47e6b2200 SOLR-8690: add solr.disableFingerprint system property 2016-02-22 12:44:30 -05:00
Christine Poerschke b14fb50b7f SOLR-8674: solr.tests.mergePolicy[Factory] tests now randomly choose between <mergePolicy> and <mergePolicyFactory>
* This increases <mergePolicy> vs. <mergePolicyFactory> test coverage.
* This temporarily also adds a little test setup complexity but when SOLR-8668 removes support for <mergePolicy> then test setup will return to its original complexity.
2016-02-22 15:22:55 +00:00
Noble Paul 5a15fed9f5 SOLR-8700 eliminate the java class for implicit plugins 2016-02-21 20:49:55 +05:30
markrmiller 2fd90cd489 SOLR-8575: Add missing assert. 2016-02-20 20:35:21 -05:00
jbernste b2475bf9fd SOLR-8588: Add TopicStream to the streaming API to support publish/subscribe messaging 2016-02-19 20:03:43 -05:00
markrmiller 9418369b46 SOLR-8697: Scope ZK election nodes by session to prevent elections from interfering with each other and other small LeaderElector improvements. 2016-02-19 17:06:38 -05:00
markrmiller 771f14cb6e SOLR-8656: PeerSync should use same nUpdates everywhere. 2016-02-19 16:41:49 -05:00
markrmiller 8cd53a076b SOLR-8633: DistributedUpdateProcess processCommit/deleteByQuery call finish on DUP and SolrCmdDistributor, which violates the lifecycle and can cause bugs. 2016-02-19 14:59:46 -05:00
markrmiller e30d638c51 SOLR-8695: Ensure ZK watchers are not triggering our watch logic on connection events and make this handling more consistent. 2016-02-19 14:36:53 -05:00
markrmiller 32fbca6ea7 SOLR-8694: DistributedMap/Queue can create too many Watchers and some code simplification. 2016-02-19 14:33:50 -05:00
anshum c7c5b8fe49 SOLR-8677: Fix broken build 2016-02-18 18:06:12 -08:00
Noble Paul 8fe946bde2 Merge remote-tracking branch 'origin/master' 2016-02-18 16:28:19 -08:00
Noble Paul 2977efa922 updatd the test in according with SOLR-7984 2016-02-18 16:27:53 -08:00
anshum d01230d639 SOLR-8677: Restrict creation of shards with invalid names 2016-02-18 15:18:44 -08:00
Noble Paul 8bcac81a21 SOLR-8692 moved the embedded json out to resources dir 2016-02-18 14:59:09 -08:00
yonik 5d2fb9cf69 doc: explain why peersync fingerprinting is sometimes off 2016-02-18 13:24:01 -05:00
yonik 091889cf79 tests: additional prefix facet tests 2016-02-18 12:19:41 -05:00
markrmiller 31437c9b43 SOLR-8416: The collections create API should return after all replicas are active. 2016-02-17 13:37:08 -05:00
Mike McCandless 25931d3624 suppress IW's pending deletes check when creating SpellChecker 2016-02-16 17:41:05 -05:00
markrmiller 0bba332549 SOLR-7339: Jetty 9.3 upgrade. 2016-02-16 16:01:10 -05:00
markrmiller 9184d52f68 SOLR-8683: Always consume the full request on the server, not just in the case of an error. 2016-02-16 16:01:10 -05:00
markrmiller a40118c9df SOLR-8578: Fully consume proxy requests and move CHANGES entry to 6.0. 2016-02-16 13:16:02 -05:00
markrmiller 13dda5debb SOLR-8669: Non binary responses use chunked encoding because we flush the outputstream early. 2016-02-16 13:11:37 -05:00
Uwe Schindler 74421d729b LUCENE-7028: Remove duplicate method in LegacyNumericUtils 2016-02-14 00:49:21 +01:00
Uwe Schindler 779120c6a4 SOLR-5730: Workaround non-working javadocs link (cannot refer to classes from packages in other modules that already exist in lucene-core.jar) 2016-02-13 13:53:17 +01:00
Christine Poerschke f9df240e5c SOLR-5730: rename TestSegmentTerminateEarlyState to SegmentTerminateEarlyTestState 2016-02-12 23:41:30 +00:00
markrmiller 4cc844897e SOLR-8575: Fix HDFSLogReader replay status numbers, a performance bug where we can reopen FSDataInputStream much too often, and an hdfs tlog data integrity bug. 2016-02-12 15:58:06 -05:00
Christine Poerschke 677779086c SOLR-5730: Make Lucene's SortingMergePolicy and EarlyTerminatingSortingCollector configurable in Solr. 2016-02-12 20:16:02 +00:00
Christine Poerschke 77558a649f SOLR-8621: SolrIndexConfig.toMap() fix to distinguish mergePolicyInfo and mergePolicyFactoryInfo, associated SolrIndexConfigTest and TestConfig tweaks. 2016-02-12 19:04:45 +00:00
Christine Poerschke 159ace1b7c SOLR-8621: solrconfig.xml in solr/server/solr/configsets and test-files/solr/configsets/bad-mergepolicy now also use <mergePolicyFactory> instead of <mergePolicy> 2016-02-11 20:41:35 +00:00
Christine Poerschke 360051a414 SOLR-8621: factor out protected abstract WrapperMergePolicyFactory.getMergePolicyInstance method
Here in SOLR-8621:
 * UpgradeIndexMergePolicyFactory extends WrapperMergePolicyFactory
 * (WrapperMergePolicyFactoryTest's) DefaultingWrapperMergePolicyFactory extends WrapperMergePolicyFactory

Elsewhere in SOLR-5730:
 * SortingMergePolicyFactory will extend WrapperMergePolicyFactory
2016-02-11 17:05:17 +00:00
Mike McCandless 12b8721a44 Merge branch 'jira/lucene-5438-nrt-replication' 2016-02-11 11:20:18 -05:00
markrmiller f6098148ae SOLR-8575: Revert while investigated. (reverted from commit ec4c72310f) 2016-02-11 08:32:37 -05:00
Christine Poerschke 6b6932e8e1 SOLR-8621: WrapperMergePolicyFactory logic tweaks
* fix so that getMergePolicy() can now be called more than once
 * added WrapperMergePolicyFactoryTest.testUpgradeIndexMergePolicyFactory()
 * account for overlap between wrapping and wrapped setters (and disallow it)
** illustration:
   <mergePolicyFactory class="UpgradeMergePolicyFactory">
      <int name="noCFSRatio">0.24</int>
      <str name="wrapped.prefix">mergePolicy</str>
                      <str name="mergePolicy.class">TieredMergePolicyFactory</str>
                      <int name="mergePolicy.noCFSRatio">0.42</int>
   </mergePolicyFactory>
** implementation details: the wrapping MP's setter calls the wrapped MP's setter and in the current code the wrapping MP's value prevails i.e. the 0.24 value in the illustration since the wrapped MP is constructed before the wrapping MP. an end-user however might reasonably assume that the wrapped MP's 0.42 value will prevail. at best configuring the same setter twice within the same overall <mergePolicyFactory> element is ambiguous and so the code now disallows it.
2016-02-10 22:24:15 +00:00
Christine Poerschke 5d32609cdc SOLR-8621: add IndexSchema arg to MergePolicyFactory constructor 2016-02-10 16:28:06 +00:00
markrmiller 8299b00868 SOLR-7281: Improve 'best effort', we don't want this best effort method to easily throw exceptions. 2016-02-10 10:27:43 -05:00
Noble Paul b889109da1 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/lucene-solr 2016-02-09 15:08:56 -08:00
Noble Paul 2184a7baf6 SOLR-6594 Mark old schema APIs as deprecated 2016-02-09 15:08:41 -08:00
Mikhail Khludnev eac3bb9b32 SOLR-8466: facet.method=uif for UnInvertedField faceting, like it was with 'fc' earlier. 2016-02-10 01:06:56 +03:00
Christine Poerschke b47eeb2bb3 SOLR-8621: more <mergePolicy> vs. <mergePolicyFactory> test coverage
* added bad-mpf-solrconfig.xml as MergePolicyFactory equivalent of bad-mp-solrconfig.xml (with DummyMergePolicyFactory as equivalent to DummyMergePolicy)

* added solrconfig-logmergepolicyfactory.xml as MergePolicyFactory equivalent of solrconfig-logmergepolicy.xml

* added solrconfig-mergepolicyfactory-nocfs.xml as MergePolicyFactory equivalent of solrconfig-mergepolicy-nocfs.xml

* added solrconfig-indexconfig-mergepolicyfactory.xml as MergePolicyFactory equivalent of solrconfig-indexconfig.xml

* added solrconfig-warmer-randommergepolicyfactory.xml as MergePolicyFactory equivalent of solrconfig-warmer.xml
2016-02-09 17:47:05 +00:00
Jan Høydahl be807919b6 SOLR-3141: Warn in logs when expensive optimize calls are made 2016-02-09 15:37:25 +01:00
Christine Poerschke e9c90037aa SOLR-8621: TestMergePolicyConfig.testTieredMergePolicyConfig now randomly chooses between solrconfig-tieredmergepolicy.xml and solrconfig-tieredmergepolicyfactory.xml; solrconfig-tieredmergepolicyfactory.xml fix so that TestMergePolicyConfig.testTieredMergePolicyConfig passes. 2016-02-09 12:36:24 +00:00