Commit Graph

254 Commits

Author SHA1 Message Date
Uwe Schindler 7405b9772b SOLR-3733: First version of patch (without Robert's changes)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/branches/solr3733@1388082 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 15:37:42 +00:00
Chris M. Hostetter 52d9fdb780 SOLR-3783: Fixed Pivot Faceting to work with facet.missing=true
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1387824 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 00:17:57 +00:00
Robert Muir c529308734 fix javadocs bugs found by my IDE
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1387823 13f79535-47bb-0310-9956-ffa450edef68
2012-09-20 00:17:50 +00:00
Yonik Seeley 9be371a198 SOLR-3815: preserve shard properties
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1387747 13f79535-47bb-0310-9956-ffa450edef68
2012-09-19 20:42:04 +00:00
Yonik Seeley 7ae776e2d1 SOLR-3815: fix overseer.setShardLeader to not modify existing state
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1387354 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 20:48:09 +00:00
Erick Erickson 580b53efdd Fixes for SOLR-3846 (very long tests on OS X for TestReplicationHandler)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1387099 13f79535-47bb-0310-9956-ffa450edef68
2012-09-18 11:40:13 +00:00
Yonik Seeley 8c5fc86a38 SOLR-3815: change clusterstate structure to add properties to slices
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1386858 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 21:40:51 +00:00
Erick Erickson ded01621a4 Fix for LUCENE-4362, ban tabs-indent
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1386681 13f79535-47bb-0310-9956-ffa450edef68
2012-09-17 16:01:56 +00:00
Mark Robert Miller f0185fb9d5 SOLR-3833: When a election is started because a leader went down, the new leader candidate should decline if the last state they published was not active.
SOLR-3836: When doing peer sync, we should only count sync attempts that cannot reach the given host as success when the candidate leader is syncing with the replicas - not when replicas are syncing to the leader.

SOLR-3835: In our leader election algorithm, if on connection loss we found we did not create our election node, we should retry, not throw an exception.

SOLR-3834: A new leader on cluster startup should also run the leader sync process in case there was a bad cluster shutdown.

SOLR-3772: On cluster startup, we should wait until we see all registered replicas before running the leader process - or if they all do not come up, N amount of time.
  
SOLR-3756: If we are elected the leader of a shard, but we fail to publish this for any reason, we should clean up and re trigger a leader election.

SOLR-3812: ConnectionLoss during recovery can cause lost updates, leading to shard inconsistency.
  
SOLR-3813: When a new leader syncs, we need to ask all shards to sync back, not just those that are active.

SOLR-3807: Currently during recovery we pause for a number of seconds after waiting for the leader to see a recovering state so that any previous updates will have finished before our commit on the leader - we don't need this wait for peersync.
  
SOLR-3837: When a leader is elected and asks replicas to sync back to him and that fails, we should ask those nodes to recovery asynchronously rather than synchronously.

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1384923 13f79535-47bb-0310-9956-ffa450edef68
2012-09-14 21:05:15 +00:00
Chris M. Hostetter ee1e747c29 SOLR-3628: SolrInputField and SolrInputDocument are now consistently backed by Collections passed in to setValue/setField, and defensively copy values from Collections passed to addValue/addField
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1383520 13f79535-47bb-0310-9956-ffa450edef68
2012-09-11 18:38:45 +00:00
Robert Muir 6d0060a45f fix broken javadocs
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1382777 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 11:59:27 +00:00
Yonik Seeley b34c9a9683 SOLR-3815: separate ZkNodeProps from Replica, change properties from String values to Object values
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1382621 13f79535-47bb-0310-9956-ffa450edef68
2012-09-10 02:14:50 +00:00
Robert Muir 8eb52eb9ab SOLR-3686: clean this up for consistency
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1381835 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 00:59:22 +00:00
Robert Muir 8a72b10926 SOLR-3686: compile solrj/src/java only with its correct dependencies (tests still have the same classpath as before)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1381834 13f79535-47bb-0310-9956-ffa450edef68
2012-09-07 00:57:24 +00:00
Robert Muir ddda1b6089 SOLR-3686: fix solr/core and solr/solrj not to share a lib directory
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1381792 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 22:47:01 +00:00
Steven Rowe d3383239f8 LUCENE-4365: split maven modules into main/test sub-modules for the four modules with cyclic dependencies on the Lucene or Solr test-framework modules: lucene-core, lucene-codecs, solr-core, and solr-solrj
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1381779 13f79535-47bb-0310-9956-ffa450edef68
2012-09-06 22:17:03 +00:00
Mark Robert Miller 678e35aa58 SOLR-3782: A leader going down while updates are coming in can cause shard inconsistency.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1380974 13f79535-47bb-0310-9956-ffa450edef68
2012-09-05 04:03:55 +00:00
Mark Robert Miller 278200cfaa SOLR-3772,SOLR-3750: make optional, wait time configurable, default to off
SOLR-3782: A leader going down while updates are coming in can cause shard inconsistency. 

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1380299 13f79535-47bb-0310-9956-ffa450edef68
2012-09-03 17:14:25 +00:00
Yonik Seeley 7af7d1de48 SOLR-3755: shard splitting - create cores, use writers from cores
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1380287 13f79535-47bb-0310-9956-ffa450edef68
2012-09-03 16:36:20 +00:00
Yonik Seeley 7754d1d105 SOLR-3755: basic shard splitting code
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1379195 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 22:31:56 +00:00
Mark Robert Miller 2fdd58398a SOLR-3750: On session expiration, we should explicitly wait some time before running the leader sync process so that we are sure every node participates.
SOLR-3772: On cluster startup, we should wait until we see all registered replicas before running the leader process or if they all do not come up, N amount of time. 

SOLR-3752: When a leader goes down, have the Overseer clear the leader state in cluster.json 

SOLR-3751: Add defensive checks for SolrCloud updates and requests that ensure the local state matches what we can tell the request expected.

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1379002 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 16:23:16 +00:00
Mark Robert Miller e31ddf3554 use sendToLeaders rather than replicas != null to determine if we add repicas to end of the list
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1378922 13f79535-47bb-0310-9956-ffa450edef68
2012-08-30 13:18:29 +00:00
Sami Siren ae43103d15 reuse existing code, baseUrl and coreName can no longer be null
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1378512 13f79535-47bb-0310-9956-ffa450edef68
2012-08-29 12:06:03 +00:00
Sami Siren fdc313d3bc fix test, remove unused method
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1378458 13f79535-47bb-0310-9956-ffa450edef68
2012-08-29 06:58:38 +00:00
Sami Siren 96767652d7 SOLR-3726 allow more flexibility in configuring solr http clients
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1374964 13f79535-47bb-0310-9956-ffa450edef68
2012-08-20 10:32:52 +00:00
Yonik Seeley 84a8768b5d SOLR-3715: fix FastOutputStream, FastWriter when buffer sizes can change
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1374480 13f79535-47bb-0310-9956-ffa450edef68
2012-08-18 00:15:04 +00:00
Uwe Schindler 5a940c12d8 Don't use IOUtils in SolrJ! Sorry, hope maven build did not start in this time frame *g*
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1374079 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 21:57:13 +00:00
Uwe Schindler 00167f1514 Fix bug in test by using a local file instead of HTTP URL. Also fix unclosed file in FileStream.getContentType(), remove dead code.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1374072 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 21:50:41 +00:00
Uwe Schindler a59f38a03a Better verbosity, also fix bug in while loop with char==0.
I have one explanation for this: Maybe Apaches SVN server returns something (like error message) that's not UTF8?

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1374022 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 19:53:45 +00:00
Robert Muir 2a83b58506 use assertEquals so we will see whats going on when this fails
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1373994 13f79535-47bb-0310-9956-ffa450edef68
2012-08-16 19:24:31 +00:00
Mark Robert Miller d4b66af3b3 SOLR-3727: improve solrcloud close/shutdown
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1372701 13f79535-47bb-0310-9956-ffa450edef68
2012-08-14 01:31:27 +00:00
Mark Robert Miller 2c31ae30e5 SOLR-3727: improve solrcloud close/shutdown
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1372626 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 21:22:08 +00:00
Sami Siren 1d27c0364b SOLR-3649: fix bug in JavabinLoader that caused deleteById(List<String> ids) to not work in SolrJ
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1372346 13f79535-47bb-0310-9956-ffa450edef68
2012-08-13 09:56:33 +00:00
Dawid Weiss cebfa0b9b9 LUCENE-3985: Upgrade to randomizedtesting 2.0.0. Added support for thread leak detection. Added support for suite timeouts. (Dawid Weiss)
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1372068 13f79535-47bb-0310-9956-ffa450edef68
2012-08-12 11:23:11 +00:00
Yonik Seeley 932901bb01 SOLR-3715: remove sync around tlog serialization
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1371379 13f79535-47bb-0310-9956-ffa450edef68
2012-08-09 18:53:19 +00:00
Mark Robert Miller e528549a3b still favor leaders with CloudSolrServer, but also fall back to replicas after leaders
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1370864 13f79535-47bb-0310-9956-ffa450edef68
2012-08-08 18:01:11 +00:00
Mark Robert Miller fec289ee99 SOLR-3710: Change CloudSolrServer so that update requests are only sent to leaders by default.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1369484 13f79535-47bb-0310-9956-ffa450edef68
2012-08-04 22:03:42 +00:00
Mark Robert Miller 238c4274b6 SOLR-3709: Cache the url list created from the ClusterState in CloudSolrServer on each request.
SOLR-3708: Add hashcode to ClusterState so that structures built based on the ClusterState can be easily cached.	

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1369465 13f79535-47bb-0310-9956-ffa450edef68
2012-08-04 21:22:45 +00:00
Mark Robert Miller de3d41432c rename CloudState to ClusterState
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1369396 13f79535-47bb-0310-9956-ffa450edef68
2012-08-04 18:32:33 +00:00
Mark Robert Miller 7add2f7c62 LUCENE-3985: add close methods to Overseer and ConnectionManager and use them
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1369236 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 22:34:08 +00:00
Mark Robert Miller 66dac680fe assume that sometimes the zk state can be stale vs our watcher based state when checking our state matches zk state
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1369189 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 20:03:16 +00:00
Mark Robert Miller 45030e76eb SOLR-3639: Update ZooKeeper to 3.3.6
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1369025 13f79535-47bb-0310-9956-ffa450edef68
2012-08-03 15:22:17 +00:00
Yonik Seeley e397d26dea SOLR-3154: add murmurhash3 that can work directly on a string
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1367800 13f79535-47bb-0310-9956-ffa450edef68
2012-07-31 22:08:32 +00:00
Robert Muir 6d2a288be3 LUCENE-4262: add ivy sync=true, so when resolve runs, only jars that should be there are there
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1366509 13f79535-47bb-0310-9956-ffa450edef68
2012-07-27 19:18:49 +00:00
Mark Robert Miller 6578d7f512 SOLR-3663: There are a couple of bugs in the sync process when a leader goes down and a new leader is elected.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1364429 13f79535-47bb-0310-9956-ffa450edef68
2012-07-22 20:30:37 +00:00
Mark Robert Miller b1fb39754b don't treat 404 special and lost the http response code
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1363330 13f79535-47bb-0310-9956-ffa450edef68
2012-07-19 13:49:55 +00:00
Mark Robert Miller 24dae70408 SOLR-3639: Update ZooKeeper to 3.3.5 for a variety of bug fixes.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1363024 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 17:26:47 +00:00
Mark Robert Miller 83e07fec09 SOLR-3215: Clone SolrInputDocument when distrib indexing so that update processors after the distrib update process do not process the document twice.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1363013 13f79535-47bb-0310-9956-ffa450edef68
2012-07-18 16:52:42 +00:00
Mark Robert Miller e7d1278836 Add reload command to collections api - also improve tests.
git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1361017 13f79535-47bb-0310-9956-ffa450edef68
2012-07-13 00:35:54 +00:00
Mark Robert Miller 46021d4575 SOLR-3460: Add cloud-scripts directory and a zkcli.sh|bat tool for easy scripting and interaction with ZooKeeper.
SOLR-3609: Change Solr's expanded webapp directory to be at a consistent path called solr-webapp rather than a temporary directory.

git-svn-id: https://svn.apache.org/repos/asf/lucene/dev/trunk@1360416 13f79535-47bb-0310-9956-ffa450edef68
2012-07-11 21:45:43 +00:00