Commit Graph

1350 Commits

Author SHA1 Message Date
kimchy 9d08e56d8a cache nodes store metadata for on a shard basis when iteratring over the unassigned nodes 2010-08-25 15:03:25 +03:00
kimchy f36d80f66d don't go and find local storage for a shard on nodes if its not going to be allocated 2010-08-25 15:01:09 +03:00
kimchy 4bfd0a8c26 cache commit points during smart allocation based on local storage when recovering from gateway 2010-08-25 01:12:16 +03:00
kimchy 244cd42298 allow to use just hosts when using unicast discover, will use the transport level ports 2010-08-25 00:44:04 +03:00
kimchy fc812a306b change logging 2010-08-24 23:33:03 +03:00
kimchy ba5814a72f change log level 2010-08-24 23:25:20 +03:00
kimchy 31aed01220 increase timeout to 5 seconds 2010-08-24 23:18:58 +03:00
kimchy fdc82dd5a3 ignore parsing of wrong file format in the gateway (log warn), use index vesrion as the translog id 2010-08-24 23:12:18 +03:00
kimchy d0f5bc3403 add russian letter tokenizer 2010-08-24 23:11:22 +03:00
kimchy 49b4659322 Indexing Buffer Size: Refine default setting to 10% (from 40%) and add more settings, closes #334. 2010-08-24 18:12:45 +03:00
kimchy 7ae8d4c669 thread pool type setting is wrong, fix blocking max setting to have a minimum of 10, use cached TP where needed 2010-08-24 15:28:54 +03:00
kimchy b8ab50828c only list and delete files we created 2010-08-24 14:48:49 +03:00
kimchy c85019fb86 upgrade to aws 1.0.008 2010-08-24 03:58:45 +03:00
kimchy df23d8f7ec don't snapshot a translog that has no content 2010-08-24 03:58:21 +03:00
kimchy 80c71350cd change from 0.9.1 to version 0.10.0 2010-08-24 01:29:17 +03:00
kimchy 6c29142b91 throw recovery failure if failing to parse all commit points 2010-08-24 01:28:39 +03:00
kimchy 02b74dfb63 Memcach: StreamCorruptedException when loading a cluster, closes #300. 2010-08-23 22:21:35 +03:00
kimchy 8079b5def5 Should escape \r\n in exception message, closes #332. 2010-08-23 22:19:40 +03:00
kimchy b52d854711 smarter handling of throttling when preferring allocating to an existing work location 2010-08-23 21:39:54 +03:00
kimchy 78b6879ecd move rebalance only when active logic into node allocation, add canRebalance hook point 2010-08-23 18:28:35 +03:00
kimchy 149962691e move rebalance only when active logic into node allocation, add canRebalance hook point 2010-08-23 18:27:01 +03:00
kimchy 4300a6ca18 move rebalance only when active logic into node allocation, add canRebalance hook point 2010-08-23 18:26:17 +03:00
kimchy 0e47898902 add /_shutdown to the REST endpoints 2010-08-23 18:01:47 +03:00
kimchy 5900e01a0d list remote nodest storage information with a timeout 2010-08-23 18:00:37 +03:00
kimchy 1461da5b49 move prefetch allocation to be a NodeAllocation 2010-08-23 17:22:44 +03:00
kimchy edbd586ee5 add load test for recovery from gateway 2010-08-23 16:33:33 +03:00
kimchy 939d583550 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 15:42:03 +03:00
kimchy b49d331c86 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 15:28:12 +03:00
kimchy 62cc4d554a better logging message for reused vs. recovered from gateway 2010-08-23 15:25:06 +03:00
kimchy 5bd37f6f47 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 14:48:49 +03:00
kimchy 1517fa3d28 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 01:45:03 +03:00
kimchy 36ad3b246a addlow to add node allocation ot the module 2010-08-22 12:35:59 +03:00
kimchy 664f28492d improvements to the module system, allow for a module to spawn other modules, and pre process modules before injector creation 2010-08-22 10:42:25 +03:00
kimchy aa28b93610 refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it 2010-08-22 02:47:34 +03:00
kimchy 7592862646 add a callback for allocation as well 2010-08-22 01:00:37 +03:00
kimchy a3852766ff only check for prefered allocation on data nodes 2010-08-22 00:32:43 +03:00
kimchy 3f701365b0 move the allocate replica after primary active logic to a node allocation 2010-08-22 00:14:56 +03:00
kimchy 5ded04c5cb refactor shard allocation to be more pluggable for node allocation "deciders" 2010-08-21 21:59:31 +03:00
kimchy 2865ceef85 more on sorted nodes when allocating shards above average number of shards per node 2010-08-21 19:55:38 +03:00
kimchy 76e1a6b1bf check also for negative values 2010-08-21 19:51:14 +03:00
kimchy 5d2c005622 pass to canAllocate (though nothing is done there now) the actual routing nodes 2010-08-21 17:52:24 +03:00
kimchy 1ddd969fa7 pass to canAllocate (though nothing is done there now) the actual routing nodes 2010-08-21 17:52:02 +03:00
kimchy 11dbbebb7a renamve var to better reflect its state (started, not active) 2010-08-21 17:50:08 +03:00
kimchy 3117341f44 Shards Allocation: Only rebalance a shard if all its instances are already active, closes #331. 2010-08-21 17:49:19 +03:00
kimchy 38e6649a7e Cluster Health API: Add `initializing_shards` and `unassigned_shards` to the response, closes #330. 2010-08-21 16:03:29 +03:00
kimchy 113ea1bb1b don't throttle gateway recovery based on peer recoveries (gateway recoveries are important to do as fast as possible). still throttle peer recoveries based on both. 2010-08-21 15:37:12 +03:00
kimchy e12bdd9faf rename RETRY stage in recovery to THROTTLE 2010-08-21 15:13:34 +03:00
kimchy 0c72bb2125 better writing of local md5 caches 2010-08-21 02:16:36 +03:00
kimchy d97695ad10 fix windows script to not double quote 2010-08-20 21:13:32 +03:00
kimchy 1ef1e9b25b don't spawn on received cluster state 2010-08-20 19:36:39 +03:00