Commit Graph

931 Commits

Author SHA1 Message Date
kimchy 11dbbebb7a renamve var to better reflect its state (started, not active) 2010-08-21 17:50:08 +03:00
kimchy 3117341f44 Shards Allocation: Only rebalance a shard if all its instances are already active, closes #331. 2010-08-21 17:49:19 +03:00
kimchy 38e6649a7e Cluster Health API: Add `initializing_shards` and `unassigned_shards` to the response, closes #330. 2010-08-21 16:03:29 +03:00
kimchy 113ea1bb1b don't throttle gateway recovery based on peer recoveries (gateway recoveries are important to do as fast as possible). still throttle peer recoveries based on both. 2010-08-21 15:37:12 +03:00
kimchy e12bdd9faf rename RETRY stage in recovery to THROTTLE 2010-08-21 15:13:34 +03:00
kimchy 0c72bb2125 better writing of local md5 caches 2010-08-21 02:16:36 +03:00
kimchy 1ef1e9b25b don't spawn on received cluster state 2010-08-20 19:36:39 +03:00
kimchy 800e450e3a handle local md5 cases, don't include them in the list of files the directory has 2010-08-20 19:30:26 +03:00
kimchy 9acae60dbf also have a minimum value for concurrent recoveries, at 3 2010-08-20 17:28:31 +03:00
kimchy f62f7b8ffe check the progress in case the index size has not been set yet... 2010-08-20 17:17:32 +03:00
kimchy 9f0d5f8ef1 better default concurrent recoveries, based on number of processors, tap it at 10 2010-08-20 17:06:56 +03:00
kimchy 8c25be6dee better exception message with primary not started exception on index/delete/delete_by_query apis 2010-08-20 16:36:25 +03:00
kimchy 07285d81d1 add stream done when there is no file (should not happen) 2010-08-20 15:59:46 +03:00
kimchy b609162be3 don't ignore recovery on throttling unless the shard is closed 2010-08-20 15:58:24 +03:00
kimchy 4e74001bde move marking recovering before creating a status 2010-08-20 15:24:49 +03:00
kimchy c0552bdc70 Can't set "no stopwords" on analyzer, closes #329. 2010-08-20 03:22:43 +03:00
kimchy 6f1a9fbfb9 create md5 files on the local index storage as well, so they won't have to be recomputed when performing initial recovery 2010-08-20 02:28:14 +03:00
kimchy acae0650c8 bail out of recovery when close and still waiting on throttling 2010-08-20 01:24:02 +03:00
kimchy a05c367c5e don't snapshot gateway when cleaning shard 2010-08-20 00:59:37 +03:00
kimchy 4a2e076c6a do a reuse work prefetching not on the cluster state thread, so it won't block while fetching md5s from other nodes 2010-08-20 00:45:17 +03:00
kimchy a5c5f65da5 fix recovery status when all index got reused 2010-08-19 22:46:58 +03:00
kimchy 7437acfcea add progress to indices status API 2010-08-19 22:29:31 +03:00
kimchy 8d0e5b239c recator source rest building into common code 2010-08-19 20:24:12 +03:00
kimchy 7b1093fb16 anoter compressed string test 2010-08-19 18:45:15 +03:00
kimchy 19abe7a2a5 when using compressed source, extract the compressed source directly into the response without any buffering 2010-08-19 18:29:36 +03:00
kimchy 46ccee8f89 when deleting an index, remove any blocks associated with it 2010-08-19 17:21:14 +03:00
kimchy c40935ae14 store the mapping definition in compressed form internally to save memory 2010-08-19 17:06:36 +03:00
kimchy a2d10d490d allocate list when deserializing, NPE galore... 2010-08-19 16:40:51 +03:00
kimchy 04ae1581a0 fix NPE introduced on optimization of index status on docs status creation 2010-08-19 15:37:06 +03:00
kimchy 70c344b079 add compressed string 2010-08-19 15:33:57 +03:00
kimchy 1a18387fab add `standard_html_strip` analyzer that combines the standard analyzer with html_strip char filter. 2010-08-19 15:10:31 +03:00
kimchy 22ea5e6608 fix primary election on replica relocation 2010-08-19 14:59:50 +03:00
kimchy 9c0bbe9bb5 log failure to notify master on shard started/failed 2010-08-19 13:49:48 +03:00
kimchy fd569a9523 renme tests to reflect replica and not backup 2010-08-19 13:11:53 +03:00
kimchy 27e92cd505 fix a case where node might not exists on relocating, don't fail the replication action (index / delete / ...) because of it 2010-08-19 13:08:20 +03:00
kimchy 51656552a5 better mehtod name 2010-08-19 11:20:06 +03:00
kimchy 965d7303cf index status action - some docs and extract common docs status 2010-08-19 09:34:02 +03:00
kimchy a3107bc5b1 add snapshot status (either current one or the latest one executed) to indices status api 2010-08-18 17:11:29 +03:00
kimchy 91aada2706 boolean values cannot be searched with expected queries, closes #327. 2010-08-18 15:11:23 +03:00
kimchy de71a1ce99 filtered more_like_this doesn't parse correctly, closes #326. 2010-08-18 14:36:34 +03:00
kimchy 2259ef671b Gateway: Failure to read full translog from the gateway, closes #328. 2010-08-18 14:29:46 +03:00
kimchy 3f9034b41c add gateway recovery status to the indices status API exposing both on going and summary when recovering from a gateway 2010-08-17 22:34:56 +03:00
kimchy 311520d146 add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard 2010-08-17 21:33:11 +03:00
kimchy 5fb80c391b add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard 2010-08-17 21:23:05 +03:00
kimchy 96fc16dddb add ability to iterate over assigned shards, and add an extension point to control shard routing iteration in the broadcast based action support 2010-08-17 14:04:12 +03:00
kimchy 7833cb1c76 Document IDs need to be URL decoded when indexed, closes #324. 2010-08-17 10:47:02 +03:00
kimchy c989d3a928 fix limit on UTF writing (the new mechanism) to be higher than short 2010-08-17 10:21:26 +03:00
kimchy e1f3fee4e4 internally store on going state of snapshot to gateway 2010-08-17 10:03:19 +03:00
kimchy 29e981d28d internally store on going state of recovery from gateway 2010-08-17 08:17:29 +03:00
kimchy 92fd9af2b9 more info stored on shard recovery process, start time and recovery time 2010-08-16 18:22:19 +03:00