Commit Graph

1235 Commits

Author SHA1 Message Date
kimchy 6f1a9fbfb9 create md5 files on the local index storage as well, so they won't have to be recomputed when performing initial recovery 2010-08-20 02:28:14 +03:00
kimchy acae0650c8 bail out of recovery when close and still waiting on throttling 2010-08-20 01:24:02 +03:00
kimchy a05c367c5e don't snapshot gateway when cleaning shard 2010-08-20 00:59:37 +03:00
kimchy 4a2e076c6a do a reuse work prefetching not on the cluster state thread, so it won't block while fetching md5s from other nodes 2010-08-20 00:45:17 +03:00
kimchy a5c5f65da5 fix recovery status when all index got reused 2010-08-19 22:46:58 +03:00
kimchy 7437acfcea add progress to indices status API 2010-08-19 22:29:31 +03:00
kimchy 8d0e5b239c recator source rest building into common code 2010-08-19 20:24:12 +03:00
kimchy 7b1093fb16 anoter compressed string test 2010-08-19 18:45:15 +03:00
kimchy 19abe7a2a5 when using compressed source, extract the compressed source directly into the response without any buffering 2010-08-19 18:29:36 +03:00
kimchy 46ccee8f89 when deleting an index, remove any blocks associated with it 2010-08-19 17:21:14 +03:00
kimchy c40935ae14 store the mapping definition in compressed form internally to save memory 2010-08-19 17:06:36 +03:00
kimchy a2d10d490d allocate list when deserializing, NPE galore... 2010-08-19 16:40:51 +03:00
kimchy 04ae1581a0 fix NPE introduced on optimization of index status on docs status creation 2010-08-19 15:37:06 +03:00
kimchy 70c344b079 add compressed string 2010-08-19 15:33:57 +03:00
kimchy 1a18387fab add `standard_html_strip` analyzer that combines the standard analyzer with html_strip char filter. 2010-08-19 15:10:31 +03:00
kimchy 22ea5e6608 fix primary election on replica relocation 2010-08-19 14:59:50 +03:00
kimchy 9c0bbe9bb5 log failure to notify master on shard started/failed 2010-08-19 13:49:48 +03:00
kimchy fd569a9523 renme tests to reflect replica and not backup 2010-08-19 13:11:53 +03:00
kimchy 27e92cd505 fix a case where node might not exists on relocating, don't fail the replication action (index / delete / ...) because of it 2010-08-19 13:08:20 +03:00
kimchy 51656552a5 better mehtod name 2010-08-19 11:20:06 +03:00
kimchy 965d7303cf index status action - some docs and extract common docs status 2010-08-19 09:34:02 +03:00
kimchy a3107bc5b1 add snapshot status (either current one or the latest one executed) to indices status api 2010-08-18 17:11:29 +03:00
kimchy 91aada2706 boolean values cannot be searched with expected queries, closes #327. 2010-08-18 15:11:23 +03:00
kimchy de71a1ce99 filtered more_like_this doesn't parse correctly, closes #326. 2010-08-18 14:36:34 +03:00
kimchy 2259ef671b Gateway: Failure to read full translog from the gateway, closes #328. 2010-08-18 14:29:46 +03:00
kimchy 3f9034b41c add gateway recovery status to the indices status API exposing both on going and summary when recovering from a gateway 2010-08-17 22:34:56 +03:00
kimchy 311520d146 add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard 2010-08-17 21:33:11 +03:00
kimchy 5fb80c391b add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard 2010-08-17 21:23:05 +03:00
kimchy 96fc16dddb add ability to iterate over assigned shards, and add an extension point to control shard routing iteration in the broadcast based action support 2010-08-17 14:04:12 +03:00
kimchy 7833cb1c76 Document IDs need to be URL decoded when indexed, closes #324. 2010-08-17 10:47:02 +03:00
kimchy c989d3a928 fix limit on UTF writing (the new mechanism) to be higher than short 2010-08-17 10:21:26 +03:00
kimchy e1f3fee4e4 internally store on going state of snapshot to gateway 2010-08-17 10:03:19 +03:00
kimchy 29e981d28d internally store on going state of recovery from gateway 2010-08-17 08:17:29 +03:00
kimchy 92fd9af2b9 more info stored on shard recovery process, start time and recovery time 2010-08-16 18:22:19 +03:00
kimchy c7f765d025 add (commented) playing with trying to execute from gradle 2010-08-16 12:56:45 +03:00
kimchy 12bacbbc38 upgrade to gradle 0.9-rc-1 2010-08-16 12:43:14 +03:00
kimchy 92aa91d7b2 update the current recvoerd files size in peer recovery 2010-08-16 09:11:51 +03:00
kimchy a012e0f1bd allow to configure translog batch size (internal) and compress translog operations when doing peer recvoery 2010-08-16 09:03:48 +03:00
kimchy 1bdce4c7ef capture current state of peer level recovery 2010-08-16 09:00:34 +03:00
kimchy 57ee1bdc55 improve utf based stream input / output handling 2010-08-15 21:19:36 +03:00
kimchy 14237317fc support compression of the source field 2010-08-15 17:57:14 +03:00
kimchy ee33ee457a allow to explicitly disable compression in peer recovery (defaults to true) 2010-08-15 15:13:45 +03:00
kimchy f6c58ff35d change default calibrate_size_by_deletes for merge policy to true from false (this is what upcoming lucene version will use, and makes much more sense) 2010-08-15 09:01:09 +03:00
kimchy 6d509a5e4e explicitly clean stream handles 2010-08-15 03:08:01 +03:00
kimchy c18904eb96 Recovery: Using transport compression explicitly when recovering an index from a peer shard, closes #322. 2010-08-15 03:01:35 +03:00
kimchy 1ee2f80e68 Transport: add global compression support compressing all internal transport communication (using lzf), closes #321. 2010-08-15 02:57:22 +03:00
kimchy c10544479f refactor cached streams into a separate class 2010-08-14 13:47:34 +03:00
kimchy 01b3d42cee separet recovery tests to one with small buffer size and on with bigger one 2010-08-14 13:44:42 +03:00
kimchy e1226626bc improve thread cached bytes allocation 2010-08-14 02:26:12 +03:00
kimchy 7c5f0fe405 minor transport refactoring, add options to send response, though no options to set yet 2010-08-14 02:25:58 +03:00