Commit Graph

912 Commits

Author SHA1 Message Date
kimchy 311520d146 add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard 2010-08-17 21:33:11 +03:00
kimchy 5fb80c391b add peer recovery status to the indices status API exposing both on going and summary when recovering from a peer shard 2010-08-17 21:23:05 +03:00
kimchy 96fc16dddb add ability to iterate over assigned shards, and add an extension point to control shard routing iteration in the broadcast based action support 2010-08-17 14:04:12 +03:00
kimchy 7833cb1c76 Document IDs need to be URL decoded when indexed, closes #324. 2010-08-17 10:47:02 +03:00
kimchy c989d3a928 fix limit on UTF writing (the new mechanism) to be higher than short 2010-08-17 10:21:26 +03:00
kimchy e1f3fee4e4 internally store on going state of snapshot to gateway 2010-08-17 10:03:19 +03:00
kimchy 29e981d28d internally store on going state of recovery from gateway 2010-08-17 08:17:29 +03:00
kimchy 92fd9af2b9 more info stored on shard recovery process, start time and recovery time 2010-08-16 18:22:19 +03:00
kimchy 92aa91d7b2 update the current recvoerd files size in peer recovery 2010-08-16 09:11:51 +03:00
kimchy a012e0f1bd allow to configure translog batch size (internal) and compress translog operations when doing peer recvoery 2010-08-16 09:03:48 +03:00
kimchy 1bdce4c7ef capture current state of peer level recovery 2010-08-16 09:00:34 +03:00
kimchy 57ee1bdc55 improve utf based stream input / output handling 2010-08-15 21:19:36 +03:00
kimchy 14237317fc support compression of the source field 2010-08-15 17:57:14 +03:00
kimchy ee33ee457a allow to explicitly disable compression in peer recovery (defaults to true) 2010-08-15 15:13:45 +03:00
kimchy f6c58ff35d change default calibrate_size_by_deletes for merge policy to true from false (this is what upcoming lucene version will use, and makes much more sense) 2010-08-15 09:01:09 +03:00
kimchy 6d509a5e4e explicitly clean stream handles 2010-08-15 03:08:01 +03:00
kimchy c18904eb96 Recovery: Using transport compression explicitly when recovering an index from a peer shard, closes #322. 2010-08-15 03:01:35 +03:00
kimchy 1ee2f80e68 Transport: add global compression support compressing all internal transport communication (using lzf), closes #321. 2010-08-15 02:57:22 +03:00
kimchy c10544479f refactor cached streams into a separate class 2010-08-14 13:47:34 +03:00
kimchy 01b3d42cee separet recovery tests to one with small buffer size and on with bigger one 2010-08-14 13:44:42 +03:00
kimchy e1226626bc improve thread cached bytes allocation 2010-08-14 02:26:12 +03:00
kimchy 7c5f0fe405 minor transport refactoring, add options to send response, though no options to set yet 2010-08-14 02:25:58 +03:00
kimchy b3afca2589 remove compressor package, move lzf to a different package 2010-08-14 02:25:30 +03:00
kimchy 0adb2edba2 clean code 2010-08-14 01:23:04 +03:00
kimchy 75ee01a6b4 clean builder code when dealing with maps 2010-08-14 00:37:33 +03:00
kimchy 4a9c7d672e clean code 2010-08-13 23:50:16 +03:00
kimchy d12c757824 Gateway: Chunk based storage broken, fails to recover from gateway, closes #318. 2010-08-13 14:03:52 +03:00
kimchy 12ef12f7aa better handling of closing a shard / index while retrying recovery 2010-08-12 21:44:27 +03:00
kimchy 2bd9a63467 Query DSL: custom score script, allow to use `_score` as well as `score` as the underlying query score, closes #316. 2010-08-12 18:41:29 +03:00
kimchy 98bc8285ea Analysis: Add `char_filter` on top of `tokenizer`, `filter`, and `analyzer`. Add an `html_strip` char filter, closes #315. 2010-08-12 18:16:30 +03:00
kimchy e29925684a Term Facets: Add `reverse_cout` and `reverse_term` to `order` options, closes #314. 2010-08-12 15:26:26 +03:00
kimchy b1d1f1ff94 improve peer recovery shard state handling. when throttling a recovery, don't restore the non recovering state and then move to recovery again with each retry, keep the recovering state while retrying 2010-08-12 12:31:27 +03:00
kimchy c0a7dc327c range facet: from is used in to_str, should be to 2010-08-11 23:40:42 +03:00
kimchy a6d84f5942 no need to spawn a thread when response to a ping response 2010-08-11 13:20:13 +03:00
kimchy fbea92e688 REST API hang on a bogus call, closes #297. 2010-08-11 13:18:33 +03:00
kimchy ee26d55296 Remove memory monitor and move translog operations threshold to shard level setting, closes #312. 2010-08-11 12:54:00 +03:00
kimchy df4ece8cef remove no longer required commented code ;) 2010-08-11 11:43:52 +03:00
kimchy 9f8e5cb2c0 add a simple integration level test for scroll 2010-08-10 20:48:05 +03:00
kimchy 7977edd5db a filter based on the type of the document is built in several places in the code, which is wasteful. Instead, create a filter based on the type on the document mapper level, and reuse it where applicable. 2010-08-10 18:34:49 +03:00
kimchy 5f986ef422 build a match all filter internal implementation and use it where appropiate (instead of using query filter wrapper around a match all query) 2010-08-10 18:18:51 +03:00
kimchy f2018e2f86 Facets: Automatically filter by type for facets that use explicit field names that are prefixed by the type, closes #310. 2010-08-10 17:03:14 +03:00
kimchy 61bb9d0ff9 Mappers: also use `name` as a smart lookup for field/property on top of indexName and fullName, closes #309. 2010-08-10 16:14:15 +03:00
kimchy 879191c435 don't add the same object twice under rare cases where multiple threads are introducing the same new dynamic object 2010-08-10 09:18:53 +03:00
kimchy 4bb1baa9d4 remove nb structures 2010-08-10 00:05:38 +03:00
kimchy 05d07b036a remove ning async http client, no need for it 2010-08-10 00:00:24 +03:00
kimchy cacb5a54f1 upgrade to joda 1.6.1 2010-08-09 21:12:44 +03:00
kimchy f3cc8d1249 when serializing mappers into json, also serialize index, type and id mappings (index for the enabled flag, and id/type for the store) 2010-08-09 18:25:45 +03:00
kimchy f10699d5b8 javadoc 2010-08-09 09:06:14 +03:00
kimchy 6611e7db44 refactor custom sort parsing to be "code" pluggable 2010-08-09 08:57:56 +03:00
kimchy ff8d743337 add geo distance sort option, refactor java level sort API to have sort builders (similar to facets) 2010-08-08 21:46:11 +03:00