Commit Graph

259 Commits

Author SHA1 Message Date
kimchy cf51fbcdc6 change hdfs location test 2010-11-03 21:19:49 +02:00
kimchy dd9553e7cc add debug and trace logs to couchdb river 2010-11-02 01:07:06 +02:00
kimchy 0ec79e6645 upgrade to aws 1.0.14 2010-10-31 11:35:24 +02:00
kimchy b8708f276d Transport Thrift: Upgrade to thrift 0.5.0, closes #457. 2010-10-27 23:12:53 +02:00
kimchy 2460ee8072 Thrift: Response might get corrupted with extra data, closes #452. 2010-10-26 14:58:57 +02:00
kimchy bad45de7af fix wrong handling of empty param in thrift/memcached transport 2010-10-18 14:47:28 +02:00
kimchy ed9d9aa358 CouchDB River: Allow to define a javascript that can munge the changes stream, closes #431. 2010-10-14 17:57:52 +02:00
kimchy 81fd17b035 CouchDB River: Deletes not handles correctly 2010-10-14 17:38:28 +02:00
kimchy eb44910047 add py as lang 2010-10-14 16:22:12 +02:00
kimchy ae05ce0551 Scripting: Allow to define scripts within `config/scripts`, automatically compiled and can be referenced by name, closes #429. 2010-10-14 16:14:23 +02:00
kimchy 503b023eac remove attempt to get ruby in scripting, problems embedding it... 2010-10-14 14:11:13 +02:00
kimchy 1f4aa5d9d2 handle cases when the body is not set in thrift 2010-10-13 18:35:52 +02:00
kimchy 18d8e9dcdd add more script tests 2010-10-10 20:05:37 +02:00
kimchy a754ebacd4 Python Plugin: Allow to use python for scripts, closes #418. 2010-10-09 20:59:41 +02:00
kimchy 05e413a7f1 handle cases when address is null when discovering 2010-10-09 17:37:52 +02:00
kimchy 8b03b914f9 Twitter River: Support filter stream, closes #416. 2010-10-09 00:39:10 +02:00
kimchy ee2fabb9dd Thrift: Rename Status.CONTINUE to Status.CONT (reserved word), closes #415. 2010-10-08 23:06:30 +02:00
kimchy 6314c2460c Geo Overhaul (work with multiple locations), closes #414. 2010-10-08 22:31:21 +02:00
kimchy 523a8b4c3e rename xonctent mappers to just mappers 2010-10-08 15:05:07 +02:00
kimchy af3599fe47 upgrade to aws sdk 1.0.11 2010-10-08 11:45:27 +02:00
kimchy d0bf743ab4 Query DSL: query_string / field to use the optimized match_all query when using * (or *:*), closes #413. 2010-10-07 16:48:24 +02:00
kimchy 504a5458c5 add trace logging for thrift 2010-10-07 11:53:13 +02:00
kimchy bc4543a5e9 add multi threaded test execution for groovy and javascript 2010-10-06 22:00:27 +02:00
kimchy abf1855509 change logging level 2010-10-05 15:52:18 +02:00
Mahendra M a0d48487c1 Couchdb river plugin - ignore design documents 2010-10-05 15:51:36 +02:00
kimchy c4d17860a1 Wikipedia River: A river to index wikipedia, closes #403. 2010-10-03 22:22:45 +02:00
kimchy 6371ed7d78 build structure for ruby support, problems in figuring out how to execute the ruby scripts in the most optimal manner 2010-10-03 15:52:44 +02:00
kimchy 7180636df6 add close to script services 2010-10-03 14:31:36 +02:00
kimchy 80b8898542 add support for java List usage as javascript Array in scripts 2010-10-03 13:10:33 +02:00
kimchy 5b8bc333bd JavaScript Plugin: Allow to use javascript for scripts, closes #401. 2010-10-03 02:20:37 +02:00
kimchy 5a7c8fe2cb allow script engines to have several types 2010-10-02 21:18:01 +02:00
kimchy 542a85090f add _source script field search 2010-10-02 17:36:26 +02:00
kimchy 7a78374398 fix wrong refactoring... 2010-10-02 01:29:28 +02:00
kimchy 9e8ebd46e8 Groovy Plugin: Allow to run use groovy for scripts (where applicable), closes #398. 2010-10-02 01:22:05 +02:00
kimchy 5c1c580b84 upgrade to groovy 1.7.5 2010-10-01 22:29:08 +02:00
Mahendra M c657c7c6d0 Filter parameters not formed properly in couchdb river plugin, closes #394 2010-10-01 13:56:07 +02:00
kimchy 1af53bce0d Support http auth in couchdb river plugin, closes #390. 2010-09-30 20:58:04 +02:00
kimchy 735ad0d43d CouchDB River: Support couchdb filter query parameters, closes #389. 2010-09-30 20:47:05 +02:00
kimchy 06c7c4a9ac thrift definition `params` is conflict with c#'s keyword, rename to `parameters`, closes #392. 2010-09-30 10:07:02 +02:00
kimchy 1bcecd7bb7 fix rabbitmq params parsing 2010-09-28 17:12:34 +02:00
kimchy f01f5ab323 remove double & in the url, though seems like couchdb does not mind... 2010-09-27 23:04:44 +02:00
kimchy 48bd9a2076 don't try adn connect to couch until we manage to check if there is a last_seq 2010-09-27 15:21:26 +02:00
kimchy efe5b5734c rename client-groovy to lang-groovy 2010-09-26 18:13:45 +02:00
kimchy 3a5938b2d1 better state control, store under couchdb obj 2010-09-23 02:45:32 +02:00
kimchy ecaaeb5250 River CouchDB Plugin, closes #382. 2010-09-23 02:26:12 +02:00
kimchy d0b29fe3ef allow to set exhange and routing_key 2010-09-21 22:19:36 +02:00
kimchy 8cce3d6cce rabbitmq river 2010-09-21 17:41:19 +02:00
kimchy aa68667d63 rabbitmq river 2010-09-21 17:32:34 +02:00
kimchy 4fe7cbccca rename indexer to river 2010-09-21 13:35:09 +02:00
kimchy 2715212868 better handling of creation of index 2010-09-21 01:20:37 +02:00
kimchy 5f574013fd add a twitter indexer 2010-09-20 23:06:59 +02:00
kimchy 94a77b69d6 add a twitter indexer 2010-09-20 18:17:02 +02:00
kimchy ed96d161a6 upgrade to amazon aws jdk 1.0.10 2010-09-20 12:09:17 +02:00
kimchy 38aeba438d XContent refactoring, closes #367. 2010-09-12 23:20:15 +02:00
kimchy 4f08801bb9 Thrift Plugin: Expose REST interface using thrift, closes #354. 2010-09-04 02:45:37 +03:00
kimchy 042af200e8 Gateway: Default to `local` gateway (replace `none` gateway), closes #347. 2010-09-01 23:21:26 +03:00
kimchy 46b58ce77f Memcached transport does not support version, npe when no uri, closes #342. 2010-09-01 15:16:03 +03:00
kimchy 38cae95ebc EC2 Discovery should optionally bind to nodes who are members of all groups, closes #345. 2010-09-01 15:07:26 +03:00
kimchy 163b7be639 refactor gateway service to allow for more custom gateway implemenations 2010-08-28 00:34:15 +03:00
kimchy c85019fb86 upgrade to aws 1.0.008 2010-08-24 03:58:45 +03:00
kimchy 02b74dfb63 Memcach: StreamCorruptedException when loading a cluster, closes #300. 2010-08-23 22:21:35 +03:00
kimchy 8079b5def5 Should escape \r\n in exception message, closes #332. 2010-08-23 22:19:40 +03:00
kimchy 1461da5b49 move prefetch allocation to be a NodeAllocation 2010-08-23 17:22:44 +03:00
kimchy 1517fa3d28 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 01:45:03 +03:00
kimchy 664f28492d improvements to the module system, allow for a module to spawn other modules, and pre process modules before injector creation 2010-08-22 10:42:25 +03:00
kimchy aa28b93610 refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it 2010-08-22 02:47:34 +03:00
kimchy c40935ae14 store the mapping definition in compressed form internally to save memory 2010-08-19 17:06:36 +03:00
kimchy 1ee2f80e68 Transport: add global compression support compressing all internal transport communication (using lzf), closes #321. 2010-08-15 02:57:22 +03:00
kimchy 23b8b81e15 EC2 Discovery ignoring instances with more than one security group, closes #311. 2010-08-10 22:16:13 +03:00
kimchy 8223418b04 better handling of non supported commands / opcodes 2010-08-09 17:52:24 +03:00
kimchy d4547c629f New API, update settings, allowing to change specific runtime settings of the cluster (indices). `number_of_replicas` is the only settings supported, allowing to change the number of repliacs of one or more indices. 2010-08-08 09:17:09 +03:00
kimchy d72de60b6f Add the ability to store the index name in the doc, closes #292. 2010-08-04 11:41:56 +03:00
kimchy 457b56937e small improvements to groovy client, allows for closure in the search request 2010-07-25 10:32:22 +03:00
kimchy 747aa2e30a only close client if it was started 2010-07-25 10:28:27 +03:00
kimchy 77b6d1d8b8 remove cloud plugin, reimplement an AWS specific cloud plugin with S3 gateway and EC2 discovery 2010-07-24 23:39:43 +03:00
kimchy 0072dd816b nicer logging, and use sync streams 2010-07-23 23:10:59 +03:00
kimchy 09bbf11605 fix dep on hamcrest for memcached plugin 2010-07-22 21:13:47 +03:00
kimchy c1ab9f290f remove compile warnings 2010-07-22 00:25:25 +03:00
kimchy 300f38ee3c improve memcached test 2010-07-20 21:12:26 +03:00
kimchy 2eeb4ebd8c improve memcached test 2010-07-20 20:53:00 +03:00
kimchy 5f0470d68b Support Cross-Origin resource in http/rest module, closes #218. 2010-07-19 15:06:13 +03:00
kimchy d657d4447b more shard relocation tests, create a cached executor that can be used to allocate threads that are not affected by the actual thread pool impl (can always fork, no blocking) 2010-07-19 01:45:09 +03:00
kimchy 7d29896190 add more info 2010-07-17 19:10:06 +03:00
kimchy 08ca383fd5 more work on cloud gateway 2010-07-17 15:20:13 +03:00
kimchy 1fccaf06e9 start work on reimplementing cloud gateway 2010-07-17 13:12:53 +03:00
kimchy 52ac24fa23 more debug statr on recovery from gateway 2010-07-11 21:51:45 +03:00
kimchy e7a8da8236 do flush within the finalization of index shard recovery 2010-07-11 21:20:36 +03:00
kimchy 84af9f5681 improve handling of translog snapshotting 2010-07-08 20:51:37 +03:00
kimchy d4f86899e3 more work on reuse work dir, improved transaction log to move to stream based 2010-07-06 00:12:40 +03:00
kimchy b078c9206a more work on reuse work dir, added md5 logic to identify what need to be recovered or not, note, requires reindexing 2010-07-05 14:13:55 +03:00
kimchy d848ab3df3 rename executors to esexecutors 2010-07-01 00:06:34 +03:00
kimchy 66096e97f2 Remove the terms API (replaced by facets in search), closes #242. 2010-06-30 19:49:41 +03:00
kimchy 04ad93e8d6 update project run target to add hadoop plugin as well 2010-06-29 21:42:47 +03:00
kimchy 3f6cd46736 allow to configure tcp network modules (transport, memcached and http) to use blocking io (just enabling it to do some performance tests) 2010-06-29 21:07:38 +03:00
kimchy 703657699a refactor new thread pools in, remove dynamic ones 2010-06-29 18:20:31 +03:00
kimchy 3770924300 allow to control the buffer size of the gateway blob container 2010-06-27 23:26:32 +03:00
kimchy edf0075025 more work on reusing work node level data, now when recovering from peers 2010-06-24 15:34:02 +03:00
kimchy 57169d4233 initial work on reusing work node level data when recovering from gateway 2010-06-24 00:32:05 +03:00
kimchy 3d84af2a40 refactor hdfs gateway to use the new common blobstore 2010-06-22 09:10:00 +03:00
kimchy 96d08cc641 remove the jgroups plugin 2010-06-21 22:51:54 +03:00