Commit Graph

2397 Commits

Author SHA1 Message Date
kimchy 1461da5b49 move prefetch allocation to be a NodeAllocation 2010-08-23 17:22:44 +03:00
kimchy 1517fa3d28 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 01:45:03 +03:00
kimchy 664f28492d improvements to the module system, allow for a module to spawn other modules, and pre process modules before injector creation 2010-08-22 10:42:25 +03:00
kimchy aa28b93610 refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it 2010-08-22 02:47:34 +03:00
kimchy c40935ae14 store the mapping definition in compressed form internally to save memory 2010-08-19 17:06:36 +03:00
kimchy 1ee2f80e68 Transport: add global compression support compressing all internal transport communication (using lzf), closes . 2010-08-15 02:57:22 +03:00
kimchy 23b8b81e15 EC2 Discovery ignoring instances with more than one security group, closes . 2010-08-10 22:16:13 +03:00
kimchy 8223418b04 better handling of non supported commands / opcodes 2010-08-09 17:52:24 +03:00
kimchy d4547c629f New API, update settings, allowing to change specific runtime settings of the cluster (indices). `number_of_replicas` is the only settings supported, allowing to change the number of repliacs of one or more indices. 2010-08-08 09:17:09 +03:00
kimchy d72de60b6f Add the ability to store the index name in the doc, closes . 2010-08-04 11:41:56 +03:00
kimchy 457b56937e small improvements to groovy client, allows for closure in the search request 2010-07-25 10:32:22 +03:00
kimchy 747aa2e30a only close client if it was started 2010-07-25 10:28:27 +03:00
kimchy 77b6d1d8b8 remove cloud plugin, reimplement an AWS specific cloud plugin with S3 gateway and EC2 discovery 2010-07-24 23:39:43 +03:00
kimchy 0072dd816b nicer logging, and use sync streams 2010-07-23 23:10:59 +03:00
kimchy 09bbf11605 fix dep on hamcrest for memcached plugin 2010-07-22 21:13:47 +03:00
kimchy c1ab9f290f remove compile warnings 2010-07-22 00:25:25 +03:00
kimchy 300f38ee3c improve memcached test 2010-07-20 21:12:26 +03:00
kimchy 2eeb4ebd8c improve memcached test 2010-07-20 20:53:00 +03:00
kimchy 5f0470d68b Support Cross-Origin resource in http/rest module, closes . 2010-07-19 15:06:13 +03:00
kimchy d657d4447b more shard relocation tests, create a cached executor that can be used to allocate threads that are not affected by the actual thread pool impl (can always fork, no blocking) 2010-07-19 01:45:09 +03:00
kimchy 7d29896190 add more info 2010-07-17 19:10:06 +03:00
kimchy 08ca383fd5 more work on cloud gateway 2010-07-17 15:20:13 +03:00
kimchy 1fccaf06e9 start work on reimplementing cloud gateway 2010-07-17 13:12:53 +03:00
kimchy 52ac24fa23 more debug statr on recovery from gateway 2010-07-11 21:51:45 +03:00
kimchy e7a8da8236 do flush within the finalization of index shard recovery 2010-07-11 21:20:36 +03:00
kimchy 84af9f5681 improve handling of translog snapshotting 2010-07-08 20:51:37 +03:00
kimchy d4f86899e3 more work on reuse work dir, improved transaction log to move to stream based 2010-07-06 00:12:40 +03:00
kimchy b078c9206a more work on reuse work dir, added md5 logic to identify what need to be recovered or not, note, requires reindexing 2010-07-05 14:13:55 +03:00
kimchy d848ab3df3 rename executors to esexecutors 2010-07-01 00:06:34 +03:00
kimchy 66096e97f2 Remove the terms API (replaced by facets in search), closes . 2010-06-30 19:49:41 +03:00
kimchy 04ad93e8d6 update project run target to add hadoop plugin as well 2010-06-29 21:42:47 +03:00
kimchy 3f6cd46736 allow to configure tcp network modules (transport, memcached and http) to use blocking io (just enabling it to do some performance tests) 2010-06-29 21:07:38 +03:00
kimchy 703657699a refactor new thread pools in, remove dynamic ones 2010-06-29 18:20:31 +03:00
kimchy 3770924300 allow to control the buffer size of the gateway blob container 2010-06-27 23:26:32 +03:00
kimchy edf0075025 more work on reusing work node level data, now when recovering from peers 2010-06-24 15:34:02 +03:00
kimchy 57169d4233 initial work on reusing work node level data when recovering from gateway 2010-06-24 00:32:05 +03:00
kimchy 3d84af2a40 refactor hdfs gateway to use the new common blobstore 2010-06-22 09:10:00 +03:00
kimchy 96d08cc641 remove the jgroups plugin 2010-06-21 22:51:54 +03:00
kimchy 7ed7c6db4e Gateway: Internal refactoring, requires manual upgrade when using fs gateway, closes . 2010-06-21 22:40:12 +03:00
kimchy 41e570d89d add prepare methods to the rest of the groovy APIs 2010-06-20 09:31:22 +03:00
kimchy abde45bb82 refactor util.xcontent to common.xcontent in groovy cliet 2010-06-20 08:53:45 +03:00
kimchy 0f2147aeec add some prepare APIs to the groovy APIs 2010-06-19 21:09:03 +03:00
kimchy a18e58b394 move size value/unit to bytes size value/unit, and create a ten based size value/unit 2010-06-15 18:16:10 +03:00
kimchy f75abbaa00 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:59:04 +03:00
kimchy d5bd77cc38 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:28:05 +03:00
kimchy 636bfe8466 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 16:51:38 +03:00
kimchy 48979ab6c8 improve gateway recovery when using delay index creation, close the loophole when the master was shut down before the delay expired and now other node becoming master will do the recovery 2010-06-15 10:27:26 +03:00
kimchy 66c9f2f834 Search Facets: Field Facets, closes 2010-06-04 02:31:49 +03:00
kimchy ec662cc019 always start the unicast ping discovery, so unicast discovery will work even when using multicast 2010-05-31 22:24:51 +03:00
kimchy 1749775414 update build files to reference hamcrest as well 2010-05-30 23:26:17 +03:00
kimchy ef9e6d369c memcahced should use its own openchannels handler 2010-05-27 18:51:11 +03:00
kimchy 7e5bfb5d3b share the open channels handler 2010-05-27 18:25:59 +03:00
kimchy ad5a4dde83 upgrade to jclouds 1-beta6 2010-05-27 02:28:31 +03:00
kimchy b7d11f1303 Gateway Storage: Improve it to support non breaking changes in the future, closes . 2010-05-24 18:27:48 +03:00
kimchy 2cdb7bc05a change jclouds to use cached thread pool 2010-05-24 10:24:16 +03:00
kimchy 28fa384b32 Hadoop Plugin: Use HDFS as gateway storage, closes . 2010-05-23 17:02:06 +03:00
kimchy 116cfce6f2 FS Gateway: Change indices location (Requires manual upgrade), closes . 2010-05-23 08:37:41 +03:00
kimchy 32829aeba5 change index directory in the cloud to be under "indices" 2010-05-23 08:18:49 +03:00
kimchy 5c6864e8b3 inital work on hadoop plugin - gateway hdfs support 2010-05-23 08:17:52 +03:00
kimchy ecc74f225e Cloud Plugin: Cloud gateway default chunk size change to 1g, closes . 2010-05-22 01:08:43 +03:00
kimchy a8a4bbc30e internal optimization - share built in analyzers on the node level and not on index level 2010-05-20 00:55:31 +03:00
kimchy 40fdcc43b7 update all to use LUCENE MONITOR 2010-05-19 03:55:07 +03:00
kimchy 2881d5851d remote use of deprecated methods 2010-05-19 03:35:24 +03:00
kimchy c7075c1600 Cloud Plugin: Gateway should store meta data and indices under the same container, closes . 2010-05-18 23:38:56 +03:00
kimchy 216dda3f9c Throttling of recovery (both gateway recovery and peer node recovery), closes . 2010-05-16 23:37:56 +03:00
kimchy 013e7699c3 Index Request wrongly stores extra bytes as part of the document (trailing null bytes), closes . 2010-05-16 17:56:52 +03:00
kimchy b816ed5cf2 add thread pool stats and info to nodes stats / info api 2010-05-15 18:10:24 +03:00
kimchy 723e47a54b Consolidate network settings, common tcp settings, and generalized port settings, closes . 2010-05-15 16:30:02 +03:00
kimchy c59945eec2 remove the need for global defined grooby library, use the one gradle downloaded 2010-05-15 02:26:44 +03:00
kimchy 5db5b9f4b2 better logging 2010-05-13 22:51:21 +03:00
kimchy 529edd6b38 better trace logging of nodes processed 2010-05-13 22:45:32 +03:00
kimchy 6f74e9fc04 moreve non ascii chars 2010-05-13 21:37:58 +03:00
kimchy 6cd3fc92ed reduce bytes allocation when doing http 2010-05-13 20:42:59 +03:00
kimchy e87a4117b6 expose settings builder in the node builder API 2010-05-13 15:17:49 +03:00
kimchy f6777f1e03 jarjar netty as well, so it won't be exposed to users using elasticsearch embedded 2010-05-13 14:41:50 +03:00
kimchy 7edb3f8d54 nicer code 2010-05-12 16:48:22 +03:00
kimchy a0b25ec4c3 abstract non blocking hashset 2010-05-12 04:06:44 +03:00
kimchy f6509930c7 upgrade to netty 3.2.0 CR1 2010-05-12 04:03:20 +03:00
kimchy 9c042a2b25 allow to set settings on the groovy client 2010-05-11 18:05:11 +03:00
kimchy c759eb34a8 chen the default delegation for the builder to be delegate first so it can be used easily in scripts. 2010-05-11 18:00:44 +03:00
kimchy 040030dac8 reafctor inject to util from util.guice 2010-05-10 01:34:22 +03:00
kimchy 3e405c3ec7 Nodes Stats API, closes , 2010-05-09 09:59:43 +03:00
kimchy 473b46f5ef fix NPE since we need to provide the nodes provider 2010-05-08 02:44:06 +03:00
kimchy 66f011ae76 allow to filter out settings from REST serivces 2010-05-06 09:06:32 +03:00
kimchy 596cfd273d move to beta-5 of jclouds 2010-05-05 15:22:15 +03:00
kimchy 8053237643 move from gcommon package 2010-05-04 16:02:26 +03:00
kimchy f88e01614a update with more cloud providers 2010-05-04 15:57:13 +03:00
kimchy 7d9f55309e cloud gateway implemenation working against s3 2010-05-04 14:02:36 +03:00
kimchy 3ba4370477 verify that parsing works for dates with slash 2010-05-03 16:51:15 +03:00
kimchy 5d743383c7 expose content type in client 2010-05-03 16:00:14 +03:00
kimchy 2d20ba0b42 make resolving of "logical" (#...#) hosts pluggable (so we can later support something like #cloud:privateip# 2010-05-03 00:50:44 +03:00
kimchy bac0ef98c4 more refactoring and proper exception when using cloud plugin 2010-05-02 23:33:57 +03:00
kimchy b81e3de85e start work on cloud gateway 2010-05-02 21:58:14 +03:00
kimchy fc30467b72 add jclouds logger 2010-05-02 17:23:59 +03:00
kimchy 02bfa9c4cb rename hell 2010-05-02 16:44:47 +03:00
kimchy 1119bffc5a rename hell 2010-05-02 16:40:51 +03:00
kimchy 95becccece more work on cloud 2010-05-02 16:36:51 +03:00
kimchy 4c53422428 more work on cloud 2010-05-02 16:36:05 +03:00
kimchy 1323fe8b5e minor restructering of plugins, create the cloud plugin 2010-05-02 01:28:28 +03:00
kimchy e81d559f5f update memcached name to be transport-memcached 2010-05-01 16:34:32 +03:00
kimchy ebded19dc1 Restart API: Allow to restart one or more nodes, closes . 2010-05-01 03:00:06 +03:00
kimchy 34d99c39a5 XContent - An abstraction on top of content (JSON inspired), closes . 2010-04-29 23:10:47 +03:00
kimchy f8f65c991a finalize abstracting json into xcontent 2010-04-29 02:11:53 +03:00
kimchy 37dfc443aa continue abstracting json into xcontent 2010-04-29 00:05:55 +03:00
kimchy cdc33e18f3 start abstaction of xconten over json 2010-04-28 21:29:30 +03:00
kimchy c48851f49c start abstaction of json 2010-04-28 11:20:41 +03:00
kimchy 11e4ad9bd6 Analysis ICU Plugin, closes 2010-04-27 23:54:30 +03:00
kimchy 2a19160ad6 internalize guice (no need to aop) and reduce deps 2010-04-26 02:10:42 +03:00
kimchy e56321b414 add google collections to elasticsearch as source and remove binary dep 2010-04-26 01:02:31 +03:00
kimchy d177c78d4f add junit to test compile in groovy plugin so it will compile (strange...) 2010-04-26 00:10:22 +03:00
kimchy 9b4d64011a update files 2010-04-25 23:42:44 +03:00
kimchy c7e4ec6369 update project files, remove sources from jar files 2010-04-25 23:40:58 +03:00
kimchy 10f0eaad68 refactor plugins into sub groups 2010-04-25 23:01:00 +03:00
kimchy b09f6c7b6b move client-groovy to an updated location 2010-04-25 22:20:18 +03:00
kimchy 6975f5d15a move zen discovery to be the default discovery, and move jgroups to a plugin 2010-04-25 21:52:28 +03:00
kimchy cb0d7d4735 inital support for zen discovery module (multicast discovery implemented) 2010-04-24 23:48:45 +03:00
kimchy 609af0da60 update test resources build file 2010-04-21 01:17:19 +03:00
kimchy bda476eee8 Remove dependency on slf4j for logging, create own internal abstraction, closes . 2010-04-21 00:29:42 +03:00
kimchy 9a35ddcb61 add memcached.enabled setting allowing to disable memcached even if its added as a plugin (by default, it is enabled) 2010-04-18 00:16:45 +03:00
kimchy d997389444 add annotation documentation for memcached handlers 2010-04-17 22:09:16 +03:00
kimchy f46c643c63 add Map as a parameter where Json can be passed 2010-04-17 20:10:15 +03:00
kimchy 9c1f2fdec5 allow to change resolve strategy on jsonbuilder 2010-04-17 19:05:30 +03:00
kimchy b49a1c441c node.client setting should automatically affect node.data (if not set), fix (for now) for the JsonBuilder to resolve first to the delegate (is that right?) 2010-04-17 16:39:00 +03:00
kimchy 3e430c2ca9 memcached: add binary protocol support 2010-04-17 13:31:45 +03:00
kimchy 51aac0cdf7 memcached initial work 2010-04-16 22:01:16 +03:00
kimchy 02cb297691 more groovy client work 2010-04-15 17:45:26 +03:00
kimchy ad9549462e more groovy work 2010-04-15 06:45:46 +03:00
kimchy 0da66ba367 groovy plugin - add search API 2010-04-14 19:10:29 +03:00
kimchy 96a185e107 more work on the groovy client - count/terms api 2010-04-14 13:57:40 +03:00
kimchy 7e041c43e0 more work on the groovy client 2010-04-14 12:17:52 +03:00
kimchy cb7e92b0f8 start work on the groovy plugin 2010-04-14 08:34:47 +03:00
kimchy f10a2d428d move to 0.7.0 2010-04-09 18:19:37 +03:00
kimchy 2fd36fdbf8 add local node to node builder 2010-04-09 03:17:29 +03:00
kimchy a9cd00e287 rename Server to Node to better reflect its usage (it can be a client node), also add on the NodeBuilder helper methods to set common settings 2010-04-09 00:54:54 +03:00
kimchy b760ab18b6 update maven upload to also produce javadoc and source jars 2010-04-06 11:44:41 +03:00
kimchy 11e8141069 upgrade to tika 0.7 2010-04-06 02:20:47 +03:00
kimchy 3f8acbd994 Mapper: Rename pathType to path, closes . 2010-04-04 12:02:34 +03:00
kimchy 58d2e2e1fc update maven support 2010-04-02 21:24:28 +03:00
kimchy 7c904dcd0e better pom generation 2010-04-02 19:08:33 +03:00
kimchy 6ed23744fc upgrade to gradle 0.9 preview 1 2010-04-02 15:47:27 +03:00
kimchy 05d85b2ae4 add source files to dist jar files 2010-04-01 23:06:11 +03:00
kimchy 8faf8c2169 add source files to dist jar files 2010-04-01 23:05:05 +03:00
kimchy 336a272c6f fix build 2010-03-29 12:45:13 +03:00
kimchy 3decb2a61e nice(er) code 2010-03-29 11:27:38 +03:00
kimchy 651cd78456 add control over the base64 variant 2010-03-29 00:39:13 +03:00
kimchy 913a486f99 more work on attachments, have basic types support external set values 2010-03-29 00:19:33 +03:00
kimchy b799b7a9d7 plugins support + start work on attachments plugin 2010-03-27 23:43:59 +03:00