Commit Graph

73 Commits

Author SHA1 Message Date
kimchy 24e95ea7e4 upgrade to aws sdk 1.1.7 2011-02-25 21:33:50 +02:00
kimchy d054c8c14e use cached thread pool to do cluster state gateway snapshotting 2011-02-11 03:14:13 +02:00
kimchy 05283c7f6d NPE during ES startup when using S3 gateway with the europe region specified, closes #659. 2011-02-08 11:31:33 +02:00
kimchy 87d5a92edb move handling of recovered metadata to GatewayService, reducing code duplication in different gateway implementations 2011-01-18 14:38:10 +02:00
kimchy 4750ccdc1c move nullable annotation to the common package, and move javax inject (from guice 3) to internal common as well 2011-01-17 19:45:37 +02:00
kimchy a0a714e6a5 Shared Gateway: Allow to set the number of concurrent streams doing snapshot operations, closes #621. 2011-01-11 22:03:44 +02:00
kimchy 8e8a3a894f upgrade testing framework jars, improve build scripts to share the testing jars 2010-12-30 16:08:38 +02:00
kimchy 976d14705a add a warn and don't apply ec2 unicast discovery if not found (will not really happen) 2010-12-30 13:18:00 +02:00
kimchy 9361e3bd2b Cloud AWS: Change endpoint parameters to distinguish between ec2 and s3, closes #574. 2010-12-23 09:13:44 +02:00
kimchy 698f67a31a EC2 Discover: Support filtering instances by tags, closes #551. 2010-12-16 05:14:49 +02:00
kimchy ff0eeb3d1a improve getting setting as array, automatically support comma delimited values under the exact setting 2010-12-16 05:02:24 +02:00
kimchy f048353046 upgrade to aws java sdk 1.1.1 2010-12-04 21:19:36 +02:00
kimchy e340388a5d upgrde to amazen aws sdk 1.1.0 2010-11-11 01:44:16 +02:00
kimchy 0ec79e6645 upgrade to aws 1.0.14 2010-10-31 11:35:24 +02:00
kimchy 05e413a7f1 handle cases when address is null when discovering 2010-10-09 17:37:52 +02:00
kimchy af3599fe47 upgrade to aws sdk 1.0.11 2010-10-08 11:45:27 +02:00
kimchy ed96d161a6 upgrade to amazon aws jdk 1.0.10 2010-09-20 12:09:17 +02:00
kimchy 38cae95ebc EC2 Discovery should optionally bind to nodes who are members of all groups, closes #345. 2010-09-01 15:07:26 +03:00
kimchy 163b7be639 refactor gateway service to allow for more custom gateway implemenations 2010-08-28 00:34:15 +03:00
kimchy c85019fb86 upgrade to aws 1.0.008 2010-08-24 03:58:45 +03:00
kimchy 1461da5b49 move prefetch allocation to be a NodeAllocation 2010-08-23 17:22:44 +03:00
kimchy 1517fa3d28 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 01:45:03 +03:00
kimchy aa28b93610 refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it 2010-08-22 02:47:34 +03:00
kimchy 23b8b81e15 EC2 Discovery ignoring instances with more than one security group, closes #311. 2010-08-10 22:16:13 +03:00
kimchy 747aa2e30a only close client if it was started 2010-07-25 10:28:27 +03:00
kimchy 77b6d1d8b8 remove cloud plugin, reimplement an AWS specific cloud plugin with S3 gateway and EC2 discovery 2010-07-24 23:39:43 +03:00
kimchy 0072dd816b nicer logging, and use sync streams 2010-07-23 23:10:59 +03:00
kimchy d657d4447b more shard relocation tests, create a cached executor that can be used to allocate threads that are not affected by the actual thread pool impl (can always fork, no blocking) 2010-07-19 01:45:09 +03:00
kimchy 7d29896190 add more info 2010-07-17 19:10:06 +03:00
kimchy 08ca383fd5 more work on cloud gateway 2010-07-17 15:20:13 +03:00
kimchy 1fccaf06e9 start work on reimplementing cloud gateway 2010-07-17 13:12:53 +03:00
kimchy 52ac24fa23 more debug statr on recovery from gateway 2010-07-11 21:51:45 +03:00
kimchy e7a8da8236 do flush within the finalization of index shard recovery 2010-07-11 21:20:36 +03:00
kimchy 84af9f5681 improve handling of translog snapshotting 2010-07-08 20:51:37 +03:00
kimchy d4f86899e3 more work on reuse work dir, improved transaction log to move to stream based 2010-07-06 00:12:40 +03:00
kimchy d848ab3df3 rename executors to esexecutors 2010-07-01 00:06:34 +03:00
kimchy 703657699a refactor new thread pools in, remove dynamic ones 2010-06-29 18:20:31 +03:00
kimchy edf0075025 more work on reusing work node level data, now when recovering from peers 2010-06-24 15:34:02 +03:00
kimchy 57169d4233 initial work on reusing work node level data when recovering from gateway 2010-06-24 00:32:05 +03:00
kimchy 7ed7c6db4e Gateway: Internal refactoring, requires manual upgrade when using fs gateway, closes #232. 2010-06-21 22:40:12 +03:00
kimchy a18e58b394 move size value/unit to bytes size value/unit, and create a ten based size value/unit 2010-06-15 18:16:10 +03:00
kimchy f75abbaa00 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:59:04 +03:00
kimchy d5bd77cc38 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:28:05 +03:00
kimchy 636bfe8466 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 16:51:38 +03:00
kimchy ec662cc019 always start the unicast ping discovery, so unicast discovery will work even when using multicast 2010-05-31 22:24:51 +03:00
kimchy 1749775414 update build files to reference hamcrest as well 2010-05-30 23:26:17 +03:00
kimchy ad5a4dde83 upgrade to jclouds 1-beta6 2010-05-27 02:28:31 +03:00
kimchy 2cdb7bc05a change jclouds to use cached thread pool 2010-05-24 10:24:16 +03:00
kimchy 32829aeba5 change index directory in the cloud to be under "indices" 2010-05-23 08:18:49 +03:00
kimchy 5c6864e8b3 inital work on hadoop plugin - gateway hdfs support 2010-05-23 08:17:52 +03:00