44 Commits

Author SHA1 Message Date
David Pilato
f2571343fc Update to elasticsearch 1.3.0
Related to #89.
(cherry picked from commit 11e1d8a)
2014-06-19 19:23:51 +02:00
Wilkes Joiner
c743f06702 Add Server Side Encryption support for S3 repository
For legal reasons, we need to store our ES backups in S3 using server side encryption.

Closes #78.

(cherry picked from commit b3f9e12)
2014-05-28 22:49:04 +02:00
Igor Motov
6fd4945860 Update to elasticsearch 1.3.0
Closes #89.
(cherry picked from commit d65a970)
2014-05-28 21:42:57 +02:00
Igor Motov
d322b10488 Switch to shared thread pool for snapshot operations
Closes #87

(cherry picked from commit 36d4da6)
2014-05-28 21:30:54 +02:00
David Pilato
27ef02e59b Update to elasticsearch 2.0.0 / Lucene 4.8
Breaking changes in tests
2014-04-29 21:45:20 +02:00
David Pilato
f03b1aa8c7 Remove S3 gateway
In elasticsearch core code, we removed Gateways (see https://github.com/elasticsearch/elasticsearch/issues/5422).

We need now to remove S3 gateway from aws plugin.

Closes #75.
2014-04-18 11:14:46 +02:00
David Pilato
ecc4577836 cloud-aws 2.1.0 doesn't support elasticsearch 1.1.1
Closes #74.
(cherry picked from commit a9a76e2)
2014-04-18 11:14:46 +02:00
Konrad Beiske
7f271fd37a Add per repository credentials
Changed AwsS3Service to use one client per region and credentials combination.
Made S3Repository specify credentials if such exists in the repository settings.

Updated readme with repository specific credentials settings.

Closes #54.
Closes #55.
Closes #56.
(cherry picked from commit d4ea2dd)
2014-03-26 18:52:48 +01:00
David Pilato
a1669be4d1 Update to AWS SDK 1.7.3
Closes #62.
2014-03-17 19:18:20 +01:00
Kenta Suzuki
4c7e384c96 Support ap-northeast region for EC2 and S3
Closes #52.
2014-03-17 11:50:28 +01:00
David Pilato
bbb064468c Support group id in addition to group names
Based on issue #43, we want to support both notations:

* group name first
* group id if it does not work with group name

Closes #49.
2014-03-17 09:53:56 +01:00
David Pilato
7c1284817e Add plugin version in es-plugin.properties
With https://github.com/elasticsearch/elasticsearch/issues/2784, we can now add plugin version in `es-plugin.properties` file.

It will only be used with elasticsearch 1.0.0 and upper. No need to push it in 1.x branch.

Closes #59.
2014-03-17 09:41:47 +01:00
Igor Motov
05255a230d Initial implementation of S3 snapshot/restore repository 2014-01-15 11:07:05 -05:00
David Pilato
4a1cbd2f63 Update to elasticsearch 1.0.0.RC1
Closes #45.
2014-01-13 14:48:36 +01:00
David Pilato
9cc331b12d Move tests to elasticsearch test framework
Closes #46.
2014-01-13 14:44:56 +01:00
David Pilato
04f15cd56b update headers 2014-01-13 14:30:20 +01:00
Joe Pollard
712baa42ae Filter instances using EC2 API instead of locally
This change will allow EC2 API to filter by tags, AZ, and instance state.  In the situation where you have a large number of instances/reservations, this can be a performance boost.

Note that we still do the security group filter locally due to the different strategies (all or some must match).

Closes #39.
2013-11-26 17:00:18 +01:00
Andrew Gross
283d1748b5 Minor Typo Correction
Reading the logic, saw a few typos. Feel free to just fix them and not bother with a PR.

Closed #38.
2013-11-26 11:29:44 +01:00
Njal Karevoll
7e2ee43fdf Update to elasticsearch 0.90.4
Breaking changes in to EsExecutors was introduced in elasticsearch 0.90.4
Closes #35.
2013-09-17 06:35:21 +02:00
David Pilato
0f5f57d1de Revert change made with #32.
Fix missing lib in assembly. relative to #29.
Closes #33.
2013-08-09 19:29:05 +02:00
Gianni O'Neill
4da9b2cc9c Catch AmazonClientExceptions to prevent connection loss
If the AWS client throws an exception (e.g: because of a DNS failure) it will end up killing the rejoin thread and stop retrying which can lead to a node getting stuck unable to rejoin the cluster.

Closes #30.
2013-08-09 09:27:15 +02:00
David Pilato
8b20e57fd7 Update to Elasticsearch 0.90.3
Closes #31.
2013-08-09 09:17:01 +02:00
Leslie Wittig Quintanilla
485bb96ae6 Two last modifications for the new region sa-east-1. 2013-05-31 09:47:31 +02:00
Shay Banon
8d7bcc0d93 Merge pull request #23 from vinodc/s3gateway-us-west-2
Update S3Gateway to add us-west-2
2013-04-04 01:03:48 -07:00
Leslie Wittig Quintanilla
36e29cec7a Adding sa-east-1 region. 2013-04-03 14:45:32 -03:00
Leslie Wittig Quintanilla
5734b408ed Adding sa-east-1 region. 2013-04-03 14:31:10 -03:00
Vinod Chandru
a57a9e23f1 Update S3Gateway to add us-west-2 2013-03-31 18:12:12 -07:00
Mark Gallop
22722840d4 Update src/main/java/org/elasticsearch/cloud/aws/AwsEc2Service.java 2012-12-06 00:17:34 +01:00
Mark Gallop
f1297eec81 Update src/main/java/org/elasticsearch/gateway/s3/S3Gateway.java 2012-12-06 00:17:34 +01:00
Mark Gallop
ef889a2d6e Update src/main/java/org/elasticsearch/cloud/aws/AwsS3Service.java
Add support for Asia Pacific (Sydney) Region.
2012-12-06 00:17:34 +01:00
Sean Laurent
ed964368a9 Fixed EC2 discovery to correctly find groups, regardless of whether the instance is in the public cloud or within a VPC. 2012-08-25 14:21:38 +03:00
Shay Banon
51d46154eb fix logging message 2012-06-27 14:13:14 +02:00
Shay Banon
8904847933 more logging on region and endpoint used 2012-06-27 12:26:34 +02:00
Shay Banon
220275e6b0 log when an instance is not added because of its state 2012-06-27 11:38:18 +02:00
Shay Banon
96a4e5de46 Optional credentials with latest AWS SDK, closes #11. 2012-06-20 10:29:04 +02:00
Shay Banon
b9368e2fc2 no need for objectCount, we can use keys 2012-03-07 22:08:58 +02:00
Holden Karau
bb222f0f7f Improve S3 grouped deletes
* Move the grouping to outside the main while(true) loop
2012-03-06 15:47:58 -08:00
Holden Karau
b19f1a5b06 Group S3 delete requests.
* In the new AWS SDK deleting multiple objects
  in a single request is now supported. See:
http://docs.amazonwebservices.com/AmazonS3/latest/dev/DeletingMultipleObjectsUsingJava.html
2012-03-05 16:32:06 -08:00
Holden Karau
d234b3cdc8 Fix region parsing
* Fix invalid host names and remove \t's from region
  hostnames.
2012-03-05 15:19:52 -08:00
Shay Banon
6dceb5b326 upgrade to latest assembly 2012-02-26 10:15:07 +02:00
Shay Banon
e4a23e244b move to elasticsearch 0.19.0 snap and use some of its features 2012-01-31 13:04:54 +02:00
Shay Banon
03b422e959 aws-sdk pulls the wrong version of httpclient that comes bundled with the installation, use the formal one 2012-01-03 01:21:12 +02:00
Shay Banon
2cbf07e5b6 S3 blob storage gateway: deleting an index named x destroys data for any index with name beginning with x, closes #2. 2012-01-02 23:10:00 +02:00
Shay Banon
7d57a52d0f first commit 2011-12-05 15:42:33 +02:00