Commit Graph

34 Commits

Author SHA1 Message Date
David Pilato 85ac406f63 Use Azure Java Management SDK 0.7.0
This first version adds `azure-management` 0.7.0 instead of using our own XML implementation.
We can now have more control and give more options to the users.

We now support different keystore types using `cloud.azure.management.keystore.type`:

* `pkcs12`
* `jceks`
* `jks`

Closes #38

(cherry picked from commit 72c77d3)
(cherry picked from commit d2541ab)
2015-02-27 10:56:00 +01:00
David Pilato 54de108a51 Use Azure Storage 2.0.0
Microsoft team has released a new specific project to deal with storage with a much cleaner API than the previous version.

See https://github.com/azure/azure-storage-java
Documentation is here: http://azure.microsoft.com/en-us/documentation/articles/storage-java-how-to-use-blob-storage/

Note that the produced ZIP file has been reduced from 5mb to 1.3mb.

Related to #38

(cherry picked from commit 4467254)
(cherry picked from commit b2f1e4d)
2015-02-12 21:25:32 +01:00
David Pilato b7b8db97c7 [package] stax-api is added twice
Library stax-api is added twice in final ZIP file.
It's due to the dependency tree.

```
[INFO] --- maven-dependency-plugin:2.8:tree (default-cli) @ elasticsearch-cloud-azure ---
[INFO] org.elasticsearch:elasticsearch-cloud-azure:jar:2.5.2-SNAPSHOT
[INFO] +- org.hamcrest:hamcrest-core:jar:1.3.RC2:test
[INFO] +- org.hamcrest:hamcrest-library:jar:1.3.RC2:test
[INFO] +- com.carrotsearch.randomizedtesting:randomizedtesting-runner:jar:2.1.10:test
[INFO] |  \- junit:junit:jar:4.10:test
[INFO] +- org.apache.lucene:lucene-test-framework:jar:4.10.2:test
[INFO] |  +- org.apache.lucene:lucene-codecs:jar:4.10.2:test
[INFO] |  +- org.apache.lucene:lucene-core:jar:4.10.2:compile
[INFO] |  +- com.carrotsearch.randomizedtesting:junit4-ant:jar:2.1.6:test
[INFO] |  \- org.apache.ant🐜jar:1.8.2:test
[INFO] +- org.elasticsearch:elasticsearch:jar:1.4.2:compile
[INFO] |  +- org.apache.lucene:lucene-analyzers-common:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-queries:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-memory:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-highlighter:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-queryparser:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-sandbox:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-suggest:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-misc:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-join:jar:4.10.2:compile
[INFO] |  +- org.apache.lucene:lucene-grouping:jar:4.10.2:compile
[INFO] |  \- org.apache.lucene:lucene-spatial:jar:4.10.2:compile
[INFO] |     \- com.spatial4j:spatial4j:jar:0.4.1:compile
[INFO] +- com.microsoft.windowsazure:microsoft-windowsazure-api:jar:0.4.6:compile
[INFO] |  +- com.sun.jersey:jersey-client:jar:1.13:compile
[INFO] |  |  \- com.sun.jersey:jersey-core:jar:1.13:compile
[INFO] |  +- javax.inject:javax.inject🫙1:compile
[INFO] |  +- com.sun.jersey:jersey-json:jar:1.13:compile
[INFO] |  |  +- org.codehaus.jettison:jettison:jar:1.1:compile
[INFO] |  |  |  \- stax:stax-api:jar:1.0.1:compile
[INFO] |  |  +- com.sun.xml.bind:jaxb-impl:jar:2.2.3-1:compile
[INFO] |  |  |  \- javax.xml.bind:jaxb-api:jar:2.2.2:compile
[INFO] |  |  |     \- javax.xml.stream:stax-api:jar:1.0-2:compile
[INFO] |  |  +- org.codehaus.jackson:jackson-core-asl:jar:1.9.2:compile
[INFO] |  |  +- org.codehaus.jackson:jackson-mapper-asl:jar:1.9.2:compile
[INFO] |  |  +- org.codehaus.jackson:jackson-jaxrs:jar:1.9.2:compile
[INFO] |  |  \- org.codehaus.jackson:jackson-xc:jar:1.9.2:compile
[INFO] |  +- commons-logging:commons-logging:jar:1.1.1:compile
[INFO] |  +- javax.mail:mail:jar:1.4.5:compile
[INFO] |  |  \- javax.activation:activation:jar:1.1:compile
[INFO] |  \- org.apache.commons:commons-lang3:jar:3.1:compile
[INFO] +- log4j:log4j:jar:1.2.17:compile
[INFO] \- org.elasticsearch:elasticsearch:test-jar:tests:1.4.2:test
```

We should exclude `javax.xml.stream:stax-api:jar:1.0-2:compile` from `com.microsoft.windowsazure:microsoft-windowsazure-api:jar:0.4.6:compile`

Closes #56.

(cherry picked from commit 68efe93)
(cherry picked from commit 68f25d1)
2015-02-04 15:38:41 +01:00
David Pilato dee924bb05 Depend on elasticsearch-parent
To simplify plugins maintenance and provide more value in the future, we are starting to build an `elasticsearch-parent` project. This commit is the first step for this plugin to depend on this new `pom` maven project.
2015-01-02 21:46:55 +01:00
Adrien Grand 3e612ed3e2 Upgrade to Lucene 5.0.0-snapshot-1642891 2014-12-02 18:19:45 +01:00
Michael McCandless 300320f862 Upgrade to Lucene 5.0.0-snapshot-1641343 2014-11-24 05:52:11 -05:00
Michael McCandless 099f9bba21 Upgrade to Lucene 5.0.0-snapshot-1637347 2014-11-10 16:46:26 -05:00
Robert Muir 8e31e1edf1 upgrade to lucene 5 snapshot (the compile is still broken as it was before, so untested) 2014-11-05 18:01:11 -05:00
David Pilato 3ae755ed9a Tests: upgrade randomizedtesting-runner to 2.1.10
Closes #43.

(cherry picked from commit 6e5efe6)
(cherry picked from commit 675a860)
2014-10-30 16:08:59 +01:00
David Pilato ca7540f502 Update to Lucene 4.10.2
Closes #42.
2014-10-30 15:45:35 +01:00
David Pilato 6d5ac76eee BlobContainer interface changed in elasticsearch 1.4.0
AWS plugin needs an update because of this change https://github.com/elasticsearch/elasticsearch/pull/7551

Closes #37.
2014-10-30 15:45:07 +01:00
David Pilato 74bd4f7881 Remove unused property 2014-08-05 11:08:26 +02:00
David Pilato 0005eab665 Update to Azure Java SDK 0.4.6
Latest Azure Java SDK is 0.4.6 when looking at http://search.maven.org/#browse%7C-589510877

Closes #25.

(cherry picked from commit 89be7b4)
2014-07-31 00:13:52 +02:00
David Pilato 0bd6c72ac6 Tests: update to Lucene 4.9.0
Closes #24.

(cherry picked from commit 13c60e4)
2014-07-31 00:12:54 +02:00
David Pilato 943f2552f9 Update to elasticsearch 1.3.0
And refactor integration tests

Closes #17.

(cherry picked from commit f5b444e)
(cherry picked from commit 1e63f86)
2014-06-19 19:05:16 +02:00
David Pilato d020012ef2 Update to Lucene 4.8
Closes #14.
(cherry picked from commit 3cf0368)
2014-04-29 21:54:16 +02:00
David Pilato 6e1ab49757 Update to elasticsearch 1.1.1
(Impact only on tests as test framework moved a bit)

(cherry picked from commit e5a32c0)
2014-04-18 11:31:22 +02:00
David Pilato 03895ea768 Create branches according to elasticsearch versions
We create branches:

* es-0.90 for elasticsearch 0.90
* es-1.0 for elasticsearch 1.0
* es-1.1 for elasticsearch 1.1
* master for elasticsearch master

We also check that before releasing we don't have a dependency to an elasticsearch SNAPSHOT version.

Add links to each version in documentation
(cherry picked from commit 65d4862)
2014-03-26 19:42:00 +01:00
David Pilato 96c280f43d Update to elasticsearch 1.1.0
Closes #11.
2014-03-26 19:37:35 +01:00
David Pilato 3969991091 prepare for next development iteration 2014-03-17 19:42:05 +01:00
David Pilato 39c3cbad98 prepare release elasticsearch-cloud-azure-2.1.0 2014-03-17 19:36:52 +01:00
David Pilato b7240d7b0d Fix azure plugin description
It now also add `azure` repositories
2014-03-17 19:36:18 +01:00
David Pilato 11dfdfb189 Add Azure Storage repository
elasticsearch 1.0 will provide a new feature named `Snapshot & Restore`.

We want to add support for [Azure Storage](http://www.windowsazure.com/en-us/documentation/services/storage/).

To enable Azure repositories, you have first to set your azure storage settings:

```yaml
    cloud:
        azure:
            storage_account: your_azure_storage_account
            storage_key: your_azure_storage_key
```

The Azure repository supports following settings:

* `container`: Container name. Defaults to `elasticsearch-snapshots`
* `base_path`: Specifies the path within container to repository data. Defaults to empty (root directory).
* `concurrent_streams`: Throttles the number of streams (per node) preforming snapshot operation. Defaults to `5`.
* `chunk_size`: Big files can be broken down into chunks during snapshotting if needed. The chunk size can be specified
in bytes or by using size value notation, i.e. `1g`, `10m`, `5k`. Defaults to `64m` (64m max)
* `compress`: When set to `true` metadata files are stored in compressed format. This setting doesn't affect index
files that are already compressed by default. Defaults to `false`.

Some examples, using scripts:

```sh
$ curl -XPUT 'http://localhost:9200/_snapshot/my_backup1' -d '{
    "type": "azure"
}'

$ curl -XPUT 'http://localhost:9200/_snapshot/my_backup2' -d '{
    "type": "azure",
    "settings": {
        "container": "backup_container",
        "base_path": "backups",
        "concurrent_streams": 2,
        "chunk_size": "32m",
        "compress": true
    }
}'
```

Example using Java:

```java
client.admin().cluster().preparePutRepository("my_backup3")
        .setType("azure").setSettings(ImmutableSettings.settingsBuilder()
                .put(AzureStorageService.Fields.CONTAINER, "backup_container")
                .put(AzureStorageService.Fields.CHUNK_SIZE, new ByteSizeValue(32, ByteSizeUnit.MB))
        ).get();
```

Closes #2.
2014-03-17 09:23:29 +01:00
David Pilato 92f629bcc4 Add plugin release semi-automatic script
Closes #10.
2014-03-13 15:35:00 +01:00
David Pilato 65448fe639 prepare for next development iteration 2014-02-14 18:39:08 +01:00
David Pilato 96c60413b8 prepare release elasticsearch-cloud-azure-2.0.0 2014-02-14 18:39:08 +01:00
David Pilato fbf9b0049c Update to elasticsearch 1.0.0.RC1
Closes #4.
2014-01-15 16:30:42 +01:00
David Pilato 9f9d85ec82 Move tests to elasticsearch test framework
Related to #3.
2014-01-15 16:30:10 +01:00
David Pilato 48b264172c update headers 2014-01-15 16:04:02 +01:00
David Pilato 316a1411d0 Move tests to elasticsearch test framework
Move tests to elasticsearch test framework.
In addition to this, we want to refactor some package names to prepare next snapshot/restore feature (see #2).

Closes #3.
2014-01-07 00:03:44 +01:00
David Pilato 41de615eb2 prepare for next development iteration 2013-11-06 16:19:32 +01:00
David Pilato 92cda5e27b prepare release elasticsearch-cloud-azure-1.0.0.alpha1 2013-11-06 16:09:25 +01:00
David Pilato a1f85f6d90 Preparing release for 1.0.0-Alpha 2013-11-06 09:54:30 +01:00
David Pilato fba4f6b1a1 Create elasticsearch-cloud-azure project 2013-08-22 13:16:00 +02:00