Commit Graph

448 Commits

Author SHA1 Message Date
David Pilato e429b8d190 [build] include in plugins only needed jars
Follow up for https://github.com/elastic/elasticsearch-analysis-kuromoji/issues/61

We don't shade anymore elasticsearch dependencies, so plugins might include jars in the distribution ZIP file which might not be needed anymore.

For example, `elasticsearch-cloud-aws` comes with:

```
Archive:  cloud-aws/target/releases/elasticsearch-cloud-aws-2.0.0-SNAPSHOT.zip
  Length     Date   Time    Name
 --------    ----   ----    ----
  1920788  05-18-15 09:42   aws-java-sdk-ec2-1.9.34.jar
   503963  05-18-15 09:42   aws-java-sdk-core-1.9.34.jar
   232771  01-19-15 09:24   commons-codec-1.6.jar
   915096  01-19-15 09:24   jackson-databind-2.3.2.jar
   252288  05-18-15 09:42   aws-java-sdk-kms-1.9.34.jar
    62050  01-19-15 09:24   commons-logging-1.1.3.jar
   282269  10-31-14 13:19   httpcore-4.3.2.jar
    35058  01-19-15 09:24   jackson-annotations-2.3.0.jar
   229998  05-29-15 12:28   jackson-core-2.5.3.jar
   589289  01-19-15 09:24   joda-time-2.7.jar
   562858  05-18-15 09:42   aws-java-sdk-s3-1.9.34.jar
   590533  10-31-14 13:19   httpclient-4.3.5.jar
    44854  06-12-15 19:22   elasticsearch-cloud-aws-2.0.0-SNAPSHOT.jar
 --------                   -------
  6221815                   13 files
```

A lot of those files are already distributed with elasticsearch itself so classes are available within the classloader.

We mark all es core dependencies as provided in plugins.
We also remove `groupId` as already defined in parent pom.
And we remove non needed licenses files as some jars are not included anymore in plugins.

Closes #11647.
2015-07-01 21:37:27 +02:00
Robert Muir 46256e25f6 fix licensing 2015-06-30 00:55:11 -04:00
Robert Muir b58eb35dfa detect jar hell in tests better and fix more stuff 2015-06-30 00:12:40 -04:00
Robert Muir f8fbf1fa0c Fail startup (and tests) on jar hell 2015-06-29 23:13:45 -04:00
David Pursehouse b49e66c3a1 Replace references to ImmutableSettings with Settings
ImmutableSettings was merged into Settings in commit 4873070.

Change-Id: I06bd0150381d131593920c2328c46beacf49661f
2015-06-24 14:54:53 +09:00
Clinton Gormley d8a186e121 Added LICENSE and NOTICE files for all plugins 2015-06-23 12:50:31 +02:00
Simon Willnauer 8b60083dda Add high-level javadocs to delete-by-query
This commit adds high-level javadocs to the delete-by-query explaining
it's semantics and why it's moved to a plugin.

Closes #11723
2015-06-22 14:34:16 +02:00
Colin Goodheart-Smithe 772d0cc6e7 Build: Make rest-spec-api a project so eclipse build works
The change makes rest-spec-api a project in the same way as we build dev-tools. it packages the tests and api in a bundle using the maven-remote-resources-plugin and uses the same plugin in the plugins and core pom to unpack the rest-api-spec into the target directory and references the rest tests there in the test resources.

The main stimulus for this change is that for those using Eclipse the current build does not work. After running `mvn eclipse:eclipse` the Eclipse IDE errors because the rest-api-spec is outside of the project scope, meaning that every time the command is run (required whenever any dependencies change), the class path of all the projects has to be manually fixed.
2015-06-22 11:41:44 +01:00
Simon Willnauer 895a7dd03c [TEST] assume assertions are enabled 2015-06-22 11:25:02 +02:00
David Pilato 42f852d399 [test] ByteSizeUnit.BYTES should be explicitly set
With a recent change in core, we don't support anymore non explicit byte size units when setting values.
This commit fix that in azure repository. Otherwise, tests can't be executed.
2015-06-18 17:29:10 +02:00
Simon Willnauer 5808102d19 Upgrade AWS dependency to 1.10.0
This also apgrades JodaTime to 2.8.0.
2015-06-18 14:04:38 +02:00
Tanguy Leroux 8bd3d7e4a4 Fix number of deleted/missing documents in Delete-By-Query
The deleted counter is incremented even if the document is missing. Also, this commit ensures that the scroll id is cleared even if no documents are found by the scan request.
2015-06-18 13:09:42 +02:00
Simon Willnauer 90f9b5f60d Allow to opt-out of loading packaged REST tests
this is really just a workaround for plugins to run their own
REST tests instead of the core ones. It opts out of the rest test
loading from the core jar file and tries to load from the classpath instead.
Eventually we need to fix this infrastrucutre to move away from parameterized
tests such that subclasses can override behavior.

Closes #11721
2015-06-17 20:37:59 +02:00
Tanguy Leroux ba3540675a Add delete-by-query plugin
The delete by query plugin adds support for deleting all of the documents (from one or more indices) which match the specified query. It is a replacement for the problematic delete-by-query functionality which has been removed from Elasticsearch core in 2.0. Internally, it uses the Scan/Scroll and Bulk APIs to delete documents in an efficient and safe manner. It is slower than the old delete-by-query functionality, but fixes the problems with the previous implementation.

Closes #7052
2015-06-17 14:52:25 +02:00
David Pilato fbf83e3568 Merge pull request #11637 from dadoonet/plugins/elasticsearch-provided
[build] mark elasticsearch as provided in plugins

When we build a plugin, we suppose it will be executed within elasticsearch server.
So we should mark it as `provided`.

If a java developer needs to embed the plugin and elasticsearch, it will make sense to declare both in its `pom.xml` file.
2015-06-16 09:31:24 +02:00
David Pilato bd5c7d0ea2 [maven] clean pom.xml
In Maven parent project, in dependency management, we should only declare which versions of 3rd party jars we want to use but not force any scope.
It makes then more obvious in modules what is exactly the scope of any dependency.

For example, one could imagine importing `jimfs` as a `compile` dependency in another module/plugin with:

```xml
<dependency>
   <groupId>com.google.jimfs</groupId>
   <artifactId>jimfs</artifactId>
</dependency>
```

But it won't work as expected as the default maven `scope` should be `compile` but here it's `test` as defined in the parent project.

So, if you want to use this lib for tests, you should simply define:

```xml
<dependency>
   <groupId>com.google.jimfs</groupId>
   <artifactId>jimfs</artifactId>
   <scope>test</scope>
</dependency>
```

We also remove `maven-s3-wagon` from gce plugin as it's not used.
2015-06-15 17:08:15 +02:00
Simon Willnauer 364cbbd282 [TEST] Fix JavaScript tests - case matters here 2015-06-13 10:34:36 +02:00
Simon Willnauer 09a30e7eee Remove deprecated script APIs
The script APIs have been deprecated long ago we can now remove them.
This commit still keeps the parsing code since it might be used in a
query that is still stuck in transaction log. This issue should be discussed
elsewhere.

Closes #11619
2015-06-13 10:11:43 +02:00
David Pilato 7c365daf67 [build] mark elasticsearch as provided in plugins
When we build a plugin, we suppose it will be executed within elasticsearch server.
So we should mark it as `provided`.

If a java developer needs to embed the plugin and elasticsearch, it will make sense to declare both in its `pom.xml` file.
2015-06-12 18:53:35 +02:00
Boaz Leskes 134d898be9 Test: added awaitFix to AzureTwoStartedNodesTest.two_nodes_should_run_using_private_ip 2015-06-11 08:59:44 +02:00
Simon Willnauer 54815f259e add lang-javascript module 2015-06-09 15:17:27 +02:00
Simon Willnauer 64fdb0eeb0 migrate branch for lang-javascript 2015-06-09 15:17:27 +02:00
Simon Willnauer a24c10c703 add lang-javascript module 2015-06-09 15:17:25 +02:00
Simon Willnauer d9fe7cc252 add lang-python module 2015-06-09 15:17:23 +02:00
Simon Willnauer a04a9777d4 migrate branch for lang-python 2015-06-09 15:17:23 +02:00
Simon Willnauer a1b410652d add lang-python module 2015-06-09 15:17:22 +02:00
Boaz Leskes 8f2dc10832 AwaitFix to two_nodes_should_run_using_public_ip
https://github.com/elastic/elasticsearch/issues/11533
2015-06-08 12:45:48 +02:00
Simon Willnauer 5beed150ed add cloud-aws module 2015-06-05 13:12:38 +02:00
Simon Willnauer b3088d50a1 migrate branch for cloud-aws 2015-06-05 13:12:38 +02:00
Simon Willnauer a704a9ff83 add cloud-aws module 2015-06-05 13:12:36 +02:00
Simon Willnauer 7c23416b4a add cloud-azure module 2015-06-05 13:12:34 +02:00
Simon Willnauer 68ba0d9bab migrate branch for cloud-azure 2015-06-05 13:12:34 +02:00
Simon Willnauer 553c913aa3 add cloud-azure module 2015-06-05 13:12:32 +02:00
Simon Willnauer f10a971e8f add cloud-gce module 2015-06-05 13:12:30 +02:00
Simon Willnauer 3ab627b72f migrate branch for cloud-gce 2015-06-05 13:12:30 +02:00
Simon Willnauer 4e9e74da97 add cloud-gce module 2015-06-05 13:12:28 +02:00
Simon Willnauer 682ad1e5f9 add analysis-icu module 2015-06-05 13:12:26 +02:00
Simon Willnauer f3228e394d migrate branch for analysis-icu 2015-06-05 13:12:26 +02:00
Simon Willnauer ed3cc8d034 add analysis-icu module 2015-06-05 13:12:23 +02:00
Simon Willnauer d0be9e5f7a add analysis-phonetic module 2015-06-05 13:12:22 +02:00
Simon Willnauer 0d328b07bd migrate branch for analysis-phonetic 2015-06-05 13:12:21 +02:00
Simon Willnauer 8d9ff57bc3 add analysis-phonetic module 2015-06-05 13:12:20 +02:00
Simon Willnauer 1cb86507d4 add analysis-stempel module 2015-06-05 13:12:18 +02:00
Simon Willnauer 263bc6bff8 migrate branch for analysis-stempel 2015-06-05 13:12:17 +02:00
Simon Willnauer 78f9ee6d1b add analysis-stempel module 2015-06-05 13:12:16 +02:00
Simon Willnauer 3ca26fa1b4 add analysis-smartcn module 2015-06-05 13:12:14 +02:00
Simon Willnauer 87df2b21da migrate branch for analysis-smartcn 2015-06-05 13:12:14 +02:00
Simon Willnauer 6f8c2c7936 add analysis-smartcn module 2015-06-05 13:12:12 +02:00
Simon Willnauer 69f425daff add analysis-kuromoji module 2015-06-05 13:12:09 +02:00
Simon Willnauer 7294d27e5c migrate branch for analysis-kuromoji 2015-06-05 13:12:09 +02:00
Simon Willnauer 9b41b94459 add analysis-kuromoji module 2015-06-05 13:12:07 +02:00
Simon Willnauer 96101d3e7e add modules section 2015-06-05 13:12:05 +02:00
Simon Willnauer 05db5dc2c8 create parent pom project from its original location 2015-06-05 13:12:05 +02:00
Shay Banon 473b0f4dff Migrate built in plugins to their own repos, closes #1520. 2011-12-05 21:00:12 +02:00
Shay Banon f18ad903a9 Upgrade to Lucene 3.5, closes #1502. 2011-11-27 12:57:26 +02:00
Aaron Sutter 8a5f767286 changed writeObject to writeArray
dealing with json array not json map
2011-11-24 09:50:02 +02:00
Shay Banon e8d91a66b6 AWS Plugin: Add more automatic region configuration, closes #1490. 2011-11-23 18:09:27 +02:00
Shay Banon b2e329a609 another go at trying to solve: BigCouch returns JSON array for sequence #1478. 2011-11-23 09:21:01 +02:00
Shay Banon d69aa525b9 upgrade to aws sdk 1.2.12 2011-11-22 14:21:41 +02:00
Shay Banon 0c384af9bf Thrift transport handling unexpected URI hangs, closes #1484. 2011-11-22 10:44:10 +02:00
Aman Gupta 5deffec84f read bulk_size/drop_threshold from twitter river configuration as documented 2011-11-20 12:36:21 +02:00
Florian Gilcher bf5d722748 Add HTTPS handling to CouchDB river
Introduces 2 new configuration options:

* couchProtocol: http/https
  - Describes the protocol in use.
* no_verify: true/false
  - Allows to disable hostname verification for hosts with problematic certs
2011-11-20 11:36:27 +02:00
Shay Banon 8e9f01a0f7 BigCouch returns JSON array for sequence, closes #1478. 2011-11-18 13:35:28 +02:00
Shay Banon 7dfe48c33b Couchdb River: since changes parameter (seq) is not url encoded, closes #1470. 2011-11-15 23:40:41 +02:00
Shay Banon 99d31cc8c8 better handlign of open channels 2011-11-11 22:22:15 +02:00
Shay Banon 6c275098ba move to formal twitter4j 2.2.5 2011-10-25 00:30:22 +02:00
Shay Banon ea4462fc39 fix twitter distribution 2011-10-20 00:32:16 +02:00
Shay Banon 8c776bee97 use twitter4j 2.5 snapshot version as its the only version that works with the change of the endpoint 2011-10-14 17:46:35 +02:00
Pedro Alves 7fb32a0287 - Fix for [1393] 2011-10-14 17:16:49 +02:00
Shay Banon 5c783c8ef1 Upgrade to Apache Tika 0.10, closes #1372. 2011-10-05 15:21:56 +02:00
Shay Banon 3d4c31de91 associate a version with a discovery node 2011-10-05 12:42:27 +02:00
Shay Banon 79b63b3e07 add junit to the test dep when running groovy tests 2011-09-26 21:20:25 +03:00
Shay Banon 8a63e58e1a Add `cloud.node.auto_attributes` setting, when set to `true`, will automatically add aws ec2 related attributes to the node (like availability zone), closes #1364. 2011-09-26 21:01:23 +03:00
Shay Banon 25fe56c462 more javadoc 2011-09-22 16:11:22 +03:00
Shay Banon f3106de23f suppress unchecked compile warnings 2011-09-18 21:51:42 +03:00
Shay Banon 74079c8a13 Upgrade to Lucene 3.4.0, closes #1335. 2011-09-15 12:16:58 +03:00
Shay Banon a6eaf8c2c3 upgrade to aws sdk 1.2.7 2011-09-09 16:57:30 +03:00
Shay Banon 189d117dcb upgrade to groovy 1.8.2 2011-09-07 10:50:12 +03:00
Shay Banon 9f427010bf more to ABQ from LBQ is relevant places 2011-09-05 12:34:20 +03:00
Shay Banon 847b10dc99 Support setting ctx._parent in CouchDB-River, closes #1300. 2011-09-04 17:29:25 +03:00
Shay Banon cb7242f84e add indices stats to groovy client 2011-09-01 21:15:00 +03:00
Shay Banon 4e17543bee fix more like this call in groovy client 2011-09-01 21:11:26 +03:00
Shay Banon 2bc2b3f4e2 add percolate api to groovy client 2011-09-01 21:10:46 +03:00
Shay Banon b185078554 Java API: ActionFuture#actionGet to automatically unwrap failures, closes #1292. 2011-09-01 00:10:15 +03:00
Shay Banon c8a2f3e6f8 fix failure message 2011-09-01 00:09:16 +03:00
Shay Banon bc1dd108d1 Java API: XContentFactory creation of XContentBuilder to always be "safe", closes #1291. 2011-08-31 21:10:50 +03:00
Shay Banon 48a26f286b upgrade to rhino 1.7R3 2011-08-30 18:47:08 +03:00
Shay Banon 41f0e9fb26 upgrade jython to 2.5.2 2011-08-30 18:42:25 +03:00
Shay Banon d880a6c1b0 cleanup on new ignore_attachments flag in couchdb river 2011-08-29 17:55:06 +03:00
David Pilato 7420e99e7d Update TODO after a brief talk with couchDB team, attachment filter doesn't make sense on server side but only on client side. BTW, we may like to fully support attachments in ES couchDB river as by now only meta information are sent to Elastic Search 2011-08-29 17:49:47 +03:00
David Pilato 1f30681a84 Add ignoreAttachements option for couchDb river 2011-08-29 17:49:46 +03:00
Shay Banon 265b9f0369 CouchDB River: Add throttling when indexing does not keep up with fetching _changes, closes #1269. 2011-08-22 22:18:04 +03:00
Shay Banon 6afbfad089 Enhance transport stats to include rx and tx counters, closes #1254. 2011-08-20 21:37:37 +03:00
Shay Banon 6e81fbc30d rename cluster settings service to node settings service, as it better reflects the fact that settings are applied on the node level 2011-08-20 16:58:39 +03:00
Shay Banon 03217c460a Cluster Update Settings API, closes #1266. 2011-08-20 04:00:41 +03:00
Shay Banon 83d15740a7 Thrift Transport: Uses wrong array offset into the underlying buffer, closes #1232. 2011-08-11 15:30:16 +03:00
Shay Banon d06a7e9fe1 CouchDB River: Custom script does not convert the modified doc properly to be indexed, closes #1225. 2011-08-10 15:06:53 +03:00
Shay Banon 83271d0806 add a test to the new content_type field 2011-08-09 17:53:11 +03:00
Fehmi Can SAĞLAM 892767864f fix issue #1209 2011-08-09 17:36:42 +03:00
Shay Banon eef4ec2f5c Allow setting _index and _type with CouchDB river, closes #1219. 2011-08-09 15:53:13 +03:00