Commit Graph

2641 Commits

Author SHA1 Message Date
Shay Banon b2e329a609 another go at trying to solve: BigCouch returns JSON array for sequence #1478. 2011-11-23 09:21:01 +02:00
Shay Banon d69aa525b9 upgrade to aws sdk 1.2.12 2011-11-22 14:21:41 +02:00
Shay Banon 0c384af9bf Thrift transport handling unexpected URI hangs, closes #1484. 2011-11-22 10:44:10 +02:00
Aman Gupta 5deffec84f read bulk_size/drop_threshold from twitter river configuration as documented 2011-11-20 12:36:21 +02:00
Florian Gilcher bf5d722748 Add HTTPS handling to CouchDB river
Introduces 2 new configuration options:

* couchProtocol: http/https
  - Describes the protocol in use.
* no_verify: true/false
  - Allows to disable hostname verification for hosts with problematic certs
2011-11-20 11:36:27 +02:00
Shay Banon 8e9f01a0f7 BigCouch returns JSON array for sequence, closes #1478. 2011-11-18 13:35:28 +02:00
Shay Banon 7dfe48c33b Couchdb River: since changes parameter (seq) is not url encoded, closes #1470. 2011-11-15 23:40:41 +02:00
Shay Banon 99d31cc8c8 better handlign of open channels 2011-11-11 22:22:15 +02:00
Shay Banon 6c275098ba move to formal twitter4j 2.2.5 2011-10-25 00:30:22 +02:00
Shay Banon ea4462fc39 fix twitter distribution 2011-10-20 00:32:16 +02:00
Shay Banon 8c776bee97 use twitter4j 2.5 snapshot version as its the only version that works with the change of the endpoint 2011-10-14 17:46:35 +02:00
Pedro Alves 7fb32a0287 - Fix for [1393] 2011-10-14 17:16:49 +02:00
Shay Banon 5c783c8ef1 Upgrade to Apache Tika 0.10, closes #1372. 2011-10-05 15:21:56 +02:00
Shay Banon 3d4c31de91 associate a version with a discovery node 2011-10-05 12:42:27 +02:00
Shay Banon 79b63b3e07 add junit to the test dep when running groovy tests 2011-09-26 21:20:25 +03:00
Shay Banon 8a63e58e1a Add `cloud.node.auto_attributes` setting, when set to `true`, will automatically add aws ec2 related attributes to the node (like availability zone), closes #1364. 2011-09-26 21:01:23 +03:00
Shay Banon 25fe56c462 more javadoc 2011-09-22 16:11:22 +03:00
Shay Banon f3106de23f suppress unchecked compile warnings 2011-09-18 21:51:42 +03:00
Shay Banon 74079c8a13 Upgrade to Lucene 3.4.0, closes #1335. 2011-09-15 12:16:58 +03:00
Shay Banon a6eaf8c2c3 upgrade to aws sdk 1.2.7 2011-09-09 16:57:30 +03:00
Shay Banon 189d117dcb upgrade to groovy 1.8.2 2011-09-07 10:50:12 +03:00
Shay Banon 9f427010bf more to ABQ from LBQ is relevant places 2011-09-05 12:34:20 +03:00
Shay Banon 847b10dc99 Support setting ctx._parent in CouchDB-River, closes #1300. 2011-09-04 17:29:25 +03:00
Shay Banon cb7242f84e add indices stats to groovy client 2011-09-01 21:15:00 +03:00
Shay Banon 4e17543bee fix more like this call in groovy client 2011-09-01 21:11:26 +03:00
Shay Banon 2bc2b3f4e2 add percolate api to groovy client 2011-09-01 21:10:46 +03:00
Shay Banon b185078554 Java API: ActionFuture#actionGet to automatically unwrap failures, closes #1292. 2011-09-01 00:10:15 +03:00
Shay Banon c8a2f3e6f8 fix failure message 2011-09-01 00:09:16 +03:00
Shay Banon bc1dd108d1 Java API: XContentFactory creation of XContentBuilder to always be "safe", closes #1291. 2011-08-31 21:10:50 +03:00
Shay Banon 48a26f286b upgrade to rhino 1.7R3 2011-08-30 18:47:08 +03:00
Shay Banon 41f0e9fb26 upgrade jython to 2.5.2 2011-08-30 18:42:25 +03:00
Shay Banon d880a6c1b0 cleanup on new ignore_attachments flag in couchdb river 2011-08-29 17:55:06 +03:00
David Pilato 7420e99e7d Update TODO after a brief talk with couchDB team, attachment filter doesn't make sense on server side but only on client side. BTW, we may like to fully support attachments in ES couchDB river as by now only meta information are sent to Elastic Search 2011-08-29 17:49:47 +03:00
David Pilato 1f30681a84 Add ignoreAttachements option for couchDb river 2011-08-29 17:49:46 +03:00
Shay Banon 265b9f0369 CouchDB River: Add throttling when indexing does not keep up with fetching _changes, closes #1269. 2011-08-22 22:18:04 +03:00
Shay Banon 6afbfad089 Enhance transport stats to include rx and tx counters, closes #1254. 2011-08-20 21:37:37 +03:00
Shay Banon 6e81fbc30d rename cluster settings service to node settings service, as it better reflects the fact that settings are applied on the node level 2011-08-20 16:58:39 +03:00
Shay Banon 03217c460a Cluster Update Settings API, closes #1266. 2011-08-20 04:00:41 +03:00
Shay Banon 83d15740a7 Thrift Transport: Uses wrong array offset into the underlying buffer, closes #1232. 2011-08-11 15:30:16 +03:00
Shay Banon d06a7e9fe1 CouchDB River: Custom script does not convert the modified doc properly to be indexed, closes #1225. 2011-08-10 15:06:53 +03:00
Shay Banon 83271d0806 add a test to the new content_type field 2011-08-09 17:53:11 +03:00
Fehmi Can SAĞLAM 892767864f fix issue #1209 2011-08-09 17:36:42 +03:00
Shay Banon eef4ec2f5c Allow setting _index and _type with CouchDB river, closes #1219. 2011-08-09 15:53:13 +03:00
Shay Banon 9503126155 Rest API: Add an `X-Opaque-Id` header, to be returned in the response if exists in the request, closes #1202. 2011-08-03 19:40:25 +03:00
Shay Banon b104c19e7a Groovy Plugins: Upgrade to 1.8.1, closes #1175. 2011-07-28 20:41:15 +03:00
kimchy 09528610c1 cleanup some test code, rename internal masterDoc to rootDoc 2011-07-17 04:32:18 +03:00
kimchy 1a3306912e upgrade to aws sdk 1.2.4 2011-07-16 08:58:48 +03:00
kimchy f2c085a9f9 Fix strange compilation failure under jdk7... 2011-07-11 03:59:15 +03:00
kimchy a8d8eb686e RabbitMQ River: Upgrade to rabbitmq driver 2.5.1, closes #1112. 2011-07-10 04:22:20 +03:00
kimchy ac1240b407 add debug logging for parameters used for ec2 unicast disco 2011-07-07 17:48:14 +03:00
Lukas Vlcek d1ad747824 Fixing plugins description 2011-07-06 17:55:38 +03:00
kimchy 3a7f7664b6 Nested Object/Docs Mapping and Searching, closes #1095. 2011-07-06 17:53:55 +03:00
kimchy 0b59c00e0d Upgrade to Lucene 3.3. closes #1083. 2011-07-01 18:30:06 +03:00
kimchy 72ee0aaee7 Realtime GET, closes #1060. 2011-06-24 09:39:37 +03:00
Igor Motov ae5b963e97 Specify a unique cluster name for all Integration tests 2011-06-19 10:10:34 +03:00
kimchy abd38720f1 Add ec2 specific network hosts, closes #1037. 2011-06-15 22:26:21 +03:00
Paul_Loy e1514aa8e0 reverted adding IOException to NetworkService, return null if cannot resolve name and log 2011-06-15 22:03:16 +03:00
Paul_Loy 64ffd6634a adding CustomNameResolver to NetworkService for ec2 hostname resolving 2011-06-15 22:03:16 +03:00
Paul_Loy 8173f9fb18 removing underscores as they are pre-stripped 2011-06-15 22:03:15 +03:00
Paul_Loy d474025b30 Ec2NameResolver minus commons httpclient 2011-06-15 22:03:15 +03:00
Paul_Loy 6a60bbba1d adding ability for gradle to create eclipse project files and classpaths 2011-06-15 22:03:15 +03:00
kimchy 8bb448473d more optimizations for sharing same analyzers across different indices on the same node 2011-06-14 18:51:34 +03:00
René Scheibe 5f4c6c75ae cleaned Groovy classes * added type information to public methods * removed semicolons * replaced GStrings with Strings 2011-06-12 13:49:19 +03:00
kimchy abfc7f0db4 internal refactoring simplifying the type mapping system 2011-06-04 03:56:01 +03:00
kimchy 0a4e582404 Query Parser Module Refactor, closes #994. 2011-06-03 04:32:30 +03:00
kimchy a9112b4698 Thrift: Upgrade to thrift 0.6.1, closes #986. 2011-06-01 04:46:19 +03:00
kimchy 8267a76747 force the type to be set when using the put mapping API in Java 2011-05-31 16:21:59 +03:00
kimchy 68a56a0b58 optimize generation of rest responses and reduce copying bytes around 2011-05-24 14:12:17 +03:00
kimchy 6805d17fc9 upgrade to aws sdk 1.2.0 2011-05-21 02:08:39 +03:00
kimchy 7379258f2e use different settings for aws proxy port / host 2011-05-03 16:43:52 +03:00
Adam Creeger 8eb6e91eac Adding support for accessing EC2 and S3 over an http proxy. This is configured using the network.proxyHost and network.proxyPort settings. 2011-05-03 16:41:16 +03:00
kimchy 413cbf1713 Upgrade to groovy 1.8.0 2011-04-29 01:06:26 +03:00
kimchy 166493f9d5 properly clean mapper data, and cache some mapping structures 2011-04-17 09:52:29 +03:00
kimchy 85aeaaedd0 update to aws sdk 1.1.9 2011-04-15 01:56:27 +03:00
kimchy 3b72d63035 EC2 Zen Discovery: Automatically use the configured transport port to ping other nodes, closes #854. 2011-04-14 02:13:27 +03:00
kimchy 6061656170 upgrade to groovy 1.7.10 2011-04-06 16:31:25 +03:00
kimchy 5d6e84f206 Upgrade Lucene 3.1: Analyzers, closes #826. 2011-04-04 14:36:13 +03:00
kimchy 4e4495ff1d Upgrade to Lucene 3.1, closes #825. 2011-04-04 12:54:15 +03:00
kimchy 367c9562c6 update to rabbitmq client 2.3.1 2011-03-15 10:08:08 +02:00
kimchy c7b36f113d fix oauth support to also use it when reconnecting, and have the config as part of an oauth element 2011-03-09 10:12:12 +02:00
unknown d4e89faf6b added oauth support 2011-03-09 09:47:39 +02:00
kimchy 016e5bce04 Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758. 2011-03-08 21:53:33 +02:00
kimchy 4bdae621f9 Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752. 2011-03-07 13:09:07 +02:00
kimchy 578b752425 Twitter River: Automatically reconnect when disconnected from twitter stream, closes #735. 2011-03-02 04:00:12 +02:00
kimchy 3bac33e69e don't use AfterTest / BeforeTest in any tests 2011-02-28 22:28:55 +02:00
kimchy 24e95ea7e4 upgrade to aws sdk 1.1.7 2011-02-25 21:33:50 +02:00
kimchy bcaeb226d5 Twitter river: "user.screen_name" should not be analyzed, closes #715. 2011-02-23 19:55:48 +02:00
kimchy 45ec2c6e21 Allow to register custom rivers under a custom type name (And not full class names), closes #712. 2011-02-22 22:13:31 +02:00
kimchy a4978bc67e Support for other exchange types and options in AMQP river, closes #709. 2011-02-22 20:06:43 +02:00
Charles Duffy d0780f0f62 Allow exchange type and durability, queue durability and queue auto-delete to be specified; closes #696 2011-02-22 20:02:25 +02:00
kimchy 1bffe432a0 fix loading bytes to parse in mapper attachment test 2011-02-20 01:49:37 +02:00
Alberto Paro b5068baf63 Updated tika to 0.9 2011-02-20 00:47:29 +02:00
kimchy 5e2ca6fb5d support servlet path as well 2011-02-18 05:12:26 +02:00
kimchy 8d867dc24c explicitly set the cat under which jdk logging is logged 2011-02-18 05:00:08 +02:00
kimchy dab23a4d51 fix thrift test to take into account that index can return CREATED status code now 2011-02-18 00:24:50 +02:00
kimchy d1d3f8c4ca REST codes: Improve returned error codes on REST APIs, associate codes with internal exceptions, closes #690. 2011-02-16 01:41:01 +02:00
kimchy d054c8c14e use cached thread pool to do cluster state gateway snapshotting 2011-02-11 03:14:13 +02:00
kimchy 57108c8575 REST API: Failure to index docs that have their ids URL encoded and contain `/`, closes #681. 2011-02-10 03:18:01 +02:00
kimchy 5a75964fc3 upgrade to groovy 1.7.7 2011-02-09 22:30:55 +02:00
kimchy 05283c7f6d NPE during ES startup when using S3 gateway with the europe region specified, closes #659. 2011-02-08 11:31:33 +02:00
kimchy 0dfa3dc8a2 Groovy client doesn't bind to any variables outside the closure, closes #654. 2011-02-01 14:16:27 +02:00
kimchy 8927e1dee4 Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663. 2011-02-01 13:41:58 +02:00
kimchy cebdae5707 refactor script execution handling to improve performance, also introduce specific search script executor 2011-01-31 16:08:06 +02:00
kimchy 94c632b79b Java Client - Allow to set facets in binary format, closes #442. 2011-01-30 15:53:10 +02:00
kimchy 3f8933fb7b add filter setting with clojure in groovy 2011-01-28 11:28:41 +02:00
kimchy 87d5a92edb move handling of recovered metadata to GatewayService, reducing code duplication in different gateway implementations 2011-01-18 14:38:10 +02:00
kimchy 4750ccdc1c move nullable annotation to the common package, and move javax inject (from guice 3) to internal common as well 2011-01-17 19:45:37 +02:00
kimchy 64e5784623 Twitter updates have broken Twitter River, Update to latest version of Twitter4J, closes #627. 2011-01-14 20:48:09 +02:00
kimchy a0a714e6a5 Shared Gateway: Allow to set the number of concurrent streams doing snapshot operations, closes #621. 2011-01-11 22:03:44 +02:00
kimchy 50cdf2920f Make ToXContent return a builder 2011-01-10 22:11:12 +02:00
kimchy a450deee5f Groovy Plugin not loaded (groovy not enabled as pluggable script provider), closes #581. 2010-12-30 16:21:08 +02:00
kimchy 8e8a3a894f upgrade testing framework jars, improve build scripts to share the testing jars 2010-12-30 16:08:38 +02:00
kimchy 976d14705a add a warn and don't apply ec2 unicast discovery if not found (will not really happen) 2010-12-30 13:18:00 +02:00
kimchy abe33d59a5 use Closeables 2010-12-30 12:29:54 +02:00
kimchy f4a30fdc84 better stream close handling in couchdb river 2010-12-30 12:25:50 +02:00
kimchy ec2f0e05f9 upgrade to jython 2.5.2rc2 2010-12-27 10:23:01 +02:00
kimchy a00f99e7c6 upgrade to groovy 1.7.6 2010-12-27 08:21:25 +02:00
kimchy 27fe076175 upgrade to rabbitmq client 2.2.0 2010-12-26 12:50:52 +02:00
kimchy 9361e3bd2b Cloud AWS: Change endpoint parameters to distinguish between ec2 and s3, closes #574. 2010-12-23 09:13:44 +02:00
kimchy 698f67a31a EC2 Discover: Support filtering instances by tags, closes #551. 2010-12-16 05:14:49 +02:00
kimchy ff0eeb3d1a improve getting setting as array, automatically support comma delimited values under the exact setting 2010-12-16 05:02:24 +02:00
kimchy 085066ed19 set, by default, the send and receive buffers to 32k on tcp 2010-12-15 05:54:09 +02:00
kimchy b6277ac14d increase netty worker count to default to the updated value netty defaults to 2010-12-15 01:16:00 +02:00
kimchy f25eebb249 update to not use deprecated method 2010-12-08 00:16:20 +02:00
kimchy aa00fe6a83 upgrade twitter4j to 2.1.7 2010-12-05 06:39:22 +02:00
kimchy f048353046 upgrade to aws java sdk 1.1.1 2010-12-04 21:19:36 +02:00
kimchy a90684aaa5 Upgrade to Lucene 3.0.3, closes #549. 2010-12-03 20:43:51 +02:00
kimchy 992b37b8fb upgrade to tika 0.8 2010-11-28 15:27:54 +02:00
kimchy 577f06fd43 add indices API to groovy client 2010-11-26 22:19:57 +02:00
kimchy 73e5eb9e14 clean compile warnings 2010-11-26 16:03:25 +02:00
kimchy e340388a5d upgrde to amazen aws sdk 1.1.0 2010-11-11 01:44:16 +02:00
kimchy 4c6af6afa5 Cluster health API should return RED status (on applicable levels) when an index has not recovered from the gateway, closes #507. 2010-11-09 21:25:22 +02:00
kimchy cf51fbcdc6 change hdfs location test 2010-11-03 21:19:49 +02:00
kimchy dd9553e7cc add debug and trace logs to couchdb river 2010-11-02 01:07:06 +02:00
kimchy 0ec79e6645 upgrade to aws 1.0.14 2010-10-31 11:35:24 +02:00
kimchy b8708f276d Transport Thrift: Upgrade to thrift 0.5.0, closes #457. 2010-10-27 23:12:53 +02:00
kimchy 2460ee8072 Thrift: Response might get corrupted with extra data, closes #452. 2010-10-26 14:58:57 +02:00
kimchy bad45de7af fix wrong handling of empty param in thrift/memcached transport 2010-10-18 14:47:28 +02:00
kimchy ed9d9aa358 CouchDB River: Allow to define a javascript that can munge the changes stream, closes #431. 2010-10-14 17:57:52 +02:00
kimchy 81fd17b035 CouchDB River: Deletes not handles correctly 2010-10-14 17:38:28 +02:00
kimchy eb44910047 add py as lang 2010-10-14 16:22:12 +02:00
kimchy ae05ce0551 Scripting: Allow to define scripts within `config/scripts`, automatically compiled and can be referenced by name, closes #429. 2010-10-14 16:14:23 +02:00
kimchy 503b023eac remove attempt to get ruby in scripting, problems embedding it... 2010-10-14 14:11:13 +02:00
kimchy 1f4aa5d9d2 handle cases when the body is not set in thrift 2010-10-13 18:35:52 +02:00
kimchy 18d8e9dcdd add more script tests 2010-10-10 20:05:37 +02:00
kimchy a754ebacd4 Python Plugin: Allow to use python for scripts, closes #418. 2010-10-09 20:59:41 +02:00
kimchy 05e413a7f1 handle cases when address is null when discovering 2010-10-09 17:37:52 +02:00
kimchy 8b03b914f9 Twitter River: Support filter stream, closes #416. 2010-10-09 00:39:10 +02:00
kimchy ee2fabb9dd Thrift: Rename Status.CONTINUE to Status.CONT (reserved word), closes #415. 2010-10-08 23:06:30 +02:00
kimchy 6314c2460c Geo Overhaul (work with multiple locations), closes #414. 2010-10-08 22:31:21 +02:00
kimchy 523a8b4c3e rename xonctent mappers to just mappers 2010-10-08 15:05:07 +02:00
kimchy af3599fe47 upgrade to aws sdk 1.0.11 2010-10-08 11:45:27 +02:00
kimchy d0bf743ab4 Query DSL: query_string / field to use the optimized match_all query when using * (or *:*), closes #413. 2010-10-07 16:48:24 +02:00
kimchy 504a5458c5 add trace logging for thrift 2010-10-07 11:53:13 +02:00
kimchy bc4543a5e9 add multi threaded test execution for groovy and javascript 2010-10-06 22:00:27 +02:00
kimchy abf1855509 change logging level 2010-10-05 15:52:18 +02:00
Mahendra M a0d48487c1 Couchdb river plugin - ignore design documents 2010-10-05 15:51:36 +02:00
kimchy c4d17860a1 Wikipedia River: A river to index wikipedia, closes #403. 2010-10-03 22:22:45 +02:00
kimchy 6371ed7d78 build structure for ruby support, problems in figuring out how to execute the ruby scripts in the most optimal manner 2010-10-03 15:52:44 +02:00
kimchy 7180636df6 add close to script services 2010-10-03 14:31:36 +02:00
kimchy 80b8898542 add support for java List usage as javascript Array in scripts 2010-10-03 13:10:33 +02:00
kimchy 5b8bc333bd JavaScript Plugin: Allow to use javascript for scripts, closes #401. 2010-10-03 02:20:37 +02:00
kimchy 5a7c8fe2cb allow script engines to have several types 2010-10-02 21:18:01 +02:00
kimchy 542a85090f add _source script field search 2010-10-02 17:36:26 +02:00
kimchy 7a78374398 fix wrong refactoring... 2010-10-02 01:29:28 +02:00
kimchy 9e8ebd46e8 Groovy Plugin: Allow to run use groovy for scripts (where applicable), closes #398. 2010-10-02 01:22:05 +02:00
kimchy 5c1c580b84 upgrade to groovy 1.7.5 2010-10-01 22:29:08 +02:00
Mahendra M c657c7c6d0 Filter parameters not formed properly in couchdb river plugin, closes #394 2010-10-01 13:56:07 +02:00
kimchy 1af53bce0d Support http auth in couchdb river plugin, closes #390. 2010-09-30 20:58:04 +02:00
kimchy 735ad0d43d CouchDB River: Support couchdb filter query parameters, closes #389. 2010-09-30 20:47:05 +02:00
kimchy 06c7c4a9ac thrift definition `params` is conflict with c#'s keyword, rename to `parameters`, closes #392. 2010-09-30 10:07:02 +02:00
kimchy 1bcecd7bb7 fix rabbitmq params parsing 2010-09-28 17:12:34 +02:00
kimchy f01f5ab323 remove double & in the url, though seems like couchdb does not mind... 2010-09-27 23:04:44 +02:00
kimchy 48bd9a2076 don't try adn connect to couch until we manage to check if there is a last_seq 2010-09-27 15:21:26 +02:00
kimchy efe5b5734c rename client-groovy to lang-groovy 2010-09-26 18:13:45 +02:00
kimchy 3a5938b2d1 better state control, store under couchdb obj 2010-09-23 02:45:32 +02:00
kimchy ecaaeb5250 River CouchDB Plugin, closes #382. 2010-09-23 02:26:12 +02:00
kimchy d0b29fe3ef allow to set exhange and routing_key 2010-09-21 22:19:36 +02:00
kimchy 8cce3d6cce rabbitmq river 2010-09-21 17:41:19 +02:00
kimchy aa68667d63 rabbitmq river 2010-09-21 17:32:34 +02:00
kimchy 4fe7cbccca rename indexer to river 2010-09-21 13:35:09 +02:00
kimchy 2715212868 better handling of creation of index 2010-09-21 01:20:37 +02:00
kimchy 5f574013fd add a twitter indexer 2010-09-20 23:06:59 +02:00
kimchy 94a77b69d6 add a twitter indexer 2010-09-20 18:17:02 +02:00
kimchy ed96d161a6 upgrade to amazon aws jdk 1.0.10 2010-09-20 12:09:17 +02:00
kimchy 38aeba438d XContent refactoring, closes #367. 2010-09-12 23:20:15 +02:00
kimchy 4f08801bb9 Thrift Plugin: Expose REST interface using thrift, closes #354. 2010-09-04 02:45:37 +03:00
kimchy 042af200e8 Gateway: Default to `local` gateway (replace `none` gateway), closes #347. 2010-09-01 23:21:26 +03:00
kimchy 46b58ce77f Memcached transport does not support version, npe when no uri, closes #342. 2010-09-01 15:16:03 +03:00
kimchy 38cae95ebc EC2 Discovery should optionally bind to nodes who are members of all groups, closes #345. 2010-09-01 15:07:26 +03:00
kimchy 163b7be639 refactor gateway service to allow for more custom gateway implemenations 2010-08-28 00:34:15 +03:00
kimchy c85019fb86 upgrade to aws 1.0.008 2010-08-24 03:58:45 +03:00
kimchy 02b74dfb63 Memcach: StreamCorruptedException when loading a cluster, closes #300. 2010-08-23 22:21:35 +03:00
kimchy 8079b5def5 Should escape \r\n in exception message, closes #332. 2010-08-23 22:19:40 +03:00
kimchy 1461da5b49 move prefetch allocation to be a NodeAllocation 2010-08-23 17:22:44 +03:00
kimchy 1517fa3d28 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 01:45:03 +03:00
kimchy 664f28492d improvements to the module system, allow for a module to spawn other modules, and pre process modules before injector creation 2010-08-22 10:42:25 +03:00
kimchy aa28b93610 refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it 2010-08-22 02:47:34 +03:00
kimchy c40935ae14 store the mapping definition in compressed form internally to save memory 2010-08-19 17:06:36 +03:00
kimchy 1ee2f80e68 Transport: add global compression support compressing all internal transport communication (using lzf), closes #321. 2010-08-15 02:57:22 +03:00
kimchy 23b8b81e15 EC2 Discovery ignoring instances with more than one security group, closes #311. 2010-08-10 22:16:13 +03:00
kimchy 8223418b04 better handling of non supported commands / opcodes 2010-08-09 17:52:24 +03:00
kimchy d4547c629f New API, update settings, allowing to change specific runtime settings of the cluster (indices). `number_of_replicas` is the only settings supported, allowing to change the number of repliacs of one or more indices. 2010-08-08 09:17:09 +03:00
kimchy d72de60b6f Add the ability to store the index name in the doc, closes #292. 2010-08-04 11:41:56 +03:00
kimchy 457b56937e small improvements to groovy client, allows for closure in the search request 2010-07-25 10:32:22 +03:00
kimchy 747aa2e30a only close client if it was started 2010-07-25 10:28:27 +03:00
kimchy 77b6d1d8b8 remove cloud plugin, reimplement an AWS specific cloud plugin with S3 gateway and EC2 discovery 2010-07-24 23:39:43 +03:00
kimchy 0072dd816b nicer logging, and use sync streams 2010-07-23 23:10:59 +03:00
kimchy 09bbf11605 fix dep on hamcrest for memcached plugin 2010-07-22 21:13:47 +03:00
kimchy c1ab9f290f remove compile warnings 2010-07-22 00:25:25 +03:00
kimchy 300f38ee3c improve memcached test 2010-07-20 21:12:26 +03:00
kimchy 2eeb4ebd8c improve memcached test 2010-07-20 20:53:00 +03:00
kimchy 5f0470d68b Support Cross-Origin resource in http/rest module, closes #218. 2010-07-19 15:06:13 +03:00
kimchy d657d4447b more shard relocation tests, create a cached executor that can be used to allocate threads that are not affected by the actual thread pool impl (can always fork, no blocking) 2010-07-19 01:45:09 +03:00
kimchy 7d29896190 add more info 2010-07-17 19:10:06 +03:00
kimchy 08ca383fd5 more work on cloud gateway 2010-07-17 15:20:13 +03:00
kimchy 1fccaf06e9 start work on reimplementing cloud gateway 2010-07-17 13:12:53 +03:00
kimchy 52ac24fa23 more debug statr on recovery from gateway 2010-07-11 21:51:45 +03:00
kimchy e7a8da8236 do flush within the finalization of index shard recovery 2010-07-11 21:20:36 +03:00
kimchy 84af9f5681 improve handling of translog snapshotting 2010-07-08 20:51:37 +03:00
kimchy d4f86899e3 more work on reuse work dir, improved transaction log to move to stream based 2010-07-06 00:12:40 +03:00
kimchy b078c9206a more work on reuse work dir, added md5 logic to identify what need to be recovered or not, note, requires reindexing 2010-07-05 14:13:55 +03:00
kimchy d848ab3df3 rename executors to esexecutors 2010-07-01 00:06:34 +03:00
kimchy 66096e97f2 Remove the terms API (replaced by facets in search), closes #242. 2010-06-30 19:49:41 +03:00
kimchy 04ad93e8d6 update project run target to add hadoop plugin as well 2010-06-29 21:42:47 +03:00
kimchy 3f6cd46736 allow to configure tcp network modules (transport, memcached and http) to use blocking io (just enabling it to do some performance tests) 2010-06-29 21:07:38 +03:00
kimchy 703657699a refactor new thread pools in, remove dynamic ones 2010-06-29 18:20:31 +03:00
kimchy 3770924300 allow to control the buffer size of the gateway blob container 2010-06-27 23:26:32 +03:00
kimchy edf0075025 more work on reusing work node level data, now when recovering from peers 2010-06-24 15:34:02 +03:00
kimchy 57169d4233 initial work on reusing work node level data when recovering from gateway 2010-06-24 00:32:05 +03:00
kimchy 3d84af2a40 refactor hdfs gateway to use the new common blobstore 2010-06-22 09:10:00 +03:00
kimchy 96d08cc641 remove the jgroups plugin 2010-06-21 22:51:54 +03:00
kimchy 7ed7c6db4e Gateway: Internal refactoring, requires manual upgrade when using fs gateway, closes #232. 2010-06-21 22:40:12 +03:00
kimchy 41e570d89d add prepare methods to the rest of the groovy APIs 2010-06-20 09:31:22 +03:00
kimchy abde45bb82 refactor util.xcontent to common.xcontent in groovy cliet 2010-06-20 08:53:45 +03:00
kimchy 0f2147aeec add some prepare APIs to the groovy APIs 2010-06-19 21:09:03 +03:00
kimchy a18e58b394 move size value/unit to bytes size value/unit, and create a ten based size value/unit 2010-06-15 18:16:10 +03:00
kimchy f75abbaa00 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:59:04 +03:00
kimchy d5bd77cc38 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:28:05 +03:00
kimchy 636bfe8466 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 16:51:38 +03:00
kimchy 48979ab6c8 improve gateway recovery when using delay index creation, close the loophole when the master was shut down before the delay expired and now other node becoming master will do the recovery 2010-06-15 10:27:26 +03:00
kimchy 66c9f2f834 Search Facets: Field Facets, closes #207 2010-06-04 02:31:49 +03:00
kimchy ec662cc019 always start the unicast ping discovery, so unicast discovery will work even when using multicast 2010-05-31 22:24:51 +03:00
kimchy 1749775414 update build files to reference hamcrest as well 2010-05-30 23:26:17 +03:00
kimchy ef9e6d369c memcahced should use its own openchannels handler 2010-05-27 18:51:11 +03:00
kimchy 7e5bfb5d3b share the open channels handler 2010-05-27 18:25:59 +03:00
kimchy ad5a4dde83 upgrade to jclouds 1-beta6 2010-05-27 02:28:31 +03:00
kimchy b7d11f1303 Gateway Storage: Improve it to support non breaking changes in the future, closes #191. 2010-05-24 18:27:48 +03:00
kimchy 2cdb7bc05a change jclouds to use cached thread pool 2010-05-24 10:24:16 +03:00
kimchy 28fa384b32 Hadoop Plugin: Use HDFS as gateway storage, closes #189. 2010-05-23 17:02:06 +03:00
kimchy 116cfce6f2 FS Gateway: Change indices location (Requires manual upgrade), closes #188. 2010-05-23 08:37:41 +03:00
kimchy 32829aeba5 change index directory in the cloud to be under "indices" 2010-05-23 08:18:49 +03:00
kimchy 5c6864e8b3 inital work on hadoop plugin - gateway hdfs support 2010-05-23 08:17:52 +03:00
kimchy ecc74f225e Cloud Plugin: Cloud gateway default chunk size change to 1g, closes #186. 2010-05-22 01:08:43 +03:00
kimchy a8a4bbc30e internal optimization - share built in analyzers on the node level and not on index level 2010-05-20 00:55:31 +03:00
kimchy 40fdcc43b7 update all to use LUCENE MONITOR 2010-05-19 03:55:07 +03:00
kimchy 2881d5851d remote use of deprecated methods 2010-05-19 03:35:24 +03:00
kimchy c7075c1600 Cloud Plugin: Gateway should store meta data and indices under the same container, closes #180. 2010-05-18 23:38:56 +03:00
kimchy 216dda3f9c Throttling of recovery (both gateway recovery and peer node recovery), closes #176. 2010-05-16 23:37:56 +03:00
kimchy 013e7699c3 Index Request wrongly stores extra bytes as part of the document (trailing null bytes), closes #175. 2010-05-16 17:56:52 +03:00
kimchy b816ed5cf2 add thread pool stats and info to nodes stats / info api 2010-05-15 18:10:24 +03:00
kimchy 723e47a54b Consolidate network settings, common tcp settings, and generalized port settings, closes #174. 2010-05-15 16:30:02 +03:00
kimchy c59945eec2 remove the need for global defined grooby library, use the one gradle downloaded 2010-05-15 02:26:44 +03:00
kimchy 5db5b9f4b2 better logging 2010-05-13 22:51:21 +03:00
kimchy 529edd6b38 better trace logging of nodes processed 2010-05-13 22:45:32 +03:00
kimchy 6f74e9fc04 moreve non ascii chars 2010-05-13 21:37:58 +03:00
kimchy 6cd3fc92ed reduce bytes allocation when doing http 2010-05-13 20:42:59 +03:00
kimchy e87a4117b6 expose settings builder in the node builder API 2010-05-13 15:17:49 +03:00
kimchy f6777f1e03 jarjar netty as well, so it won't be exposed to users using elasticsearch embedded 2010-05-13 14:41:50 +03:00
kimchy 7edb3f8d54 nicer code 2010-05-12 16:48:22 +03:00
kimchy a0b25ec4c3 abstract non blocking hashset 2010-05-12 04:06:44 +03:00
kimchy f6509930c7 upgrade to netty 3.2.0 CR1 2010-05-12 04:03:20 +03:00
kimchy 9c042a2b25 allow to set settings on the groovy client 2010-05-11 18:05:11 +03:00
kimchy c759eb34a8 chen the default delegation for the builder to be delegate first so it can be used easily in scripts. 2010-05-11 18:00:44 +03:00
kimchy 040030dac8 reafctor inject to util from util.guice 2010-05-10 01:34:22 +03:00
kimchy 3e405c3ec7 Nodes Stats API, closes #165, 2010-05-09 09:59:43 +03:00
kimchy 473b46f5ef fix NPE since we need to provide the nodes provider 2010-05-08 02:44:06 +03:00
kimchy 66f011ae76 allow to filter out settings from REST serivces 2010-05-06 09:06:32 +03:00
kimchy 596cfd273d move to beta-5 of jclouds 2010-05-05 15:22:15 +03:00
kimchy 8053237643 move from gcommon package 2010-05-04 16:02:26 +03:00
kimchy f88e01614a update with more cloud providers 2010-05-04 15:57:13 +03:00
kimchy 7d9f55309e cloud gateway implemenation working against s3 2010-05-04 14:02:36 +03:00
kimchy 3ba4370477 verify that parsing works for dates with slash 2010-05-03 16:51:15 +03:00
kimchy 5d743383c7 expose content type in client 2010-05-03 16:00:14 +03:00
kimchy 2d20ba0b42 make resolving of "logical" (#...#) hosts pluggable (so we can later support something like #cloud:privateip# 2010-05-03 00:50:44 +03:00
kimchy bac0ef98c4 more refactoring and proper exception when using cloud plugin 2010-05-02 23:33:57 +03:00
kimchy b81e3de85e start work on cloud gateway 2010-05-02 21:58:14 +03:00
kimchy fc30467b72 add jclouds logger 2010-05-02 17:23:59 +03:00
kimchy 02bfa9c4cb rename hell 2010-05-02 16:44:47 +03:00
kimchy 1119bffc5a rename hell 2010-05-02 16:40:51 +03:00
kimchy 95becccece more work on cloud 2010-05-02 16:36:51 +03:00
kimchy 4c53422428 more work on cloud 2010-05-02 16:36:05 +03:00
kimchy 1323fe8b5e minor restructering of plugins, create the cloud plugin 2010-05-02 01:28:28 +03:00
kimchy e81d559f5f update memcached name to be transport-memcached 2010-05-01 16:34:32 +03:00
kimchy ebded19dc1 Restart API: Allow to restart one or more nodes, closes #155. 2010-05-01 03:00:06 +03:00
kimchy 34d99c39a5 XContent - An abstraction on top of content (JSON inspired), closes #152. 2010-04-29 23:10:47 +03:00
kimchy f8f65c991a finalize abstracting json into xcontent 2010-04-29 02:11:53 +03:00
kimchy 37dfc443aa continue abstracting json into xcontent 2010-04-29 00:05:55 +03:00
kimchy cdc33e18f3 start abstaction of xconten over json 2010-04-28 21:29:30 +03:00
kimchy c48851f49c start abstaction of json 2010-04-28 11:20:41 +03:00
kimchy 11e4ad9bd6 Analysis ICU Plugin, closes #151 2010-04-27 23:54:30 +03:00
kimchy 2a19160ad6 internalize guice (no need to aop) and reduce deps 2010-04-26 02:10:42 +03:00
kimchy e56321b414 add google collections to elasticsearch as source and remove binary dep 2010-04-26 01:02:31 +03:00
kimchy d177c78d4f add junit to test compile in groovy plugin so it will compile (strange...) 2010-04-26 00:10:22 +03:00
kimchy 9b4d64011a update files 2010-04-25 23:42:44 +03:00
kimchy c7e4ec6369 update project files, remove sources from jar files 2010-04-25 23:40:58 +03:00
kimchy 10f0eaad68 refactor plugins into sub groups 2010-04-25 23:01:00 +03:00
kimchy b09f6c7b6b move client-groovy to an updated location 2010-04-25 22:20:18 +03:00
kimchy 6975f5d15a move zen discovery to be the default discovery, and move jgroups to a plugin 2010-04-25 21:52:28 +03:00
kimchy cb0d7d4735 inital support for zen discovery module (multicast discovery implemented) 2010-04-24 23:48:45 +03:00
kimchy 609af0da60 update test resources build file 2010-04-21 01:17:19 +03:00
kimchy bda476eee8 Remove dependency on slf4j for logging, create own internal abstraction, closes #146. 2010-04-21 00:29:42 +03:00
kimchy 9a35ddcb61 add memcached.enabled setting allowing to disable memcached even if its added as a plugin (by default, it is enabled) 2010-04-18 00:16:45 +03:00
kimchy d997389444 add annotation documentation for memcached handlers 2010-04-17 22:09:16 +03:00
kimchy f46c643c63 add Map as a parameter where Json can be passed 2010-04-17 20:10:15 +03:00
kimchy 9c1f2fdec5 allow to change resolve strategy on jsonbuilder 2010-04-17 19:05:30 +03:00
kimchy b49a1c441c node.client setting should automatically affect node.data (if not set), fix (for now) for the JsonBuilder to resolve first to the delegate (is that right?) 2010-04-17 16:39:00 +03:00
kimchy 3e430c2ca9 memcached: add binary protocol support 2010-04-17 13:31:45 +03:00
kimchy 51aac0cdf7 memcached initial work 2010-04-16 22:01:16 +03:00
kimchy 02cb297691 more groovy client work 2010-04-15 17:45:26 +03:00
kimchy ad9549462e more groovy work 2010-04-15 06:45:46 +03:00
kimchy 0da66ba367 groovy plugin - add search API 2010-04-14 19:10:29 +03:00
kimchy 96a185e107 more work on the groovy client - count/terms api 2010-04-14 13:57:40 +03:00
kimchy 7e041c43e0 more work on the groovy client 2010-04-14 12:17:52 +03:00
kimchy cb7e92b0f8 start work on the groovy plugin 2010-04-14 08:34:47 +03:00
kimchy f10a2d428d move to 0.7.0 2010-04-09 18:19:37 +03:00
kimchy 2fd36fdbf8 add local node to node builder 2010-04-09 03:17:29 +03:00
kimchy a9cd00e287 rename Server to Node to better reflect its usage (it can be a client node), also add on the NodeBuilder helper methods to set common settings 2010-04-09 00:54:54 +03:00
kimchy b760ab18b6 update maven upload to also produce javadoc and source jars 2010-04-06 11:44:41 +03:00
kimchy 11e8141069 upgrade to tika 0.7 2010-04-06 02:20:47 +03:00
kimchy 3f8acbd994 Mapper: Rename pathType to path, closes #106. 2010-04-04 12:02:34 +03:00
kimchy 58d2e2e1fc update maven support 2010-04-02 21:24:28 +03:00
kimchy 7c904dcd0e better pom generation 2010-04-02 19:08:33 +03:00
kimchy 6ed23744fc upgrade to gradle 0.9 preview 1 2010-04-02 15:47:27 +03:00
kimchy 05d85b2ae4 add source files to dist jar files 2010-04-01 23:06:11 +03:00
kimchy 8faf8c2169 add source files to dist jar files 2010-04-01 23:05:05 +03:00
kimchy 336a272c6f fix build 2010-03-29 12:45:13 +03:00
kimchy 3decb2a61e nice(er) code 2010-03-29 11:27:38 +03:00
kimchy 651cd78456 add control over the base64 variant 2010-03-29 00:39:13 +03:00
kimchy 913a486f99 more work on attachments, have basic types support external set values 2010-03-29 00:19:33 +03:00
kimchy b799b7a9d7 plugins support + start work on attachments plugin 2010-03-27 23:43:59 +03:00