Commit Graph

378 Commits

Author SHA1 Message Date
kimchy abfc7f0db4 internal refactoring simplifying the type mapping system 2011-06-04 03:56:01 +03:00
kimchy 0a4e582404 Query Parser Module Refactor, closes #994. 2011-06-03 04:32:30 +03:00
kimchy a9112b4698 Thrift: Upgrade to thrift 0.6.1, closes #986. 2011-06-01 04:46:19 +03:00
kimchy 8267a76747 force the type to be set when using the put mapping API in Java 2011-05-31 16:21:59 +03:00
kimchy 68a56a0b58 optimize generation of rest responses and reduce copying bytes around 2011-05-24 14:12:17 +03:00
kimchy 6805d17fc9 upgrade to aws sdk 1.2.0 2011-05-21 02:08:39 +03:00
kimchy 7379258f2e use different settings for aws proxy port / host 2011-05-03 16:43:52 +03:00
Adam Creeger 8eb6e91eac Adding support for accessing EC2 and S3 over an http proxy. This is configured using the network.proxyHost and network.proxyPort settings. 2011-05-03 16:41:16 +03:00
kimchy 413cbf1713 Upgrade to groovy 1.8.0 2011-04-29 01:06:26 +03:00
kimchy 166493f9d5 properly clean mapper data, and cache some mapping structures 2011-04-17 09:52:29 +03:00
kimchy 85aeaaedd0 update to aws sdk 1.1.9 2011-04-15 01:56:27 +03:00
kimchy 3b72d63035 EC2 Zen Discovery: Automatically use the configured transport port to ping other nodes, closes #854. 2011-04-14 02:13:27 +03:00
kimchy 6061656170 upgrade to groovy 1.7.10 2011-04-06 16:31:25 +03:00
kimchy 5d6e84f206 Upgrade Lucene 3.1: Analyzers, closes #826. 2011-04-04 14:36:13 +03:00
kimchy 4e4495ff1d Upgrade to Lucene 3.1, closes #825. 2011-04-04 12:54:15 +03:00
kimchy 367c9562c6 update to rabbitmq client 2.3.1 2011-03-15 10:08:08 +02:00
kimchy c7b36f113d fix oauth support to also use it when reconnecting, and have the config as part of an oauth element 2011-03-09 10:12:12 +02:00
unknown d4e89faf6b added oauth support 2011-03-09 09:47:39 +02:00
kimchy 016e5bce04 Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758. 2011-03-08 21:53:33 +02:00
kimchy 4bdae621f9 Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752. 2011-03-07 13:09:07 +02:00
kimchy 578b752425 Twitter River: Automatically reconnect when disconnected from twitter stream, closes #735. 2011-03-02 04:00:12 +02:00
kimchy 3bac33e69e don't use AfterTest / BeforeTest in any tests 2011-02-28 22:28:55 +02:00
kimchy 24e95ea7e4 upgrade to aws sdk 1.1.7 2011-02-25 21:33:50 +02:00
kimchy bcaeb226d5 Twitter river: "user.screen_name" should not be analyzed, closes #715. 2011-02-23 19:55:48 +02:00
kimchy 45ec2c6e21 Allow to register custom rivers under a custom type name (And not full class names), closes #712. 2011-02-22 22:13:31 +02:00
kimchy a4978bc67e Support for other exchange types and options in AMQP river, closes #709. 2011-02-22 20:06:43 +02:00
Charles Duffy d0780f0f62 Allow exchange type and durability, queue durability and queue auto-delete to be specified; closes #696 2011-02-22 20:02:25 +02:00
kimchy 1bffe432a0 fix loading bytes to parse in mapper attachment test 2011-02-20 01:49:37 +02:00
Alberto Paro b5068baf63 Updated tika to 0.9 2011-02-20 00:47:29 +02:00
kimchy 5e2ca6fb5d support servlet path as well 2011-02-18 05:12:26 +02:00
kimchy 8d867dc24c explicitly set the cat under which jdk logging is logged 2011-02-18 05:00:08 +02:00
kimchy dab23a4d51 fix thrift test to take into account that index can return CREATED status code now 2011-02-18 00:24:50 +02:00
kimchy d1d3f8c4ca REST codes: Improve returned error codes on REST APIs, associate codes with internal exceptions, closes #690. 2011-02-16 01:41:01 +02:00
kimchy d054c8c14e use cached thread pool to do cluster state gateway snapshotting 2011-02-11 03:14:13 +02:00
kimchy 57108c8575 REST API: Failure to index docs that have their ids URL encoded and contain `/`, closes #681. 2011-02-10 03:18:01 +02:00
kimchy 5a75964fc3 upgrade to groovy 1.7.7 2011-02-09 22:30:55 +02:00
kimchy 05283c7f6d NPE during ES startup when using S3 gateway with the europe region specified, closes #659. 2011-02-08 11:31:33 +02:00
kimchy 0dfa3dc8a2 Groovy client doesn't bind to any variables outside the closure, closes #654. 2011-02-01 14:16:27 +02:00
kimchy 8927e1dee4 Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663. 2011-02-01 13:41:58 +02:00
kimchy cebdae5707 refactor script execution handling to improve performance, also introduce specific search script executor 2011-01-31 16:08:06 +02:00
kimchy 94c632b79b Java Client - Allow to set facets in binary format, closes #442. 2011-01-30 15:53:10 +02:00
kimchy 3f8933fb7b add filter setting with clojure in groovy 2011-01-28 11:28:41 +02:00
kimchy 87d5a92edb move handling of recovered metadata to GatewayService, reducing code duplication in different gateway implementations 2011-01-18 14:38:10 +02:00
kimchy 4750ccdc1c move nullable annotation to the common package, and move javax inject (from guice 3) to internal common as well 2011-01-17 19:45:37 +02:00
kimchy 64e5784623 Twitter updates have broken Twitter River, Update to latest version of Twitter4J, closes #627. 2011-01-14 20:48:09 +02:00
kimchy a0a714e6a5 Shared Gateway: Allow to set the number of concurrent streams doing snapshot operations, closes #621. 2011-01-11 22:03:44 +02:00
kimchy 50cdf2920f Make ToXContent return a builder 2011-01-10 22:11:12 +02:00
kimchy a450deee5f Groovy Plugin not loaded (groovy not enabled as pluggable script provider), closes #581. 2010-12-30 16:21:08 +02:00
kimchy 8e8a3a894f upgrade testing framework jars, improve build scripts to share the testing jars 2010-12-30 16:08:38 +02:00
kimchy 976d14705a add a warn and don't apply ec2 unicast discovery if not found (will not really happen) 2010-12-30 13:18:00 +02:00
kimchy abe33d59a5 use Closeables 2010-12-30 12:29:54 +02:00
kimchy f4a30fdc84 better stream close handling in couchdb river 2010-12-30 12:25:50 +02:00
kimchy ec2f0e05f9 upgrade to jython 2.5.2rc2 2010-12-27 10:23:01 +02:00
kimchy a00f99e7c6 upgrade to groovy 1.7.6 2010-12-27 08:21:25 +02:00
kimchy 27fe076175 upgrade to rabbitmq client 2.2.0 2010-12-26 12:50:52 +02:00
kimchy 9361e3bd2b Cloud AWS: Change endpoint parameters to distinguish between ec2 and s3, closes #574. 2010-12-23 09:13:44 +02:00
kimchy 698f67a31a EC2 Discover: Support filtering instances by tags, closes #551. 2010-12-16 05:14:49 +02:00
kimchy ff0eeb3d1a improve getting setting as array, automatically support comma delimited values under the exact setting 2010-12-16 05:02:24 +02:00
kimchy 085066ed19 set, by default, the send and receive buffers to 32k on tcp 2010-12-15 05:54:09 +02:00
kimchy b6277ac14d increase netty worker count to default to the updated value netty defaults to 2010-12-15 01:16:00 +02:00
kimchy f25eebb249 update to not use deprecated method 2010-12-08 00:16:20 +02:00
kimchy aa00fe6a83 upgrade twitter4j to 2.1.7 2010-12-05 06:39:22 +02:00
kimchy f048353046 upgrade to aws java sdk 1.1.1 2010-12-04 21:19:36 +02:00
kimchy a90684aaa5 Upgrade to Lucene 3.0.3, closes #549. 2010-12-03 20:43:51 +02:00
kimchy 992b37b8fb upgrade to tika 0.8 2010-11-28 15:27:54 +02:00
kimchy 577f06fd43 add indices API to groovy client 2010-11-26 22:19:57 +02:00
kimchy 73e5eb9e14 clean compile warnings 2010-11-26 16:03:25 +02:00
kimchy e340388a5d upgrde to amazen aws sdk 1.1.0 2010-11-11 01:44:16 +02:00
kimchy 4c6af6afa5 Cluster health API should return RED status (on applicable levels) when an index has not recovered from the gateway, closes #507. 2010-11-09 21:25:22 +02:00
kimchy cf51fbcdc6 change hdfs location test 2010-11-03 21:19:49 +02:00
kimchy dd9553e7cc add debug and trace logs to couchdb river 2010-11-02 01:07:06 +02:00
kimchy 0ec79e6645 upgrade to aws 1.0.14 2010-10-31 11:35:24 +02:00
kimchy b8708f276d Transport Thrift: Upgrade to thrift 0.5.0, closes #457. 2010-10-27 23:12:53 +02:00
kimchy 2460ee8072 Thrift: Response might get corrupted with extra data, closes #452. 2010-10-26 14:58:57 +02:00
kimchy bad45de7af fix wrong handling of empty param in thrift/memcached transport 2010-10-18 14:47:28 +02:00
kimchy ed9d9aa358 CouchDB River: Allow to define a javascript that can munge the changes stream, closes #431. 2010-10-14 17:57:52 +02:00
kimchy 81fd17b035 CouchDB River: Deletes not handles correctly 2010-10-14 17:38:28 +02:00
kimchy eb44910047 add py as lang 2010-10-14 16:22:12 +02:00
kimchy ae05ce0551 Scripting: Allow to define scripts within `config/scripts`, automatically compiled and can be referenced by name, closes #429. 2010-10-14 16:14:23 +02:00
kimchy 503b023eac remove attempt to get ruby in scripting, problems embedding it... 2010-10-14 14:11:13 +02:00
kimchy 1f4aa5d9d2 handle cases when the body is not set in thrift 2010-10-13 18:35:52 +02:00
kimchy 18d8e9dcdd add more script tests 2010-10-10 20:05:37 +02:00
kimchy a754ebacd4 Python Plugin: Allow to use python for scripts, closes #418. 2010-10-09 20:59:41 +02:00
kimchy 05e413a7f1 handle cases when address is null when discovering 2010-10-09 17:37:52 +02:00
kimchy 8b03b914f9 Twitter River: Support filter stream, closes #416. 2010-10-09 00:39:10 +02:00
kimchy ee2fabb9dd Thrift: Rename Status.CONTINUE to Status.CONT (reserved word), closes #415. 2010-10-08 23:06:30 +02:00
kimchy 6314c2460c Geo Overhaul (work with multiple locations), closes #414. 2010-10-08 22:31:21 +02:00
kimchy 523a8b4c3e rename xonctent mappers to just mappers 2010-10-08 15:05:07 +02:00
kimchy af3599fe47 upgrade to aws sdk 1.0.11 2010-10-08 11:45:27 +02:00
kimchy d0bf743ab4 Query DSL: query_string / field to use the optimized match_all query when using * (or *:*), closes #413. 2010-10-07 16:48:24 +02:00
kimchy 504a5458c5 add trace logging for thrift 2010-10-07 11:53:13 +02:00
kimchy bc4543a5e9 add multi threaded test execution for groovy and javascript 2010-10-06 22:00:27 +02:00
kimchy abf1855509 change logging level 2010-10-05 15:52:18 +02:00
Mahendra M a0d48487c1 Couchdb river plugin - ignore design documents 2010-10-05 15:51:36 +02:00
kimchy c4d17860a1 Wikipedia River: A river to index wikipedia, closes #403. 2010-10-03 22:22:45 +02:00
kimchy 6371ed7d78 build structure for ruby support, problems in figuring out how to execute the ruby scripts in the most optimal manner 2010-10-03 15:52:44 +02:00
kimchy 7180636df6 add close to script services 2010-10-03 14:31:36 +02:00
kimchy 80b8898542 add support for java List usage as javascript Array in scripts 2010-10-03 13:10:33 +02:00
kimchy 5b8bc333bd JavaScript Plugin: Allow to use javascript for scripts, closes #401. 2010-10-03 02:20:37 +02:00
kimchy 5a7c8fe2cb allow script engines to have several types 2010-10-02 21:18:01 +02:00
kimchy 542a85090f add _source script field search 2010-10-02 17:36:26 +02:00
kimchy 7a78374398 fix wrong refactoring... 2010-10-02 01:29:28 +02:00
kimchy 9e8ebd46e8 Groovy Plugin: Allow to run use groovy for scripts (where applicable), closes #398. 2010-10-02 01:22:05 +02:00
kimchy 5c1c580b84 upgrade to groovy 1.7.5 2010-10-01 22:29:08 +02:00
Mahendra M c657c7c6d0 Filter parameters not formed properly in couchdb river plugin, closes #394 2010-10-01 13:56:07 +02:00
kimchy 1af53bce0d Support http auth in couchdb river plugin, closes #390. 2010-09-30 20:58:04 +02:00
kimchy 735ad0d43d CouchDB River: Support couchdb filter query parameters, closes #389. 2010-09-30 20:47:05 +02:00
kimchy 06c7c4a9ac thrift definition `params` is conflict with c#'s keyword, rename to `parameters`, closes #392. 2010-09-30 10:07:02 +02:00
kimchy 1bcecd7bb7 fix rabbitmq params parsing 2010-09-28 17:12:34 +02:00
kimchy f01f5ab323 remove double & in the url, though seems like couchdb does not mind... 2010-09-27 23:04:44 +02:00
kimchy 48bd9a2076 don't try adn connect to couch until we manage to check if there is a last_seq 2010-09-27 15:21:26 +02:00
kimchy efe5b5734c rename client-groovy to lang-groovy 2010-09-26 18:13:45 +02:00
kimchy 3a5938b2d1 better state control, store under couchdb obj 2010-09-23 02:45:32 +02:00
kimchy ecaaeb5250 River CouchDB Plugin, closes #382. 2010-09-23 02:26:12 +02:00
kimchy d0b29fe3ef allow to set exhange and routing_key 2010-09-21 22:19:36 +02:00
kimchy 8cce3d6cce rabbitmq river 2010-09-21 17:41:19 +02:00
kimchy aa68667d63 rabbitmq river 2010-09-21 17:32:34 +02:00
kimchy 4fe7cbccca rename indexer to river 2010-09-21 13:35:09 +02:00
kimchy 2715212868 better handling of creation of index 2010-09-21 01:20:37 +02:00
kimchy 5f574013fd add a twitter indexer 2010-09-20 23:06:59 +02:00
kimchy 94a77b69d6 add a twitter indexer 2010-09-20 18:17:02 +02:00
kimchy ed96d161a6 upgrade to amazon aws jdk 1.0.10 2010-09-20 12:09:17 +02:00
kimchy 38aeba438d XContent refactoring, closes #367. 2010-09-12 23:20:15 +02:00
kimchy 4f08801bb9 Thrift Plugin: Expose REST interface using thrift, closes #354. 2010-09-04 02:45:37 +03:00
kimchy 042af200e8 Gateway: Default to `local` gateway (replace `none` gateway), closes #347. 2010-09-01 23:21:26 +03:00
kimchy 46b58ce77f Memcached transport does not support version, npe when no uri, closes #342. 2010-09-01 15:16:03 +03:00
kimchy 38cae95ebc EC2 Discovery should optionally bind to nodes who are members of all groups, closes #345. 2010-09-01 15:07:26 +03:00
kimchy 163b7be639 refactor gateway service to allow for more custom gateway implemenations 2010-08-28 00:34:15 +03:00
kimchy c85019fb86 upgrade to aws 1.0.008 2010-08-24 03:58:45 +03:00
kimchy 02b74dfb63 Memcach: StreamCorruptedException when loading a cluster, closes #300. 2010-08-23 22:21:35 +03:00
kimchy 8079b5def5 Should escape \r\n in exception message, closes #332. 2010-08-23 22:19:40 +03:00
kimchy 1461da5b49 move prefetch allocation to be a NodeAllocation 2010-08-23 17:22:44 +03:00
kimchy 1517fa3d28 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 01:45:03 +03:00
kimchy 664f28492d improvements to the module system, allow for a module to spawn other modules, and pre process modules before injector creation 2010-08-22 10:42:25 +03:00
kimchy aa28b93610 refactor how throttling is done, instead of doing it after a shard is allocated to a node, and then wait till its allowed to recover, do it on the allocation level, and don't allocate a shard to a node that has N number of recoveries going on it 2010-08-22 02:47:34 +03:00
kimchy c40935ae14 store the mapping definition in compressed form internally to save memory 2010-08-19 17:06:36 +03:00
kimchy 1ee2f80e68 Transport: add global compression support compressing all internal transport communication (using lzf), closes #321. 2010-08-15 02:57:22 +03:00
kimchy 23b8b81e15 EC2 Discovery ignoring instances with more than one security group, closes #311. 2010-08-10 22:16:13 +03:00
kimchy 8223418b04 better handling of non supported commands / opcodes 2010-08-09 17:52:24 +03:00
kimchy d4547c629f New API, update settings, allowing to change specific runtime settings of the cluster (indices). `number_of_replicas` is the only settings supported, allowing to change the number of repliacs of one or more indices. 2010-08-08 09:17:09 +03:00
kimchy d72de60b6f Add the ability to store the index name in the doc, closes #292. 2010-08-04 11:41:56 +03:00
kimchy 457b56937e small improvements to groovy client, allows for closure in the search request 2010-07-25 10:32:22 +03:00
kimchy 747aa2e30a only close client if it was started 2010-07-25 10:28:27 +03:00
kimchy 77b6d1d8b8 remove cloud plugin, reimplement an AWS specific cloud plugin with S3 gateway and EC2 discovery 2010-07-24 23:39:43 +03:00
kimchy 0072dd816b nicer logging, and use sync streams 2010-07-23 23:10:59 +03:00
kimchy 09bbf11605 fix dep on hamcrest for memcached plugin 2010-07-22 21:13:47 +03:00
kimchy c1ab9f290f remove compile warnings 2010-07-22 00:25:25 +03:00
kimchy 300f38ee3c improve memcached test 2010-07-20 21:12:26 +03:00
kimchy 2eeb4ebd8c improve memcached test 2010-07-20 20:53:00 +03:00
kimchy 5f0470d68b Support Cross-Origin resource in http/rest module, closes #218. 2010-07-19 15:06:13 +03:00