Commit Graph

312 Commits

Author SHA1 Message Date
kimchy eccc7d5ef2 Search API: Allow to name filters and return per hit the filters it matched on, closes #364. 2010-09-11 12:38:19 +03:00
kimchy 4e661c165a Geo search across anti-meridian doesn't work, closes #363. 2010-09-10 16:04:10 +03:00
kimchy f270fc00d2 earch API: Automatically identify "script" fields on the field elements in search, close #357. 2010-09-06 11:51:31 +03:00
kimchy b40f0bc5a4 Local Gateway: Expose `gateway.local.initial_shards` to control when to recover and index, closes #352. 2010-09-03 18:38:24 +03:00
kimchy cd28afe950 Search API: Allow for script fields to extract parts of the stored _`source`, closes #349. 2010-09-02 21:29:41 +03:00
kimchy 0250896a09 reduce shard search response size by not serilaizing the node id, index, and shard id 2010-09-02 11:19:25 +03:00
kimchy 042af200e8 Gateway: Default to `local` gateway (replace `none` gateway), closes #347. 2010-09-01 23:21:26 +03:00
kimchy ba5cd19989 gateway test to make sure it recovers from the latest version 2010-08-31 21:13:42 +03:00
kimchy 289cfdf25a improve replica allocation, fix test to wait for recovery on node2 2010-08-30 23:37:09 +03:00
kimchy 61764c5b69 add another test for local gateway, fix race when loading the current state of a node 2010-08-30 19:29:00 +03:00
kimchy d9979f8dfe more work on local gateway, start integration test it 2010-08-30 01:25:45 +03:00
kimchy 5b5d42445d move the shared fs gateway base class to fs package 2010-08-29 23:22:55 +03:00
kimchy 19ddee5ec9 add a test for time interval 2010-08-26 18:12:51 +03:00
kimchy b52d854711 smarter handling of throttling when preferring allocating to an existing work location 2010-08-23 21:39:54 +03:00
kimchy 1461da5b49 move prefetch allocation to be a NodeAllocation 2010-08-23 17:22:44 +03:00
kimchy edbd586ee5 add load test for recovery from gateway 2010-08-23 16:33:33 +03:00
kimchy 5bd37f6f47 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 14:48:49 +03:00
kimchy 1517fa3d28 initial chunk of work on refactoring the gateway, syntatic gateway files names, commit points that include translog information 2010-08-23 01:45:03 +03:00
kimchy 14237317fc support compression of the source field 2010-08-15 17:57:14 +03:00
kimchy 01b3d42cee separet recovery tests to one with small buffer size and on with bigger one 2010-08-14 13:44:42 +03:00
kimchy d12c757824 Gateway: Chunk based storage broken, fails to recover from gateway, closes #318. 2010-08-13 14:03:52 +03:00
kimchy e29925684a Term Facets: Add `reverse_cout` and `reverse_term` to `order` options, closes #314. 2010-08-12 15:26:26 +03:00
kimchy c0a7dc327c range facet: from is used in to_str, should be to 2010-08-11 23:40:42 +03:00
kimchy 9f8e5cb2c0 add a simple integration level test for scroll 2010-08-10 20:48:05 +03:00
kimchy f2018e2f86 Facets: Automatically filter by type for facets that use explicit field names that are prefixed by the type, closes #310. 2010-08-10 17:03:14 +03:00
kimchy 05d07b036a remove ning async http client, no need for it 2010-08-10 00:00:24 +03:00
kimchy ff8d743337 add geo distance sort option, refactor java level sort API to have sort builders (similar to facets) 2010-08-08 21:46:11 +03:00
kimchy 37af7f5aef add sort values as part of the response per search hit 2010-08-08 18:21:17 +03:00
kimchy 7cb2010dda add script support for terms facets, allowing to control if a certain term will be included in the facets result (boolean result), or muging of the term 2010-08-08 10:37:14 +03:00
kimchy ee1d50f8d8 add script support for terms facets, allowing to control if a certain term will be included in the facets result (boolean result), or muging of the term 2010-08-08 10:27:06 +03:00
kimchy 566ae94478 add the ability to control the "order" by of terms facet, can either be `term` or `count`. defaults to `count`. 2010-08-08 09:31:40 +03:00
kimchy d4547c629f New API, update settings, allowing to change specific runtime settings of the cluster (indices). `number_of_replicas` is the only settings supported, allowing to change the number of repliacs of one or more indices. 2010-08-08 09:17:09 +03:00
kimchy 8c5fdf4aee Ability to return all stored fields with a *, closes #296. 2010-08-04 13:22:55 +03:00
kimchy 91c256361e support for custom script based sorting 2010-08-03 18:14:02 +03:00
kimchy de8ffaf5fb Geo: bounding box filter, closes #290. 2010-08-03 01:51:46 +03:00
kimchy dc6ef326d9 Facets: Filter based facet, closes #289. 2010-08-02 19:17:57 +03:00
kimchy 76cfbe6a44 support dates in range facet 2010-08-02 10:35:21 +03:00
kimchy ef861a6b7b Search Facets: Range Facet, closes #287. 2010-08-01 20:08:27 +03:00
kimchy b8b21a3363 Geo: `geo_distance` facet, closes #286. 2010-08-01 13:31:03 +03:00
kimchy dfb68c6310 Search fails when sorting on a field that has no values in the hits returned, closes #285. 2010-07-31 16:41:15 +03:00
kimchy 0186a03684 add another script function test 2010-07-29 16:07:57 +03:00
kimchy 194e6cbff6 Geo support: geo_point type and geo_distance filter, closes #278, #279 2010-07-28 21:06:18 +03:00
kimchy 65284ba2ba Terms Factes: Allow to provide regex controlling which terms should be included, closes #277. 2010-07-26 12:23:03 +03:00
kimchy 72682a6730 always retry on connect exception with master operations 2010-07-23 01:59:56 +03:00
kimchy 9283e2a7ad local discovery should update the local metadata state once it started 2010-07-23 01:39:37 +03:00
kimchy 8875b9641b cleanup test 2010-07-23 00:50:08 +03:00
kimchy 48d33ec70a Cluster Health API: Add `wait_for_nodes` (accepts "N", "<N", ">N", "<=N", and ">=N"), closes #269. 2010-07-21 16:29:44 +03:00
kimchy a2ceaa91cc improve retry when closing the node performing an operation 2010-07-20 22:34:09 +03:00
kimchy f4064038e4 improve load test 2010-07-20 20:53:14 +03:00
kimchy 45e54c1705 add retry if master is not connected till master is connected or a timeout has passed to master based operations (like cluster health) 2010-07-20 18:32:21 +03:00
kimchy 3c8cf68a17 improve timeout cluster service listener 2010-07-20 13:50:19 +03:00
kimchy e48b1d98db more recovery under load tests, now with nodes shutdown, ignore node connected exception or retry when performing replicated operations 2010-07-19 11:33:21 +03:00
kimchy 9def68a733 add full rolling restart recvoery test 2010-07-19 10:08:12 +03:00
kimchy d657d4447b more shard relocation tests, create a cached executor that can be used to allocate threads that are not affected by the actual thread pool impl (can always fork, no blocking) 2010-07-19 01:45:09 +03:00
kimchy f9cd7cb932 add a recovery test while under indexing load 2010-07-18 23:57:57 +03:00
kimchy 9c9dfe0b39 add a recovery test while under indexing load 2010-07-18 23:40:13 +03:00
kimchy a6bd64f30d Facet results vary depending on size, closes #259. 2010-07-14 11:30:39 +03:00
kimchy f0cf552bc5 sorting breaks when sorting on a field that has no value in some documents 2010-07-13 09:38:55 +03:00
kimchy ff17183798 add more sort tests 2010-07-12 22:25:49 +03:00
kimchy 8d669ff54e move sorting to be done using the new fielddata cache, and not using lucene built in FieldCache 2010-07-08 14:42:35 +03:00
kimchy a8c317e355 fix terms facets test to take into account distributed terms request 2010-07-07 16:33:39 +03:00
kimchy 9578ad3ef1 Terms Facets: Allow to specify a set of terms to exclude in the request, closes #246. 2010-07-07 14:41:34 +03:00
kimchy d4f86899e3 more work on reuse work dir, improved transaction log to move to stream based 2010-07-06 00:12:40 +03:00
kimchy b078c9206a more work on reuse work dir, added md5 logic to identify what need to be recovered or not, note, requires reindexing 2010-07-05 14:13:55 +03:00
kimchy 66096e97f2 Remove the terms API (replaced by facets in search), closes #242. 2010-06-30 19:49:41 +03:00
kimchy 33d357dbb4 Memory Store / FS Memory: Create a node level memory store cache and allocator, closes #235. 2010-06-26 22:34:30 +03:00
kimchy 00d2abef40 refactor facets builder API to make it more manageable 2010-06-26 01:36:42 +03:00
kimchy 5df2257319 add test for facets with search size 0 2010-06-25 22:46:07 +03:00
kimchy 7ed7c6db4e Gateway: Internal refactoring, requires manual upgrade when using fs gateway, closes #232. 2010-06-21 22:40:12 +03:00
kimchy 384f8a4f42 Return the maxScore per search and score for each search hit, closes #205. 2010-06-20 00:23:27 +03:00
kimchy 626989c55e don't return the source when asking for scripted fields 2010-06-16 04:48:06 +03:00
kimchy 2d6f61b3c1 Facets: Script Histogram facet, closes #228. 2010-06-16 04:22:00 +03:00
kimchy bb24b56c66 Facets: Script statistical facets, closes #227. 2010-06-16 02:18:24 +03:00
kimchy c2786038e2 Script Filter: Support providing a custom script as a filter, closes #226. 2010-06-16 01:32:04 +03:00
kimchy f75abbaa00 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:59:04 +03:00
kimchy d5bd77cc38 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 17:28:05 +03:00
kimchy 636bfe8466 big refactoring thanks to proper jarjar built from source with asm 3.3 allowing to jarjar guice and others, includes package relocations 2010-06-15 16:51:38 +03:00
kimchy 0a1bc874c3 Search: Allow to specify script fields to be loaded, closes #221. 2010-06-14 12:50:33 +03:00
kimchy 953779ccea allow to pass parameters to custom score script 2010-06-14 04:12:57 +03:00
kimchy 751c56f31e Query DSL: custom score (scripted) query, closes #220. 2010-06-14 03:15:23 +03:00
kimchy 64479a11c3 Search Facets: Histogram facets to allow to specify different key and value fields 2010-06-09 00:50:07 +03:00
kimchy 5ca050ffcb Search Facets: Facets to allow to define filters on them, closes #217. 2010-06-08 22:30:21 +03:00
kimchy 47b3a81bec Search Facets: Histogram Facets, closes #215 2010-06-08 15:45:58 +03:00
kimchy 874993557c add sum of squares, variance, and std deviation for statistical facet 2010-06-08 10:39:45 +03:00
kimchy 8aeb589a42 numeric statistical facets support 2010-06-05 23:44:34 +03:00
kimchy 88ba980f79 refactoring of facets to be more open for different facet types 2010-06-05 21:49:10 +03:00
kimchy bcbc0dd741 Search: Search requests hangs when no indices exists, closes #209. 2010-06-05 01:36:24 +03:00
kimchy 0901322337 rename field facet to term facet 2010-06-04 07:03:30 +03:00
kimchy 66c9f2f834 Search Facets: Field Facets, closes #207 2010-06-04 02:31:49 +03:00
kimchy 4b85407f5e work on a nicer java api 2010-05-29 22:23:39 +03:00
kimchy e59b413980 work on a nicer java api 2010-05-29 05:50:17 +03:00
kimchy 84a5c1eac8 Replication Actions: Allow to control replication type - `async` or `sync`, closes #196. 2010-05-28 03:47:35 +03:00
kimchy 32e4c405de add async http client 2010-05-24 23:27:07 +03:00
kimchy 5c6864e8b3 inital work on hadoop plugin - gateway hdfs support 2010-05-23 08:17:52 +03:00
kimchy 216dda3f9c Throttling of recovery (both gateway recovery and peer node recovery), closes #176. 2010-05-16 23:37:56 +03:00
kimchy 836461e6de improve search serialization and deserialization 2010-05-13 18:39:24 +03:00
kimchy 040030dac8 reafctor inject to util from util.guice 2010-05-10 01:34:22 +03:00
kimchy 8053237643 move from gcommon package 2010-05-04 16:02:26 +03:00
kimchy 34d99c39a5 XContent - An abstraction on top of content (JSON inspired), closes #152. 2010-04-29 23:10:47 +03:00
kimchy f8f65c991a finalize abstracting json into xcontent 2010-04-29 02:11:53 +03:00
kimchy 37dfc443aa continue abstracting json into xcontent 2010-04-29 00:05:55 +03:00
kimchy 2a19160ad6 internalize guice (no need to aop) and reduce deps 2010-04-26 02:10:42 +03:00
kimchy e56321b414 add google collections to elasticsearch as source and remove binary dep 2010-04-26 01:02:31 +03:00
kimchy 4ab298ce00 query on _all field with term/prefix queries fail (by resulting on query execution exception) since the correct term query is not used for it 2010-04-25 18:43:53 +03:00
kimchy bf6cead984 Highlighting broken when query is on `_all` field or with prefixes. Add also a flag to highlight to control if filters should be highlighted or not (called highlight_filters) which defaults to true. Closes #148. 2010-04-25 18:32:46 +03:00
kimchy 609af0da60 update test resources build file 2010-04-21 01:17:19 +03:00
kimchy 52a4a41088 fix dependency in build on proper slf4j version 2010-04-21 00:57:11 +03:00
kimchy bda476eee8 Remove dependency on slf4j for logging, create own internal abstraction, closes #146. 2010-04-21 00:29:42 +03:00
kimchy 2fdc49c113 Search API: Indices Boost to apply a boost factor to each index, closes #143. 2010-04-19 19:15:24 +03:00
kimchy fcc32cbe21 finalize the connection listener support 2010-04-18 17:52:18 +03:00
kimchy 72629fc5ec don't establish a connection on demand, only do it when node discovered by the discovery 2010-04-18 17:10:09 +03:00
kimchy 02cb297691 more groovy client work 2010-04-15 17:45:26 +03:00
kimchy 96a185e107 more work on the groovy client - count/terms api 2010-04-14 13:57:40 +03:00
kimchy 7e041c43e0 more work on the groovy client 2010-04-14 12:17:52 +03:00
kimchy a9cd00e287 rename Server to Node to better reflect its usage (it can be a client node), also add on the NodeBuilder helper methods to set common settings 2010-04-09 00:54:54 +03:00
kimchy 2bb31fe740 reafactor how actions handle failures, better response when non active shards exists, also, default logging to have action set to DEBUG so exceptions in actions are logged in the server 2010-04-07 01:54:33 +03:00
kimchy 3b5b4b4c3a Move from CamelCase to '_' casing, closes #116. 2010-04-04 17:18:18 +03:00
kimchy 6bf19fcd93 Mapper: Rename allFIeld to _all, sourceField to _source, idField to _id, and typeField to _type, closes #105. 2010-04-04 01:50:52 +03:00
kimchy 962ce9a7e6 improve initial read from gateway on first master startup, first master will not complete the startup sequence until meta data and all indices have been created from the gateway 2010-04-03 03:03:37 +03:00
kimchy 6ed23744fc upgrade to gradle 0.9 preview 1 2010-04-02 15:47:27 +03:00
kimchy fd574880fc Clear Indices Cache API: Allow to clear indices cache, closes #101 2010-04-01 12:25:51 +03:00
kimchy 6f9451f9c6 better lifecycle handling when deleting an index 2010-03-31 22:45:46 +03:00
kimchy 38d8fad8d0 clean and refactor the way fs index gateway work, should work nicer with NFS 2010-03-31 17:23:16 +03:00
kimchy 8f324678e8 Index Aliases, closes #88. 2010-03-25 02:00:53 +02:00
kimchy 6a476f440b rename operationThreading method 2010-03-24 00:28:05 +02:00
kimchy 93e025325e Terms API: Support numbers/dates, closes #78. 2010-03-22 02:34:42 +02:00
kimchy a039a6cc38 add a test for failed from 2010-03-21 16:45:04 +02:00
kimchy 1e455789d0 Search API: Scroll, closes #77. 2010-03-21 01:14:49 +02:00
kimchy 315cc90560 fix test 2010-03-20 02:09:44 +02:00
kimchy 049ce4ffcd better names 2010-03-20 01:25:51 +02:00
kimchy 55cad3208e fix explain failure 2010-03-19 14:15:26 +02:00
kimchy 28b0b5fc30 Search API: Support highlighting, closes #69. 2010-03-18 16:05:24 +02:00
kimchy 1dd5997889 _all field, closes #63. 2010-03-16 23:04:20 +02:00
kimchy 4e1a1f3437 Mapping metadata not restored from gateway on server restart, closes #57 2010-03-12 18:22:20 +02:00
kimchy 86c3a406c6 Java API: Expose source as Map (in GetResponse, SearchHit), allow to index a Map, closes #58. 2010-03-11 16:39:30 +02:00
kimchy f4f26d2118 Search API: Query Facet - Add global flag to control if the facet is bounded to the search query or not, closes #50. 2010-03-05 16:05:08 +02:00
kimchy 40b0dfddec count should be cached as a filter 2010-03-05 15:24:04 +02:00
kimchy e735ff49d6 simpler settings builder api 2010-03-05 12:39:38 +02:00
kimchy 7bf0f1ffca refactor client api, remove execXXX, and simple remain with the actual operation name as the method name, one that returns a future, and one that accepts a listener 2010-03-05 01:39:04 +02:00
kimchy 111f9cb751 proper handling of get response (document does not exists) 2010-03-04 15:35:15 +02:00
kimchy 372bdec45f more docs 2010-02-28 01:36:45 +02:00
kimchy 948f0ef0da doc doc doc 2010-02-27 16:36:20 +02:00
kimchy 8b36281d60 MoreLikeThis API: Search documents that are "like" the specified document, closes #45. 2010-02-27 03:57:36 +02:00
kimchy 929bb3f2be have index level query boost part of the search source 2010-02-27 01:26:56 +02:00
kimchy 284a35131c start work on more like this action 2010-02-27 00:52:13 +02:00
kimchy ba0972cde5 upgrade to lucene 3.0.1 2010-02-26 11:59:14 +02:00
kimchy 3ef36737f7 wait a bit for assigment to start in test 2010-02-25 18:45:55 +02:00
kimchy 70726b268f add validation on routing table, expose it in cluster health, and add more information when shard start or fail 2010-02-25 18:40:29 +02:00
kimchy da510f28ab start work on cluster health api, still needs some polising, relates to #42. 2010-02-24 23:16:01 +02:00
kimchy 46ff97af5e refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to search) 2010-02-23 21:30:10 +02:00
kimchy defb6a336d refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to count and delete by query) 2010-02-23 21:22:40 +02:00
kimchy c111e1ab80 refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption 2010-02-23 18:40:22 +02:00
kimchy a828106553 add shard specific failure reason to search operations 2010-02-20 17:35:26 +02:00
kimchy 008b00f51a Facet query crashes the cluster. Wrong serialzation of facets caused for construction of a rough sized array list. closes #28. 2010-02-20 15:21:02 +02:00
kimchy 82e69691b1 add support for "keep alive" time for a search request, and timeout context that have not been accessed 2010-02-18 23:21:08 +02:00
kimchy 23cfdeea11 change the routing interval in tests to 100ms from 200ms 2010-02-18 10:04:32 +02:00
kimchy 5d781961a0 Terms API: Allow to get terms for one or more field. Closes #21. 2010-02-16 21:47:56 +02:00
kimchy cfafb52beb Optimize API: Allow to optimize index/indices. Closes #9. 2010-02-14 20:33:25 +02:00
kimchy 7631b1383b change broadcast support to be able to run on all shards replicas (in parallel) and not just one shard per replica group. Change flush and refresh to use broadcast and not replicaiton. Remove shards transport support since broadcast now does exactly the same, and refactor index status to use broadcast (across all shards). 2010-02-14 13:29:39 +02:00
kimchy ade36f026b TransportClient to automatically retry another node if there is a connection problem 2010-02-11 22:34:11 +02:00
kimchy b61964a2b8 Discovery: Support local (JVM level) discovery. Closes #2. 2010-02-11 00:12:32 +02:00
kimchy b3337c3127 initial commit 2010-02-08 15:30:06 +02:00