Commit Graph

280 Commits

Author SHA1 Message Date
kimchy 049ce4ffcd better names 2010-03-20 01:25:51 +02:00
kimchy d2bf446d9c better exception handling 2010-03-20 00:55:24 +02:00
kimchy d4dc3cacc1 fix problem with outputting proper error when failing to parse configuration on startup 2010-03-20 00:28:15 +02:00
kimchy a344ebb1b3 Index Analysis: Add language analyzers and stemmers, closes #72 2010-03-19 17:07:43 +02:00
kimchy 45234f4d90 fix compilation warning 2010-03-19 14:19:53 +02:00
kimchy 55cad3208e fix explain failure 2010-03-19 14:15:26 +02:00
kimchy f8a615f9a3 refactor internal transport streams to be more effecient, heavily reduce stream size 2010-03-19 03:04:35 +02:00
kimchy 1ae5a3467f change default recovery buffer to 100k from 16k 2010-03-18 17:28:54 +02:00
kimchy b1e5284a06 Memory Store: change default bufferSize from 1k to 100k, closes #70 2010-03-18 17:27:17 +02:00
kimchy 28b0b5fc30 Search API: Support highlighting, closes #69. 2010-03-18 16:05:24 +02:00
kimchy fc3a805514 NullPointerexception at org.elasticsearch.action.get.GetResponse.sourceAsString, closes #68 2010-03-18 14:08:45 +02:00
kimchy cd2090bc79 more tests 2010-03-18 01:15:26 +02:00
kimchy 1107df9ab6 query parser should take into account using all, since all creates a specialized "term query" which boosts based on the boost level associated with a term. Generalized it so mappers can control when query is used for term query. 2010-03-18 00:53:36 +02:00
kimchy a8be04b334 improve test 2010-03-18 00:29:07 +02:00
kimchy 3a55998a3b Mapper: Ability to disable storing the "source" field, closes #66. 2010-03-17 21:29:44 +02:00
kimchy 6243f4f95b Get API: Allow to specify which fields to load, close #65. 2010-03-17 20:03:32 +02:00
kimchy 4c13a9d548 allow to also store the all field 2010-03-17 13:17:48 +02:00
kimchy d8ef200b4b Shutdown API: allow to shutdown node(s) or the whole, closes #64. 2010-03-17 00:29:36 +02:00
kimchy 1dd5997889 _all field, closes #63. 2010-03-16 23:04:20 +02:00
kimchy 1d2d4674cf stop the timer when closing the http server 2010-03-16 02:18:28 +02:00
kimchy 20877a0c79 upgrade to jackson 1.5 2010-03-14 21:24:47 +02:00
kimchy 1de6509107 optimize fetching when an empty array of fields is provided, in such a case, we only need the uid (id and type) 2010-03-13 17:56:29 +02:00
kimchy 2e8b0464b6 allow to specify mappings in created index (currently, only internally), use it to create the mappings on index creation with recoverying from gateway 2010-03-13 02:42:43 +02:00
kimchy 024cdb4312 wait till the index gets created to create the mappings when recovering from the gateway 2010-03-13 02:14:28 +02:00
kimchy 4e1a1f3437 Mapping metadata not restored from gateway on server restart, closes #57 2010-03-12 18:22:20 +02:00
kimchy 65ed582a90 Mapper : Schema less automatic date detection wrongly detects numbers as dates, closes #60. 2010-03-12 18:16:35 +02:00
kimchy 47c11aa538 Boolean field type does not handle number/string properly when searching, closes #59. 2010-03-12 16:53:11 +02:00
kimchy 6fe329ab69 search json parsing to allow passing numbers/booleans as strings and not native json types 2010-03-12 16:36:31 +02:00
kimchy ef85412f98 fix name 2010-03-12 16:30:30 +02:00
kimchy 471801b484 query/filter json parsing to allow passing numbers/booleans as strings and not native json types 2010-03-12 16:28:37 +02:00
kimchy 86c3a406c6 Java API: Expose source as Map (in GetResponse, SearchHit), allow to index a Map, closes #58. 2010-03-11 16:39:30 +02:00
kimchy 4b04db9030 A search with an empty fields param causes a NullPointerException or a runaway process. Changed logic for an empty fields array, where it won't return the source in this case. Closes #55. 2010-03-10 17:49:47 +02:00
kimchy 7c68489758 Mapping - Support specifying string as number values (for example, for boost), closes #53. 2010-03-10 11:22:57 +02:00
kimchy ae5bcb6d2e Support parsing Strings with numeric types, closes #54 2010-03-10 00:40:11 +02:00
kimchy baaac70da5 get jackson object mapper to support dates as elasticsearch expects them 2010-03-09 17:09:07 +02:00
kimchy 83a78b3979 _count hangs, closes #52 2010-03-09 13:25:17 +02:00
kimchy b13f6b1bdd Mapping - MultiField Mapping, closes #51. 2010-03-07 20:13:59 +02:00
kimchy 290ecd4c95 delete files that are no longer used from the fs gateway 2010-03-05 22:46:15 +02:00
kimchy f4f26d2118 Search API: Query Facet - Add global flag to control if the facet is bounded to the search query or not, closes #50. 2010-03-05 16:05:08 +02:00
kimchy 40b0dfddec count should be cached as a filter 2010-03-05 15:24:04 +02:00
kimchy f1d5b179ce doc 2010-03-05 13:02:36 +02:00
kimchy 51836e0fb6 doc 2010-03-05 12:56:37 +02:00
kimchy e735ff49d6 simpler settings builder api 2010-03-05 12:39:38 +02:00
kimchy 45489ed1af add TimeValue based getter 2010-03-05 01:50:40 +02:00
kimchy 7a38e384c9 wrap checked TimeoutException with runtime ElasticSearchTimeoutException 2010-03-05 01:48:56 +02:00
kimchy 7bf0f1ffca refactor client api, remove execXXX, and simple remain with the actual operation name as the method name, one that returns a future, and one that accepts a listener 2010-03-05 01:39:04 +02:00
kimchy e49a8454a6 fix rest boolean 2010-03-04 18:49:18 +02:00
kimchy 111f9cb751 proper handling of get response (document does not exists) 2010-03-04 15:35:15 +02:00
kimchy c560f1f9f1 wait for status should wait for at least that provided status, for example, waiting for status yellow should return if the status is green 2010-03-04 15:09:11 +02:00
kimchy 5d947ad680 make final 2010-03-03 08:47:22 +02:00
kimchy e276928ebf remove dep on sun 2010-03-03 01:49:25 +02:00
kimchy 03ee0a942d update docs 2010-03-03 00:50:53 +02:00
kimchy 12e2ba822f more docs 2010-03-02 22:16:35 +02:00
kimchy fdd221e8ea Query DSL: queryString - allow to run against multiple fields, closes #48. 2010-03-02 00:42:53 +02:00
kimchy fbf9197b85 make non negative query in query parser 2010-03-01 22:17:17 +02:00
kimchy 7709c68f63 optimize boolean queries when possible 2010-03-01 22:07:14 +02:00
kimchy 4dbc167966 Query DSL: Field Query, closes #47. 2010-03-01 20:10:38 +02:00
kimchy 12e87ba865 allow for * on range queries in query parser 2010-03-01 18:49:14 +02:00
kimchy aef5aa0b33 start work on getting maven working.. 2010-03-01 17:19:07 +02:00
kimchy bd8d52f3f8 move to SNAPSHOT suffix for dev builds, when an actual release will take place, then change the version 2010-03-01 16:30:07 +02:00
kimchy 234a5abda0 merge snakeyaml into source 2010-03-01 15:56:19 +02:00
kimchy 7d3b642326 merge snakeyaml into source 2010-03-01 15:53:15 +02:00
kimchy 7c91e7239b merge snakeyaml into source 2010-03-01 15:51:55 +02:00
kimchy 18a1a5f940 merge snakeyaml into source 2010-03-01 15:50:02 +02:00
kimchy 4c9cf299e6 use existing mapping when merging 2010-03-01 14:25:50 +02:00
kimchy 0ef4000842 more mapping work, ignoreDuplicates renamed to ignoreConflicts 2010-03-01 13:55:47 +02:00
kimchy 568254887f better merge mapping logic, better failure reporting 2010-02-28 12:55:05 +02:00
kimchy c6683d23ef some merge mapping work, tests... 2010-02-28 12:28:48 +02:00
kimchy f51e2cf905 stop the recovery process by interrupting network threads when closing a shard 2010-02-28 11:15:35 +02:00
kimchy 372bdec45f more docs 2010-02-28 01:36:45 +02:00
kimchy bcca36fa67 more docs 2010-02-27 23:37:53 +02:00
kimchy bf3f82c7c8 more docs 2010-02-27 22:03:40 +02:00
kimchy 1f3c038f60 fetch phase in search sould return the full name of the field, and not just the name 2010-02-27 22:00:17 +02:00
kimchy bf7ace79ea whats up? doc... 2010-02-27 19:27:07 +02:00
kimchy a5790cab28 refactor from and size in url to use the new "extraSource" in it 2010-02-27 16:48:01 +02:00
kimchy 948f0ef0da doc doc doc 2010-02-27 16:36:20 +02:00
kimchy 471ad1ed73 expose jgourps.bind_port to use when configuring tcp based discovery in jgroups through settings 2010-02-27 04:34:06 +02:00
kimchy c5a2d497df add _mlt as well for uri 2010-02-27 04:02:07 +02:00
kimchy 8b36281d60 MoreLikeThis API: Search documents that are "like" the specified document, closes #45. 2010-02-27 03:57:36 +02:00
kimchy c30d790609 change the the name to indices boost 2010-02-27 01:37:14 +02:00
kimchy 929bb3f2be have index level query boost part of the search source 2010-02-27 01:26:56 +02:00
kimchy 284a35131c start work on more like this action 2010-02-27 00:52:13 +02:00
kimchy 1ec1716a7b analyzer might end up being null 2010-02-26 15:28:38 +02:00
kimchy e0c3bb5883 Query: support negative queries, closes #44. 2010-02-26 14:44:18 +02:00
kimchy ba0972cde5 upgrade to lucene 3.0.1 2010-02-26 11:59:14 +02:00
kimchy 0ebb74dd9e Query DSL: moreLikeThis & moreLikeThisField, closes #43. 2010-02-26 03:28:44 +02:00
kimchy e70bec79cd fix wrong iteration when getting back terms 2010-02-25 21:34:41 +02:00
kimchy a8af609eba refactor index service into a service package 2010-02-25 20:20:54 +02:00
kimchy 3ef36737f7 wait a bit for assigment to start in test 2010-02-25 18:45:55 +02:00
kimchy 70726b268f add validation on routing table, expose it in cluster health, and add more information when shard start or fail 2010-02-25 18:40:29 +02:00
kimchy f5a4296bf7 improve logging 2010-02-25 09:03:52 +02:00
kimchy 9eaa50ce62 revert escaspe default to true in queryString 2010-02-25 08:46:37 +02:00
kimchy da510f28ab start work on cluster health api, still needs some polising, relates to #42. 2010-02-24 23:16:01 +02:00
kimchy e3af8716ed fix nodes info to accept node(s) ids as well 2010-02-24 22:45:24 +02:00
kimchy c7389df8e0 Query DSL: queryString - allow to escape the string (should be on by default), closes #41. 2010-02-24 22:00:03 +02:00
kimchy bcc52a0173 add calibrateSizeByDeletes option in merge policies 2010-02-24 20:45:15 +02:00
kimchy eb3f8b2f79 fix logging 2010-02-24 18:14:39 +02:00
kimchy 97814e100a add ack flag to create and delete index apis 2010-02-24 01:43:36 +02:00
kimchy 78d9ab103a clean ongoing open index outputs when closing the recovery action 2010-02-24 00:37:05 +02:00
kimchy aa54e9cc35 better handling of open inputs/outputs in case of recovery failure 2010-02-24 00:32:23 +02:00
kimchy d1a4989e84 fix possible node serialization problem (dont share the byte buffer) 2010-02-23 23:37:33 +02:00
kimchy b5544769d2 fix problem when deserializing exceptions thrown from one node to the other 2010-02-23 23:16:02 +02:00
kimchy 54f325ee1a query parser with explicit fields values would not get analyzed 2010-02-23 22:16:12 +02:00
kimchy 07d4166715 removed unused field 2010-02-23 22:04:10 +02:00
kimchy 4cf1b3ed9e read settings (json, yml) using utf8 2010-02-23 21:33:54 +02:00
kimchy 46ff97af5e refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to search) 2010-02-23 21:30:10 +02:00
kimchy defb6a336d refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to count and delete by query) 2010-02-23 21:22:40 +02:00
kimchy c111e1ab80 refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption 2010-02-23 18:40:22 +02:00
kimchy 8adcbb2832 add a simple test for validating jackson handling of binary data added while generating content 2010-02-22 23:18:45 +02:00
kimchy 3f033a04e7 change toInclusice in terms api to default to true instead of false 2010-02-22 23:03:58 +02:00
kimchy d36f376a8e fix cluster state mapping informaton, return it with the mapping name as key and source field 2010-02-22 21:34:11 +02:00
kimchy 67d86de7ea Gateway: Store cluster meta data in JSON (and not binary), closes #36. 2010-02-22 20:08:33 +02:00
kimchy 575250e223 handle reduce phase failures when searching (raise exception to listener) 2010-02-22 09:26:08 +02:00
kimchy 3d9b310c46 better detailed message 2010-02-22 08:55:36 +02:00
kimchy 98c981d02c don't wrap in broadcast shard excpetion twice 2010-02-22 08:51:47 +02:00
kimchy 086611ce38 add shard header with failures to flush operation 2010-02-22 08:48:20 +02:00
kimchy b05b01d9f8 Terms API: add the ability to return terms as array (termsAsArray flag), defaulting to true since order is important 2010-02-22 01:50:58 +02:00
kimchy 38edf96271 Terms API: add the ability to return terms as array (termsAsArray flag), defaulting to false 2010-02-22 01:48:29 +02:00
kimchy 7cda7eca54 fix spelling 2010-02-22 01:33:37 +02:00
kimchy 0f5ff617f1 when failing to send a message using the transport (connect / serialization), call the response handler with it by default 2010-02-22 01:19:06 +02:00
kimchy 16a7dd137d handle cases when t is null when producing a detailed message for it 2010-02-22 00:05:32 +02:00
kimchy 8c16840fd7 bring back boost mapping support when building mapping source 2010-02-21 23:37:48 +02:00
kimchy 6d52065db3 Mapping Overhaul - More user friendly, cluster aware, closes #34. 2010-02-21 22:57:39 +02:00
kimchy 78e73259a0 put mapping to return the parsed source and an indication if it was ack from all the nodes within the timeout 2010-02-21 17:26:15 +02:00
kimchy 0e55c876a4 rename create mapping to put mapping 2010-02-21 16:49:42 +02:00
kimchy 2201839091 add support to generate json out of the runtime representation of mappings 2010-02-21 14:24:34 +02:00
kimchy ce58723cc5 refactor mapping names into a separate class (Names), create a NamedAnalyzer wrapper which allows to know the logical name the analyzer was created under 2010-02-21 10:28:11 +02:00
kimchy 82e5b7d1c9 when a shard is recovered (from gateway or another shard, sniff mappings from it). Also, improved search load doc perforamnce when no explicit fields are provided 2010-02-21 00:34:54 +02:00
kimchy 2e81730272 add failure reason for broadcast operations (refresh, flush, optimize, ....) 2010-02-20 18:58:44 +02:00
kimchy a828106553 add shard specific failure reason to search operations 2010-02-20 17:35:26 +02:00
kimchy f94ff19f33 don't print fields when the fields map is empty 2010-02-20 15:54:18 +02:00
kimchy 008b00f51a Facet query crashes the cluster. Wrong serialzation of facets caused for construction of a rough sized array list. closes #28. 2010-02-20 15:21:02 +02:00
kimchy fa54b7c896 search operation where only some shards would fail might hang 2010-02-20 04:06:27 +02:00
kimchy 21a1021bdb add the cause to query phase execption 2010-02-20 03:34:42 +02:00
kimchy 1aa8e01184 Allow for the sort search element to speciy the sort fields in an array, closes #30. 2010-02-20 02:48:26 +02:00
kimchy 3f045dee1f Accept also 0 int number to indicate false, and any other number to indicate true (on top of accepting json boolean type), closes #26. 2010-02-20 02:13:06 +02:00
kimchy 4806df426a Boolean Type: Support also cases when a number/string value are passed, closes #33. 2010-02-20 01:50:50 +02:00
kimchy e6b5ec7aaa some queries/filters did not end at the correct state when used as inner json elements 2010-02-20 01:42:17 +02:00
kimchy bfc5ad7b92 disable error trace by deault, enable it using rest param called errorTrace which can be set to 1/true/on 2010-02-19 09:55:02 +02:00
kimchy 2a3fcce818 protected from cases when the index get created and then, right away, deleted. relates to #25. 2010-02-18 23:39:14 +02:00
kimchy c631cae090 add tagline to the main request ;) 2010-02-18 23:23:38 +02:00
kimchy 82e69691b1 add support for "keep alive" time for a search request, and timeout context that have not been accessed 2010-02-18 23:21:08 +02:00
kimchy f7d152821d supprot 1 as true for boolean setting 2010-02-18 23:11:10 +02:00
kimchy e195ec6295 allow http boolean parameters to accept either "true" or "1" for true 2010-02-18 23:09:05 +02:00
kimchy 72599ad003 generics 2010-02-18 13:56:14 +02:00
kimchy 23cfdeea11 change the routing interval in tests to 100ms from 200ms 2010-02-18 10:04:32 +02:00
kimchy 30ff15e3fc do routing automatically also when routing table changed, don't wait for the scheduled one (it means a new index has created, shard started/failed) 2010-02-18 10:04:10 +02:00
kimchy f135a93b70 create mapping operation should wait for the mappings to be created on all the nodes before it returns (with a new timeout value) 2010-02-18 02:10:15 +02:00
kimchy 778156787a the work location of an index should be under an additional "index" directory (so later, we can have other auxilary directories) 2010-02-18 00:08:39 +02:00
kimchy 8a5a44c1c3 Search API: Set different boost for indices when searching across indices, closes #23. 2010-02-17 19:49:46 +02:00