Commit Graph

2252 Commits

Author SHA1 Message Date
kimchy 5b11de8958 clean thread locals (even static ones!) on Server#close or TransportClient#close 2010-03-23 10:31:15 +02:00
kimchy 14af9d28fd sort field can be null (when sorting on score for example), make sure we take it into account when serializing 2010-03-23 08:53:58 +02:00
kimchy 89043b113a better exception when trying to put mappings when no indices exists, closes #79. 2010-03-22 18:03:05 +02:00
kimchy f9cac39024 Terms query is broken, closes #80. 2010-03-22 17:59:34 +02:00
kimchy fa55c40c87 Index FS Store: Allow to cache (in memory) specific files, closes #82 2010-03-22 17:09:03 +02:00
kimchy 267859c784 another test 2010-03-22 13:59:25 +02:00
kimchy 93e025325e Terms API: Support numbers/dates, closes #78. 2010-03-22 02:34:42 +02:00
kimchy bc03d89c00 work on terms api to work properly with number types 2010-03-21 22:38:51 +02:00
kimchy a039a6cc38 add a test for failed from 2010-03-21 16:45:04 +02:00
kimchy 297e2091e2 more improved search result streaming, write a header with shard targets, so each hit just write an id of the targe 2010-03-21 15:09:02 +02:00
kimchy 77564cb14f more improved transport stream size, duplicate strings are serialized once and use handles to deserialize 2010-03-21 10:35:25 +02:00
kimchy 1e455789d0 Search API: Scroll, closes #77. 2010-03-21 01:14:49 +02:00
kimchy 2ae6de2433 fix wrong handling of size and from when passed as request parameters 2010-03-20 23:44:24 +02:00
kimchy de69f5f0fd doc 2010-03-20 21:08:19 +02:00
kimchy 52af5573f1 rename tieBreakerMultiplier to tieBreaker 2010-03-20 18:52:21 +02:00
kimchy 35bd7f0086 fix search hanging because of query parsing exception 2010-03-20 18:45:02 +02:00
kimchy bad8643978 fix wrong parsing of useDisMax with number 2010-03-20 18:13:08 +02:00
kimchy fa1071d090 parse correct enabled flag on all field when passed as number, closes #76 2010-03-20 14:40:24 +02:00
kimchy 671bc4e734 ThreadPool: Rename dynamic to scaling, closes #75. 2010-03-20 03:41:41 +02:00
kimchy fc47bd6f2f ThreadPool: Add a blocking thread pool, closes 74. 2010-03-20 03:25:13 +02:00
kimchy 2551fb9fce change the default opereationThreading on delete/index to true 2010-03-20 03:15:57 +02:00
kimchy 315cc90560 fix test 2010-03-20 02:09:44 +02:00
kimchy 049ce4ffcd better names 2010-03-20 01:25:51 +02:00
kimchy d2bf446d9c better exception handling 2010-03-20 00:55:24 +02:00
kimchy d4dc3cacc1 fix problem with outputting proper error when failing to parse configuration on startup 2010-03-20 00:28:15 +02:00
kimchy a344ebb1b3 Index Analysis: Add language analyzers and stemmers, closes #72 2010-03-19 17:07:43 +02:00
kimchy 45234f4d90 fix compilation warning 2010-03-19 14:19:53 +02:00
kimchy 55cad3208e fix explain failure 2010-03-19 14:15:26 +02:00
kimchy f8a615f9a3 refactor internal transport streams to be more effecient, heavily reduce stream size 2010-03-19 03:04:35 +02:00
kimchy 1ae5a3467f change default recovery buffer to 100k from 16k 2010-03-18 17:28:54 +02:00
kimchy b1e5284a06 Memory Store: change default bufferSize from 1k to 100k, closes #70 2010-03-18 17:27:17 +02:00
kimchy 28b0b5fc30 Search API: Support highlighting, closes #69. 2010-03-18 16:05:24 +02:00
kimchy fc3a805514 NullPointerexception at org.elasticsearch.action.get.GetResponse.sourceAsString, closes #68 2010-03-18 14:08:45 +02:00
kimchy cd2090bc79 more tests 2010-03-18 01:15:26 +02:00
kimchy 1107df9ab6 query parser should take into account using all, since all creates a specialized "term query" which boosts based on the boost level associated with a term. Generalized it so mappers can control when query is used for term query. 2010-03-18 00:53:36 +02:00
kimchy a8be04b334 improve test 2010-03-18 00:29:07 +02:00
kimchy 3a55998a3b Mapper: Ability to disable storing the "source" field, closes #66. 2010-03-17 21:29:44 +02:00
kimchy 6243f4f95b Get API: Allow to specify which fields to load, close #65. 2010-03-17 20:03:32 +02:00
kimchy 4c13a9d548 allow to also store the all field 2010-03-17 13:17:48 +02:00
kimchy d8ef200b4b Shutdown API: allow to shutdown node(s) or the whole, closes #64. 2010-03-17 00:29:36 +02:00
kimchy 1dd5997889 _all field, closes #63. 2010-03-16 23:04:20 +02:00
kimchy 1d2d4674cf stop the timer when closing the http server 2010-03-16 02:18:28 +02:00
kimchy 20877a0c79 upgrade to jackson 1.5 2010-03-14 21:24:47 +02:00
kimchy 1de6509107 optimize fetching when an empty array of fields is provided, in such a case, we only need the uid (id and type) 2010-03-13 17:56:29 +02:00
kimchy 2e8b0464b6 allow to specify mappings in created index (currently, only internally), use it to create the mappings on index creation with recoverying from gateway 2010-03-13 02:42:43 +02:00
kimchy 024cdb4312 wait till the index gets created to create the mappings when recovering from the gateway 2010-03-13 02:14:28 +02:00
kimchy 4e1a1f3437 Mapping metadata not restored from gateway on server restart, closes #57 2010-03-12 18:22:20 +02:00
kimchy 65ed582a90 Mapper : Schema less automatic date detection wrongly detects numbers as dates, closes #60. 2010-03-12 18:16:35 +02:00
kimchy 47c11aa538 Boolean field type does not handle number/string properly when searching, closes #59. 2010-03-12 16:53:11 +02:00
kimchy 6fe329ab69 search json parsing to allow passing numbers/booleans as strings and not native json types 2010-03-12 16:36:31 +02:00
kimchy ef85412f98 fix name 2010-03-12 16:30:30 +02:00
kimchy 471801b484 query/filter json parsing to allow passing numbers/booleans as strings and not native json types 2010-03-12 16:28:37 +02:00
kimchy 86c3a406c6 Java API: Expose source as Map (in GetResponse, SearchHit), allow to index a Map, closes #58. 2010-03-11 16:39:30 +02:00
kimchy 4b04db9030 A search with an empty fields param causes a NullPointerException or a runaway process. Changed logic for an empty fields array, where it won't return the source in this case. Closes #55. 2010-03-10 17:49:47 +02:00
kimchy 7c68489758 Mapping - Support specifying string as number values (for example, for boost), closes #53. 2010-03-10 11:22:57 +02:00
kimchy ae5bcb6d2e Support parsing Strings with numeric types, closes #54 2010-03-10 00:40:11 +02:00
kimchy baaac70da5 get jackson object mapper to support dates as elasticsearch expects them 2010-03-09 17:09:07 +02:00
kimchy 83a78b3979 _count hangs, closes #52 2010-03-09 13:25:17 +02:00
kimchy b13f6b1bdd Mapping - MultiField Mapping, closes #51. 2010-03-07 20:13:59 +02:00
kimchy 290ecd4c95 delete files that are no longer used from the fs gateway 2010-03-05 22:46:15 +02:00
kimchy f4f26d2118 Search API: Query Facet - Add global flag to control if the facet is bounded to the search query or not, closes #50. 2010-03-05 16:05:08 +02:00
kimchy 40b0dfddec count should be cached as a filter 2010-03-05 15:24:04 +02:00
kimchy f1d5b179ce doc 2010-03-05 13:02:36 +02:00
kimchy 51836e0fb6 doc 2010-03-05 12:56:37 +02:00
kimchy e735ff49d6 simpler settings builder api 2010-03-05 12:39:38 +02:00
kimchy 45489ed1af add TimeValue based getter 2010-03-05 01:50:40 +02:00
kimchy 7a38e384c9 wrap checked TimeoutException with runtime ElasticSearchTimeoutException 2010-03-05 01:48:56 +02:00
kimchy 7bf0f1ffca refactor client api, remove execXXX, and simple remain with the actual operation name as the method name, one that returns a future, and one that accepts a listener 2010-03-05 01:39:04 +02:00
kimchy e49a8454a6 fix rest boolean 2010-03-04 18:49:18 +02:00
kimchy 111f9cb751 proper handling of get response (document does not exists) 2010-03-04 15:35:15 +02:00
kimchy c560f1f9f1 wait for status should wait for at least that provided status, for example, waiting for status yellow should return if the status is green 2010-03-04 15:09:11 +02:00
kimchy 5d947ad680 make final 2010-03-03 08:47:22 +02:00
kimchy e276928ebf remove dep on sun 2010-03-03 01:49:25 +02:00
kimchy 03ee0a942d update docs 2010-03-03 00:50:53 +02:00
kimchy 12e2ba822f more docs 2010-03-02 22:16:35 +02:00
kimchy fdd221e8ea Query DSL: queryString - allow to run against multiple fields, closes #48. 2010-03-02 00:42:53 +02:00
kimchy fbf9197b85 make non negative query in query parser 2010-03-01 22:17:17 +02:00
kimchy 7709c68f63 optimize boolean queries when possible 2010-03-01 22:07:14 +02:00
kimchy 4dbc167966 Query DSL: Field Query, closes #47. 2010-03-01 20:10:38 +02:00
kimchy 12e87ba865 allow for * on range queries in query parser 2010-03-01 18:49:14 +02:00
kimchy aef5aa0b33 start work on getting maven working.. 2010-03-01 17:19:07 +02:00
kimchy bd8d52f3f8 move to SNAPSHOT suffix for dev builds, when an actual release will take place, then change the version 2010-03-01 16:30:07 +02:00
kimchy 234a5abda0 merge snakeyaml into source 2010-03-01 15:56:19 +02:00
kimchy 7d3b642326 merge snakeyaml into source 2010-03-01 15:53:15 +02:00
kimchy 7c91e7239b merge snakeyaml into source 2010-03-01 15:51:55 +02:00
kimchy 18a1a5f940 merge snakeyaml into source 2010-03-01 15:50:02 +02:00
kimchy 4c9cf299e6 use existing mapping when merging 2010-03-01 14:25:50 +02:00
kimchy 0ef4000842 more mapping work, ignoreDuplicates renamed to ignoreConflicts 2010-03-01 13:55:47 +02:00
kimchy 568254887f better merge mapping logic, better failure reporting 2010-02-28 12:55:05 +02:00
kimchy c6683d23ef some merge mapping work, tests... 2010-02-28 12:28:48 +02:00
kimchy f51e2cf905 stop the recovery process by interrupting network threads when closing a shard 2010-02-28 11:15:35 +02:00
kimchy 372bdec45f more docs 2010-02-28 01:36:45 +02:00
kimchy bcca36fa67 more docs 2010-02-27 23:37:53 +02:00
kimchy bf3f82c7c8 more docs 2010-02-27 22:03:40 +02:00
kimchy 1f3c038f60 fetch phase in search sould return the full name of the field, and not just the name 2010-02-27 22:00:17 +02:00
kimchy bf7ace79ea whats up? doc... 2010-02-27 19:27:07 +02:00
kimchy a5790cab28 refactor from and size in url to use the new "extraSource" in it 2010-02-27 16:48:01 +02:00
kimchy 948f0ef0da doc doc doc 2010-02-27 16:36:20 +02:00
kimchy 471ad1ed73 expose jgourps.bind_port to use when configuring tcp based discovery in jgroups through settings 2010-02-27 04:34:06 +02:00
kimchy c5a2d497df add _mlt as well for uri 2010-02-27 04:02:07 +02:00
kimchy 8b36281d60 MoreLikeThis API: Search documents that are "like" the specified document, closes #45. 2010-02-27 03:57:36 +02:00
kimchy c30d790609 change the the name to indices boost 2010-02-27 01:37:14 +02:00
kimchy 929bb3f2be have index level query boost part of the search source 2010-02-27 01:26:56 +02:00
kimchy 284a35131c start work on more like this action 2010-02-27 00:52:13 +02:00
kimchy 1ec1716a7b analyzer might end up being null 2010-02-26 15:28:38 +02:00
kimchy e0c3bb5883 Query: support negative queries, closes #44. 2010-02-26 14:44:18 +02:00
kimchy ba0972cde5 upgrade to lucene 3.0.1 2010-02-26 11:59:14 +02:00
kimchy 0ebb74dd9e Query DSL: moreLikeThis & moreLikeThisField, closes #43. 2010-02-26 03:28:44 +02:00
kimchy e70bec79cd fix wrong iteration when getting back terms 2010-02-25 21:34:41 +02:00
kimchy a8af609eba refactor index service into a service package 2010-02-25 20:20:54 +02:00
kimchy 3ef36737f7 wait a bit for assigment to start in test 2010-02-25 18:45:55 +02:00
kimchy 70726b268f add validation on routing table, expose it in cluster health, and add more information when shard start or fail 2010-02-25 18:40:29 +02:00
kimchy f5a4296bf7 improve logging 2010-02-25 09:03:52 +02:00
kimchy 9eaa50ce62 revert escaspe default to true in queryString 2010-02-25 08:46:37 +02:00
kimchy da510f28ab start work on cluster health api, still needs some polising, relates to #42. 2010-02-24 23:16:01 +02:00
kimchy e3af8716ed fix nodes info to accept node(s) ids as well 2010-02-24 22:45:24 +02:00
kimchy c7389df8e0 Query DSL: queryString - allow to escape the string (should be on by default), closes #41. 2010-02-24 22:00:03 +02:00
kimchy bcc52a0173 add calibrateSizeByDeletes option in merge policies 2010-02-24 20:45:15 +02:00
kimchy eb3f8b2f79 fix logging 2010-02-24 18:14:39 +02:00
kimchy 97814e100a add ack flag to create and delete index apis 2010-02-24 01:43:36 +02:00
kimchy 78d9ab103a clean ongoing open index outputs when closing the recovery action 2010-02-24 00:37:05 +02:00
kimchy aa54e9cc35 better handling of open inputs/outputs in case of recovery failure 2010-02-24 00:32:23 +02:00
kimchy d1a4989e84 fix possible node serialization problem (dont share the byte buffer) 2010-02-23 23:37:33 +02:00
kimchy b5544769d2 fix problem when deserializing exceptions thrown from one node to the other 2010-02-23 23:16:02 +02:00
kimchy 54f325ee1a query parser with explicit fields values would not get analyzed 2010-02-23 22:16:12 +02:00
kimchy 07d4166715 removed unused field 2010-02-23 22:04:10 +02:00
kimchy 4cf1b3ed9e read settings (json, yml) using utf8 2010-02-23 21:33:54 +02:00
kimchy 46ff97af5e refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to search) 2010-02-23 21:30:10 +02:00
kimchy defb6a336d refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to count and delete by query) 2010-02-23 21:22:40 +02:00
kimchy c111e1ab80 refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption 2010-02-23 18:40:22 +02:00
kimchy 8adcbb2832 add a simple test for validating jackson handling of binary data added while generating content 2010-02-22 23:18:45 +02:00
kimchy 3f033a04e7 change toInclusice in terms api to default to true instead of false 2010-02-22 23:03:58 +02:00
kimchy d36f376a8e fix cluster state mapping informaton, return it with the mapping name as key and source field 2010-02-22 21:34:11 +02:00
kimchy 67d86de7ea Gateway: Store cluster meta data in JSON (and not binary), closes #36. 2010-02-22 20:08:33 +02:00
kimchy 575250e223 handle reduce phase failures when searching (raise exception to listener) 2010-02-22 09:26:08 +02:00
kimchy 3d9b310c46 better detailed message 2010-02-22 08:55:36 +02:00
kimchy 98c981d02c don't wrap in broadcast shard excpetion twice 2010-02-22 08:51:47 +02:00
kimchy 086611ce38 add shard header with failures to flush operation 2010-02-22 08:48:20 +02:00
kimchy b05b01d9f8 Terms API: add the ability to return terms as array (termsAsArray flag), defaulting to true since order is important 2010-02-22 01:50:58 +02:00
kimchy 38edf96271 Terms API: add the ability to return terms as array (termsAsArray flag), defaulting to false 2010-02-22 01:48:29 +02:00
kimchy 7cda7eca54 fix spelling 2010-02-22 01:33:37 +02:00
kimchy 0f5ff617f1 when failing to send a message using the transport (connect / serialization), call the response handler with it by default 2010-02-22 01:19:06 +02:00
kimchy 16a7dd137d handle cases when t is null when producing a detailed message for it 2010-02-22 00:05:32 +02:00
kimchy 8c16840fd7 bring back boost mapping support when building mapping source 2010-02-21 23:37:48 +02:00
kimchy 6d52065db3 Mapping Overhaul - More user friendly, cluster aware, closes #34. 2010-02-21 22:57:39 +02:00
kimchy 78e73259a0 put mapping to return the parsed source and an indication if it was ack from all the nodes within the timeout 2010-02-21 17:26:15 +02:00
kimchy 0e55c876a4 rename create mapping to put mapping 2010-02-21 16:49:42 +02:00
kimchy 2201839091 add support to generate json out of the runtime representation of mappings 2010-02-21 14:24:34 +02:00
kimchy ce58723cc5 refactor mapping names into a separate class (Names), create a NamedAnalyzer wrapper which allows to know the logical name the analyzer was created under 2010-02-21 10:28:11 +02:00
kimchy 82e5b7d1c9 when a shard is recovered (from gateway or another shard, sniff mappings from it). Also, improved search load doc perforamnce when no explicit fields are provided 2010-02-21 00:34:54 +02:00
kimchy 2e81730272 add failure reason for broadcast operations (refresh, flush, optimize, ....) 2010-02-20 18:58:44 +02:00
kimchy a828106553 add shard specific failure reason to search operations 2010-02-20 17:35:26 +02:00
kimchy f94ff19f33 don't print fields when the fields map is empty 2010-02-20 15:54:18 +02:00
kimchy 008b00f51a Facet query crashes the cluster. Wrong serialzation of facets caused for construction of a rough sized array list. closes #28. 2010-02-20 15:21:02 +02:00
kimchy fa54b7c896 search operation where only some shards would fail might hang 2010-02-20 04:06:27 +02:00
kimchy 21a1021bdb add the cause to query phase execption 2010-02-20 03:34:42 +02:00
kimchy 1aa8e01184 Allow for the sort search element to speciy the sort fields in an array, closes #30. 2010-02-20 02:48:26 +02:00
kimchy 3f045dee1f Accept also 0 int number to indicate false, and any other number to indicate true (on top of accepting json boolean type), closes #26. 2010-02-20 02:13:06 +02:00
kimchy 4806df426a Boolean Type: Support also cases when a number/string value are passed, closes #33. 2010-02-20 01:50:50 +02:00
kimchy e6b5ec7aaa some queries/filters did not end at the correct state when used as inner json elements 2010-02-20 01:42:17 +02:00
kimchy bfc5ad7b92 disable error trace by deault, enable it using rest param called errorTrace which can be set to 1/true/on 2010-02-19 09:55:02 +02:00
kimchy 2a3fcce818 protected from cases when the index get created and then, right away, deleted. relates to #25. 2010-02-18 23:39:14 +02:00
kimchy c631cae090 add tagline to the main request ;) 2010-02-18 23:23:38 +02:00
kimchy 82e69691b1 add support for "keep alive" time for a search request, and timeout context that have not been accessed 2010-02-18 23:21:08 +02:00
kimchy f7d152821d supprot 1 as true for boolean setting 2010-02-18 23:11:10 +02:00
kimchy e195ec6295 allow http boolean parameters to accept either "true" or "1" for true 2010-02-18 23:09:05 +02:00
kimchy 72599ad003 generics 2010-02-18 13:56:14 +02:00
kimchy 23cfdeea11 change the routing interval in tests to 100ms from 200ms 2010-02-18 10:04:32 +02:00
kimchy 30ff15e3fc do routing automatically also when routing table changed, don't wait for the scheduled one (it means a new index has created, shard started/failed) 2010-02-18 10:04:10 +02:00
kimchy f135a93b70 create mapping operation should wait for the mappings to be created on all the nodes before it returns (with a new timeout value) 2010-02-18 02:10:15 +02:00
kimchy 778156787a the work location of an index should be under an additional "index" directory (so later, we can have other auxilary directories) 2010-02-18 00:08:39 +02:00
kimchy 8a5a44c1c3 Search API: Set different boost for indices when searching across indices, closes #23. 2010-02-17 19:49:46 +02:00
kimchy ffbc2a9d8d add the ability to provide params to ToJson (later will be used to control how json is generated) 2010-02-17 18:36:52 +02:00
kimchy 0545423837 better encapsulation of mapping builders 2010-02-17 18:19:52 +02:00
kimchy 872781536d Merge bytebuffer and memory stores into a single memory store options, closes #22. 2010-02-17 13:09:22 +02:00
kimchy 042d71073c decouple http from rest 2010-02-17 09:28:06 +02:00
kimchy 1299f20364 flush_index hangs when no indices exist, closes #19. 2010-02-16 21:56:24 +02:00
kimchy 5d781961a0 Terms API: Allow to get terms for one or more field. Closes #21. 2010-02-16 21:47:56 +02:00
kimchy 06cbc0a95b Count API: Also accepts /_count uri to search over all indices. Closes #17. 2010-02-16 10:18:47 +02:00
kimchy 854fc21a70 Search API: Also accepts /_search uri to search over all indices. Closes #16. 2010-02-16 10:16:34 +02:00
kimchy 66b86a7a03 Optimize API: Add onlyExpungeDeletes, flush and refresh parameters. Closes #15. 2010-02-15 23:55:11 +02:00
kimchy 9633108ad6 Flush API: Add refresh flag (refresh after flush). Closes #14. 2010-02-15 23:35:53 +02:00
kimchy 687d7955e5 slight performance improvement in dfs phase 2010-02-15 17:15:49 +02:00
kimchy e768f67fa0 Search API: Fields listed should exists within a "fields" Json object. Closes #13. 2010-02-15 10:27:39 +02:00
kimchy 9a9ce99364 Create Mapping API: Automatically create indices. Closes #12. 2010-02-15 10:23:53 +02:00
kimchy b5f3fc9ae1 Query http listeners. Closes #10. 2010-02-14 21:29:14 +02:00
kimchy cfafb52beb Optimize API: Allow to optimize index/indices. Closes #9. 2010-02-14 20:33:25 +02:00
kimchy 7631b1383b change broadcast support to be able to run on all shards replicas (in parallel) and not just one shard per replica group. Change flush and refresh to use broadcast and not replicaiton. Remove shards transport support since broadcast now does exactly the same, and refactor index status to use broadcast (across all shards). 2010-02-14 13:29:39 +02:00
kimchy 604c407e91 smart search analyzer should try both fullName and then indexName, and not just indexName. 2010-02-14 02:20:34 +02:00
kimchy 5ac51ee93f HTTP: Rest API should support receiving HTTP. Closes #8. 2010-02-13 23:44:37 +02:00
kimchy 14f2445e2a javadoc client 2010-02-13 20:03:37 +02:00
kimchy c92b342216 javadoc util.settings 2010-02-12 22:54:30 +02:00
kimchy 1d732dfc1b javadoc util.settings 2010-02-12 22:07:27 +02:00
kimchy 78eaacccef Discovery/Jgroups: Upgrade to 2.9.0. Closes #7. 2010-02-12 18:09:14 +02:00
kimchy 8f1023cbbe Add support to output date types with JsonBuilder 2010-02-12 16:12:16 +02:00
kimchy 9e8b5e5060 Query DSL: Bool query/filter to be valid JSON. Closes $6. 2010-02-12 15:20:46 +02:00
kimchy bc217d99ce close JsonParser where applicable to release internal jackson resources 2010-02-12 14:49:08 +02:00
kimchy ade36f026b TransportClient to automatically retry another node if there is a connection problem 2010-02-11 22:34:11 +02:00
kimchy 847db717c6 Transport: Support local (JVM level) transport. Closes #3. 2010-02-11 19:29:25 +02:00
kimchy b61964a2b8 Discovery: Support local (JVM level) discovery. Closes #2. 2010-02-11 00:12:32 +02:00
kimchy bd2b0a632b Support terms filter, closes #1 2010-02-09 22:18:46 +02:00
kimchy b3337c3127 initial commit 2010-02-08 15:30:06 +02:00