Commit Graph

393 Commits

Author SHA1 Message Date
kimchy fd574880fc Clear Indices Cache API: Allow to clear indices cache, closes #101 2010-04-01 12:25:51 +03:00
kimchy 0e3ca48aa9 add type to filter cache 2010-04-01 01:18:18 +03:00
kimchy dc1402597f rename 2010-04-01 01:05:37 +03:00
kimchy d546ae358c javadoc 2010-04-01 00:44:34 +03:00
kimchy aac05e2629 inject similarity to parsing context of queries so it can be used 2010-04-01 00:35:54 +03:00
kimchy 2ea7423f3a don't cache count queries 2010-04-01 00:20:45 +03:00
kimchy def8caf7db better lifecycle handling when deleting an index 2010-03-31 22:46:21 +03:00
kimchy 6f9451f9c6 better lifecycle handling when deleting an index 2010-03-31 22:45:46 +03:00
kimchy 398382f6e7 nicer code 2010-03-31 21:45:56 +03:00
kimchy 632f0d4f0d clean logging file 2010-03-31 21:18:40 +03:00
kimchy 38d8fad8d0 clean and refactor the way fs index gateway work, should work nicer with NFS 2010-03-31 17:23:16 +03:00
kimchy 0586bcd003 better handling of fs gateway when sync to disk of the translog file 2010-03-31 15:39:50 +03:00
kimchy 1a698df69d better handling of fs gateway when sync to disk of the translog file 2010-03-31 15:36:43 +03:00
kimchy 875e7b7449 better logging of fs gateway 2010-03-31 13:02:09 +03:00
kimchy 41e100ad33 fix failure in mlt with dates, this does mean that currently, mlt, when based on fetching the source and parsing it, does not do mlt on numbers 2010-03-30 23:07:59 +03:00
kimchy 4492293b49 fix failure in mlt with dates, this does mean that currently, mlt, when based on fetching the source and parsing it, does not do mlt on numbers 2010-03-30 22:46:20 +03:00
kimchy 81c6b9075c MoreLikeThis: Rename fields (rest/http parameter) to mltFields, closes #95. 2010-03-29 16:43:26 +03:00
kimchy 8402738bbe Index aliases ignored for /.../_moreLikeThis, closes #93. 2010-03-29 14:14:23 +03:00
kimchy 3decb2a61e nice(er) code 2010-03-29 11:27:38 +03:00
kimchy a5dc0fcf9a javadoc 2010-03-29 11:03:36 +03:00
kimchy 913a486f99 more work on attachments, have basic types support external set values 2010-03-29 00:19:33 +03:00
kimchy b42245df53 intial support for pluggable type mappers 2010-03-28 18:36:42 +03:00
kimchy f560383b53 intial support for pluggable type mappers 2010-03-28 18:35:25 +03:00
kimchy b799b7a9d7 plugins support + start work on attachments plugin 2010-03-27 23:43:59 +03:00
kimchy 73daff1584 Better exception when failing to create gateway home 2010-03-27 22:10:56 +03:00
kimchy cd12d89dac Better exception when failing to create gateway home 2010-03-27 22:07:22 +03:00
kimchy 59267ce449 more unused field 2010-03-26 21:58:19 +03:00
kimchy 79a930d7ca javadoc 2010-03-26 21:57:47 +03:00
kimchy 9a521e8d98 update benchmark 2010-03-26 20:08:24 +03:00
kimchy 91b463a39a add create flag to benchmark 2010-03-26 18:20:26 +03:00
kimchy be096fcd6f improve moreLikeThis API by using the new get request fields options 2010-03-26 00:44:44 +02:00
kimchy 9c0a37df32 Mapping: Allow to have for a field to not be stored and not indexed, but still be included in `all`, closes #90. 2010-03-25 20:56:45 +02:00
kimchy 5957f580e3 refactor lifecycle components to a shards base class #cleancode 2010-03-25 20:40:37 +02:00
kimchy e5cd594503 Boot-time Mapping Definitions, closes #86. 2010-03-25 13:34:30 +02:00
kimchy 8f324678e8 Index Aliases, closes #88. 2010-03-25 02:00:53 +02:00
kimchy 4851ddde13 if we already have an idset, use it 2010-03-24 01:53:59 +02:00
kimchy f4c94a35d6 Query DSL: Rename `filteredQuery` to `filtered`, closes #85. 2010-03-24 00:37:59 +02:00
kimchy 6a476f440b rename operationThreading method 2010-03-24 00:28:05 +02:00
kimchy 621d222c94 Mapping: Support for short type, closes #84. 2010-03-23 14:20:56 +02:00
kimchy 0a2de7ce5d a test for lucene FieldCache 2010-03-23 12:42:31 +02:00
kimchy 3a322a64b7 a test for lucene FieldCache 2010-03-23 12:41:59 +02:00
kimchy 5b11de8958 clean thread locals (even static ones!) on Server#close or TransportClient#close 2010-03-23 10:31:15 +02:00
kimchy 14af9d28fd sort field can be null (when sorting on score for example), make sure we take it into account when serializing 2010-03-23 08:53:58 +02:00
kimchy 89043b113a better exception when trying to put mappings when no indices exists, closes #79. 2010-03-22 18:03:05 +02:00
kimchy f9cac39024 Terms query is broken, closes #80. 2010-03-22 17:59:34 +02:00
kimchy fa55c40c87 Index FS Store: Allow to cache (in memory) specific files, closes #82 2010-03-22 17:09:03 +02:00
kimchy 267859c784 another test 2010-03-22 13:59:25 +02:00
kimchy 93e025325e Terms API: Support numbers/dates, closes #78. 2010-03-22 02:34:42 +02:00
kimchy bc03d89c00 work on terms api to work properly with number types 2010-03-21 22:38:51 +02:00
kimchy a039a6cc38 add a test for failed from 2010-03-21 16:45:04 +02:00
kimchy 297e2091e2 more improved search result streaming, write a header with shard targets, so each hit just write an id of the targe 2010-03-21 15:09:02 +02:00
kimchy 77564cb14f more improved transport stream size, duplicate strings are serialized once and use handles to deserialize 2010-03-21 10:35:25 +02:00
kimchy 1e455789d0 Search API: Scroll, closes #77. 2010-03-21 01:14:49 +02:00
kimchy 2ae6de2433 fix wrong handling of size and from when passed as request parameters 2010-03-20 23:44:24 +02:00
kimchy de69f5f0fd doc 2010-03-20 21:08:19 +02:00
kimchy 52af5573f1 rename tieBreakerMultiplier to tieBreaker 2010-03-20 18:52:21 +02:00
kimchy 35bd7f0086 fix search hanging because of query parsing exception 2010-03-20 18:45:02 +02:00
kimchy bad8643978 fix wrong parsing of useDisMax with number 2010-03-20 18:13:08 +02:00
kimchy fa1071d090 parse correct enabled flag on all field when passed as number, closes #76 2010-03-20 14:40:24 +02:00
kimchy 671bc4e734 ThreadPool: Rename dynamic to scaling, closes #75. 2010-03-20 03:41:41 +02:00
kimchy fc47bd6f2f ThreadPool: Add a blocking thread pool, closes 74. 2010-03-20 03:25:13 +02:00
kimchy 2551fb9fce change the default opereationThreading on delete/index to true 2010-03-20 03:15:57 +02:00
kimchy 315cc90560 fix test 2010-03-20 02:09:44 +02:00
kimchy 049ce4ffcd better names 2010-03-20 01:25:51 +02:00
kimchy d2bf446d9c better exception handling 2010-03-20 00:55:24 +02:00
kimchy d4dc3cacc1 fix problem with outputting proper error when failing to parse configuration on startup 2010-03-20 00:28:15 +02:00
kimchy a344ebb1b3 Index Analysis: Add language analyzers and stemmers, closes #72 2010-03-19 17:07:43 +02:00
kimchy 45234f4d90 fix compilation warning 2010-03-19 14:19:53 +02:00
kimchy 55cad3208e fix explain failure 2010-03-19 14:15:26 +02:00
kimchy f8a615f9a3 refactor internal transport streams to be more effecient, heavily reduce stream size 2010-03-19 03:04:35 +02:00
kimchy 1ae5a3467f change default recovery buffer to 100k from 16k 2010-03-18 17:28:54 +02:00
kimchy b1e5284a06 Memory Store: change default bufferSize from 1k to 100k, closes #70 2010-03-18 17:27:17 +02:00
kimchy 28b0b5fc30 Search API: Support highlighting, closes #69. 2010-03-18 16:05:24 +02:00
kimchy fc3a805514 NullPointerexception at org.elasticsearch.action.get.GetResponse.sourceAsString, closes #68 2010-03-18 14:08:45 +02:00
kimchy cd2090bc79 more tests 2010-03-18 01:15:26 +02:00
kimchy 1107df9ab6 query parser should take into account using all, since all creates a specialized "term query" which boosts based on the boost level associated with a term. Generalized it so mappers can control when query is used for term query. 2010-03-18 00:53:36 +02:00
kimchy a8be04b334 improve test 2010-03-18 00:29:07 +02:00
kimchy 3a55998a3b Mapper: Ability to disable storing the "source" field, closes #66. 2010-03-17 21:29:44 +02:00
kimchy 6243f4f95b Get API: Allow to specify which fields to load, close #65. 2010-03-17 20:03:32 +02:00
kimchy 4c13a9d548 allow to also store the all field 2010-03-17 13:17:48 +02:00
kimchy d8ef200b4b Shutdown API: allow to shutdown node(s) or the whole, closes #64. 2010-03-17 00:29:36 +02:00
kimchy 1dd5997889 _all field, closes #63. 2010-03-16 23:04:20 +02:00
kimchy 1d2d4674cf stop the timer when closing the http server 2010-03-16 02:18:28 +02:00
kimchy 20877a0c79 upgrade to jackson 1.5 2010-03-14 21:24:47 +02:00
kimchy 1de6509107 optimize fetching when an empty array of fields is provided, in such a case, we only need the uid (id and type) 2010-03-13 17:56:29 +02:00
kimchy 2e8b0464b6 allow to specify mappings in created index (currently, only internally), use it to create the mappings on index creation with recoverying from gateway 2010-03-13 02:42:43 +02:00
kimchy 024cdb4312 wait till the index gets created to create the mappings when recovering from the gateway 2010-03-13 02:14:28 +02:00
kimchy 4e1a1f3437 Mapping metadata not restored from gateway on server restart, closes #57 2010-03-12 18:22:20 +02:00
kimchy 65ed582a90 Mapper : Schema less automatic date detection wrongly detects numbers as dates, closes #60. 2010-03-12 18:16:35 +02:00
kimchy 47c11aa538 Boolean field type does not handle number/string properly when searching, closes #59. 2010-03-12 16:53:11 +02:00
kimchy 6fe329ab69 search json parsing to allow passing numbers/booleans as strings and not native json types 2010-03-12 16:36:31 +02:00
kimchy ef85412f98 fix name 2010-03-12 16:30:30 +02:00
kimchy 471801b484 query/filter json parsing to allow passing numbers/booleans as strings and not native json types 2010-03-12 16:28:37 +02:00
kimchy 86c3a406c6 Java API: Expose source as Map (in GetResponse, SearchHit), allow to index a Map, closes #58. 2010-03-11 16:39:30 +02:00
kimchy 4b04db9030 A search with an empty fields param causes a NullPointerException or a runaway process. Changed logic for an empty fields array, where it won't return the source in this case. Closes #55. 2010-03-10 17:49:47 +02:00
kimchy 7c68489758 Mapping - Support specifying string as number values (for example, for boost), closes #53. 2010-03-10 11:22:57 +02:00
kimchy ae5bcb6d2e Support parsing Strings with numeric types, closes #54 2010-03-10 00:40:11 +02:00
kimchy baaac70da5 get jackson object mapper to support dates as elasticsearch expects them 2010-03-09 17:09:07 +02:00
kimchy 83a78b3979 _count hangs, closes #52 2010-03-09 13:25:17 +02:00
kimchy b13f6b1bdd Mapping - MultiField Mapping, closes #51. 2010-03-07 20:13:59 +02:00
kimchy 290ecd4c95 delete files that are no longer used from the fs gateway 2010-03-05 22:46:15 +02:00
kimchy f4f26d2118 Search API: Query Facet - Add global flag to control if the facet is bounded to the search query or not, closes #50. 2010-03-05 16:05:08 +02:00
kimchy 40b0dfddec count should be cached as a filter 2010-03-05 15:24:04 +02:00
kimchy f1d5b179ce doc 2010-03-05 13:02:36 +02:00
kimchy 51836e0fb6 doc 2010-03-05 12:56:37 +02:00
kimchy e735ff49d6 simpler settings builder api 2010-03-05 12:39:38 +02:00
kimchy 45489ed1af add TimeValue based getter 2010-03-05 01:50:40 +02:00
kimchy 7a38e384c9 wrap checked TimeoutException with runtime ElasticSearchTimeoutException 2010-03-05 01:48:56 +02:00
kimchy 7bf0f1ffca refactor client api, remove execXXX, and simple remain with the actual operation name as the method name, one that returns a future, and one that accepts a listener 2010-03-05 01:39:04 +02:00
kimchy e49a8454a6 fix rest boolean 2010-03-04 18:49:18 +02:00
kimchy 111f9cb751 proper handling of get response (document does not exists) 2010-03-04 15:35:15 +02:00
kimchy c560f1f9f1 wait for status should wait for at least that provided status, for example, waiting for status yellow should return if the status is green 2010-03-04 15:09:11 +02:00
kimchy 5d947ad680 make final 2010-03-03 08:47:22 +02:00
kimchy e276928ebf remove dep on sun 2010-03-03 01:49:25 +02:00
kimchy 03ee0a942d update docs 2010-03-03 00:50:53 +02:00
kimchy 12e2ba822f more docs 2010-03-02 22:16:35 +02:00
kimchy fdd221e8ea Query DSL: queryString - allow to run against multiple fields, closes #48. 2010-03-02 00:42:53 +02:00
kimchy fbf9197b85 make non negative query in query parser 2010-03-01 22:17:17 +02:00
kimchy 7709c68f63 optimize boolean queries when possible 2010-03-01 22:07:14 +02:00
kimchy 4dbc167966 Query DSL: Field Query, closes #47. 2010-03-01 20:10:38 +02:00
kimchy 12e87ba865 allow for * on range queries in query parser 2010-03-01 18:49:14 +02:00
kimchy aef5aa0b33 start work on getting maven working.. 2010-03-01 17:19:07 +02:00
kimchy bd8d52f3f8 move to SNAPSHOT suffix for dev builds, when an actual release will take place, then change the version 2010-03-01 16:30:07 +02:00
kimchy 234a5abda0 merge snakeyaml into source 2010-03-01 15:56:19 +02:00
kimchy 7d3b642326 merge snakeyaml into source 2010-03-01 15:53:15 +02:00
kimchy 7c91e7239b merge snakeyaml into source 2010-03-01 15:51:55 +02:00
kimchy 18a1a5f940 merge snakeyaml into source 2010-03-01 15:50:02 +02:00
kimchy 4c9cf299e6 use existing mapping when merging 2010-03-01 14:25:50 +02:00
kimchy 0ef4000842 more mapping work, ignoreDuplicates renamed to ignoreConflicts 2010-03-01 13:55:47 +02:00
kimchy 568254887f better merge mapping logic, better failure reporting 2010-02-28 12:55:05 +02:00
kimchy c6683d23ef some merge mapping work, tests... 2010-02-28 12:28:48 +02:00
kimchy f51e2cf905 stop the recovery process by interrupting network threads when closing a shard 2010-02-28 11:15:35 +02:00
kimchy 372bdec45f more docs 2010-02-28 01:36:45 +02:00
kimchy bcca36fa67 more docs 2010-02-27 23:37:53 +02:00
kimchy bf3f82c7c8 more docs 2010-02-27 22:03:40 +02:00
kimchy 1f3c038f60 fetch phase in search sould return the full name of the field, and not just the name 2010-02-27 22:00:17 +02:00
kimchy bf7ace79ea whats up? doc... 2010-02-27 19:27:07 +02:00
kimchy a5790cab28 refactor from and size in url to use the new "extraSource" in it 2010-02-27 16:48:01 +02:00
kimchy 948f0ef0da doc doc doc 2010-02-27 16:36:20 +02:00
kimchy 471ad1ed73 expose jgourps.bind_port to use when configuring tcp based discovery in jgroups through settings 2010-02-27 04:34:06 +02:00
kimchy c5a2d497df add _mlt as well for uri 2010-02-27 04:02:07 +02:00
kimchy 8b36281d60 MoreLikeThis API: Search documents that are "like" the specified document, closes #45. 2010-02-27 03:57:36 +02:00
kimchy c30d790609 change the the name to indices boost 2010-02-27 01:37:14 +02:00
kimchy 929bb3f2be have index level query boost part of the search source 2010-02-27 01:26:56 +02:00
kimchy 284a35131c start work on more like this action 2010-02-27 00:52:13 +02:00
kimchy 1ec1716a7b analyzer might end up being null 2010-02-26 15:28:38 +02:00
kimchy e0c3bb5883 Query: support negative queries, closes #44. 2010-02-26 14:44:18 +02:00
kimchy ba0972cde5 upgrade to lucene 3.0.1 2010-02-26 11:59:14 +02:00
kimchy 0ebb74dd9e Query DSL: moreLikeThis & moreLikeThisField, closes #43. 2010-02-26 03:28:44 +02:00
kimchy e70bec79cd fix wrong iteration when getting back terms 2010-02-25 21:34:41 +02:00
kimchy a8af609eba refactor index service into a service package 2010-02-25 20:20:54 +02:00
kimchy 3ef36737f7 wait a bit for assigment to start in test 2010-02-25 18:45:55 +02:00
kimchy 70726b268f add validation on routing table, expose it in cluster health, and add more information when shard start or fail 2010-02-25 18:40:29 +02:00
kimchy f5a4296bf7 improve logging 2010-02-25 09:03:52 +02:00
kimchy 9eaa50ce62 revert escaspe default to true in queryString 2010-02-25 08:46:37 +02:00
kimchy da510f28ab start work on cluster health api, still needs some polising, relates to #42. 2010-02-24 23:16:01 +02:00
kimchy e3af8716ed fix nodes info to accept node(s) ids as well 2010-02-24 22:45:24 +02:00
kimchy c7389df8e0 Query DSL: queryString - allow to escape the string (should be on by default), closes #41. 2010-02-24 22:00:03 +02:00
kimchy bcc52a0173 add calibrateSizeByDeletes option in merge policies 2010-02-24 20:45:15 +02:00
kimchy eb3f8b2f79 fix logging 2010-02-24 18:14:39 +02:00
kimchy 97814e100a add ack flag to create and delete index apis 2010-02-24 01:43:36 +02:00
kimchy 78d9ab103a clean ongoing open index outputs when closing the recovery action 2010-02-24 00:37:05 +02:00
kimchy aa54e9cc35 better handling of open inputs/outputs in case of recovery failure 2010-02-24 00:32:23 +02:00
kimchy d1a4989e84 fix possible node serialization problem (dont share the byte buffer) 2010-02-23 23:37:33 +02:00
kimchy b5544769d2 fix problem when deserializing exceptions thrown from one node to the other 2010-02-23 23:16:02 +02:00
kimchy 54f325ee1a query parser with explicit fields values would not get analyzed 2010-02-23 22:16:12 +02:00
kimchy 07d4166715 removed unused field 2010-02-23 22:04:10 +02:00
kimchy 4cf1b3ed9e read settings (json, yml) using utf8 2010-02-23 21:33:54 +02:00
kimchy 46ff97af5e refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to search) 2010-02-23 21:30:10 +02:00
kimchy defb6a336d refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption (apply to count and delete by query) 2010-02-23 21:22:40 +02:00
kimchy c111e1ab80 refactor json handling to use byte[] instead of string for better performance, storage, and memory consumption 2010-02-23 18:40:22 +02:00
kimchy 8adcbb2832 add a simple test for validating jackson handling of binary data added while generating content 2010-02-22 23:18:45 +02:00
kimchy 3f033a04e7 change toInclusice in terms api to default to true instead of false 2010-02-22 23:03:58 +02:00
kimchy d36f376a8e fix cluster state mapping informaton, return it with the mapping name as key and source field 2010-02-22 21:34:11 +02:00
kimchy 67d86de7ea Gateway: Store cluster meta data in JSON (and not binary), closes #36. 2010-02-22 20:08:33 +02:00
kimchy 575250e223 handle reduce phase failures when searching (raise exception to listener) 2010-02-22 09:26:08 +02:00
kimchy 3d9b310c46 better detailed message 2010-02-22 08:55:36 +02:00
kimchy 98c981d02c don't wrap in broadcast shard excpetion twice 2010-02-22 08:51:47 +02:00
kimchy 086611ce38 add shard header with failures to flush operation 2010-02-22 08:48:20 +02:00
kimchy b05b01d9f8 Terms API: add the ability to return terms as array (termsAsArray flag), defaulting to true since order is important 2010-02-22 01:50:58 +02:00
kimchy 38edf96271 Terms API: add the ability to return terms as array (termsAsArray flag), defaulting to false 2010-02-22 01:48:29 +02:00
kimchy 7cda7eca54 fix spelling 2010-02-22 01:33:37 +02:00
kimchy 0f5ff617f1 when failing to send a message using the transport (connect / serialization), call the response handler with it by default 2010-02-22 01:19:06 +02:00
kimchy 16a7dd137d handle cases when t is null when producing a detailed message for it 2010-02-22 00:05:32 +02:00
kimchy 8c16840fd7 bring back boost mapping support when building mapping source 2010-02-21 23:37:48 +02:00
kimchy 6d52065db3 Mapping Overhaul - More user friendly, cluster aware, closes #34. 2010-02-21 22:57:39 +02:00
kimchy 78e73259a0 put mapping to return the parsed source and an indication if it was ack from all the nodes within the timeout 2010-02-21 17:26:15 +02:00
kimchy 0e55c876a4 rename create mapping to put mapping 2010-02-21 16:49:42 +02:00
kimchy 2201839091 add support to generate json out of the runtime representation of mappings 2010-02-21 14:24:34 +02:00
kimchy ce58723cc5 refactor mapping names into a separate class (Names), create a NamedAnalyzer wrapper which allows to know the logical name the analyzer was created under 2010-02-21 10:28:11 +02:00
kimchy 82e5b7d1c9 when a shard is recovered (from gateway or another shard, sniff mappings from it). Also, improved search load doc perforamnce when no explicit fields are provided 2010-02-21 00:34:54 +02:00
kimchy 2e81730272 add failure reason for broadcast operations (refresh, flush, optimize, ....) 2010-02-20 18:58:44 +02:00
kimchy a828106553 add shard specific failure reason to search operations 2010-02-20 17:35:26 +02:00
kimchy f94ff19f33 don't print fields when the fields map is empty 2010-02-20 15:54:18 +02:00
kimchy 008b00f51a Facet query crashes the cluster. Wrong serialzation of facets caused for construction of a rough sized array list. closes #28. 2010-02-20 15:21:02 +02:00
kimchy fa54b7c896 search operation where only some shards would fail might hang 2010-02-20 04:06:27 +02:00
kimchy 21a1021bdb add the cause to query phase execption 2010-02-20 03:34:42 +02:00
kimchy 1aa8e01184 Allow for the sort search element to speciy the sort fields in an array, closes #30. 2010-02-20 02:48:26 +02:00
kimchy 3f045dee1f Accept also 0 int number to indicate false, and any other number to indicate true (on top of accepting json boolean type), closes #26. 2010-02-20 02:13:06 +02:00
kimchy 4806df426a Boolean Type: Support also cases when a number/string value are passed, closes #33. 2010-02-20 01:50:50 +02:00