Commit Graph

2750 Commits

Author SHA1 Message Date
Austin McKinley e98860dc29 fixing bug when installing local plugins 2011-07-14 00:30:32 +03:00
kimchy bd85d32756 set 0 refresh interval for the test 2011-07-13 08:20:16 +03:00
kimchy 801c7e2483 fix spelling 2011-07-13 08:12:02 +03:00
kimchy c2584baf86 rename json query to wrapper query, and optimize it to not parse it twice, once on creation, and once on parsing to build lucene queries 2011-07-13 03:38:36 +03:00
kimchy cfc45b0ab9 make analyzer request just use field, and allow it to have type.field_name option (or just field name) 2011-07-13 03:15:36 +03:00
melix 8564c20378 Make AnalyzeRequest support field() and type() 2011-07-13 03:07:41 +03:00
melix b627ba06c6 Adds a JSONQueryBuilder which allows using a JSON query string through the Java builder API. 2011-07-13 03:07:40 +03:00
kimchy 1033249f0c Native (java) process memory leak, closes #1118. 2011-07-13 01:46:22 +03:00
kimchy fdbcec8a84 Node Stats: Add number of server open channels for transport and http, closes #1115. 2011-07-12 02:41:18 +03:00
kimchy c04be9d365 return on failure 2011-07-12 00:34:11 +03:00
kimchy 567cf6b5c3 search parse failure should return a 400 status code 2011-07-11 21:49:33 +03:00
kimchy 6be337e184 fix fugly failure message on put index template 2011-07-11 04:10:16 +03:00
kimchy b275e6f798 Closed indices should not cause block failures on some APIs what executing against _all indices, closes #1010. 2011-07-10 23:56:03 +03:00
kimchy 1acca2050c Allow to disable automatic date detection, closes #1051. 2011-07-10 23:44:41 +03:00
kimchy ced90891ab Allow to disable automatic date detection, closes #1051. 2011-07-10 23:41:52 +03:00
kimchy b17c2b09db Allow to disable automatic date detection, closes #1051. 2011-07-10 23:24:23 +03:00
kimchy 882ccf32c8 only use dfs data on main query executed 2011-07-10 23:05:09 +03:00
kimchy e489ad2221 better toString on transport future 2011-07-10 22:56:14 +03:00
kimchy 7ef41eefea Node Info / Stats: Add max_file_descriptors (info) and open_file_descriptors (stats), closes #1113. 2011-07-10 05:13:35 +03:00
kimchy 23a35a0809 add handling a failure of malformed scroll id, and throw back the scroll id itself for simpler debugging 2011-07-10 03:25:34 +03:00
kimchy ca97e19cde upgrade to latest jsr166y version 2011-07-10 02:16:58 +03:00
kimchy 9513dd0a4a fix nested filter to work well with inner nested queries 2011-07-09 22:10:58 +03:00
kimchy 66d5eb94fb fix new analysis components test, and make pattern require parameters 2011-07-08 22:28:26 +03:00
belevian 7e20a9f80a Analysis: expose Lucene PatternReplaceFilter. 2011-07-08 22:00:20 +03:00
belevian 888194e903 Analysis: expose Lucene MappingCharFilter. 2011-07-08 22:00:19 +03:00
kimchy 9464208f83 handle failure on interface check if its up (seems to happen on jdk 7) 2011-07-08 21:58:39 +03:00
kimchy 61ad8b614a TCP: Change the default connect timeout to 2s, closes #1104. 2011-07-08 08:36:47 +03:00
kimchy 893c7df966 add empty index test 2011-07-08 08:02:34 +03:00
kimchy 5a8b27b9dc small optimization to counting search shards 2011-07-08 06:04:33 +03:00
kimchy 0642acd9ac Uneven distribution of search requests across shards, closes 1103. 2011-07-08 05:32:59 +03:00
kimchy 9876fa5a76 improve failure message when not finding _uid field in the doc 2011-07-08 03:56:46 +03:00
kimchy 42edd0c864 Query DSL: nested filter support, closes #1102. 2011-07-08 03:03:09 +03:00
kimchy 9be62a06e9 support also ping.timeout in zen disco, and add it to the sample config 2011-07-08 02:03:09 +03:00
kimchy 6783b7fe18 more work on Improve cleanup of unused shards when index is completely relocated from (#1101) 2011-07-08 01:52:53 +03:00
Igor Motov 3a8f198a76 Improve cleanup of unused shards when index is completely relocated from a node 2011-07-08 01:14:34 +03:00
kimchy 21883716e5 change indices sig 2011-07-07 17:59:25 +03:00
kimchy 429335adf3 upgrade to log4j 1.2.16 2011-07-07 05:36:53 +03:00
kimchy a4c9f11b1c Nested Objects Facets Support, closes #1098. 2011-07-07 04:20:53 +03:00
kimchy 90209d8dff move things around a bit... 2011-07-07 01:38:17 +03:00
kimchy 420ed9daa6 upgrade to testng 6.1.1 2011-07-06 23:15:03 +03:00
kimchy 9ef34f82ea Mapping: non-string type field level boosting, closes #1097. 2011-07-06 22:35:29 +03:00
kimchy 4d3b623923 add include_in_parent and include_in_root explicit flags for nested cases 2011-07-06 21:27:19 +03:00
kimchy 6f7b462f1d java.lang.ArrayIndexOutOfBoundsException when indexing a doc, closes #1094. 2011-07-06 18:57:11 +03:00
Igor Motov c9d619ea4f Remove unnecessary refresh after delete 2011-07-06 17:56:50 +03:00
Lukáš Vlček 3a9613ecc7 Removed unused class 2011-07-06 17:55:37 +03:00
kimchy 3a7f7664b6 Nested Object/Docs Mapping and Searching, closes #1095. 2011-07-06 17:53:55 +03:00
kimchy 19031db447 NPE with mget, closes #1085. 2011-07-02 15:39:37 +03:00
kimchy 317d4f687f fail hashing when using null type or _all 2011-07-01 20:23:19 +03:00
kimchy 0b59c00e0d Upgrade to Lucene 3.3. closes #1083. 2011-07-01 18:30:06 +03:00
kimchy bac6240d17 improve clearing caches in guice 2011-07-01 13:32:23 +03:00
kimchy a8969cd672 Without pre-creating index, heavy write rates OOM with too many threads, closes #1081. 2011-06-30 21:22:21 +03:00
kimchy 4c913693a9 bite the bullet and add guice source, we don't need much from it, and will allow to optimize for our use case as well as remove the AOP support from it 2011-06-30 20:24:16 +03:00
kimchy e78e665273 Zen Discovery: Add `minimum_master_nodes` setting helping with split brains, closes #1079. 2011-06-30 17:02:29 +03:00
kimchy c31ee7d68d add xcontent builder settings option (though just calling builder#string() was always possible) to create index 2011-06-29 15:12:53 +03:00
kimchy 0bf1ed964e fix wrong routing table versioning when deleting an index 2011-06-29 14:51:32 +03:00
kimchy 4139bb5180 Misbehaving "missing" field in facet results, closes #1070. 2011-06-28 12:38:21 +03:00
kimchy f6ebee3785 allow to provide fields for multi get 2011-06-28 11:54:52 +03:00
kimchy 2e83a2f045 clean unused code 2011-06-28 11:37:52 +03:00
kimchy 73898067b8 format 2011-06-28 00:29:06 +03:00
Nicolas Lalevée 759d7d693d Support for highlighting of phrase prefix queries 2011-06-28 00:26:06 +03:00
kimchy ce6fbc687d upgrade to mvel 2.1 Beta5 2011-06-28 00:25:37 +03:00
kimchy 9bf686ef62 Multi GET API, closes #1068. 2011-06-27 22:23:49 +03:00
kimchy 475564449f properly take offset and length into account (introduced with realtime get) 2011-06-27 21:51:14 +03:00
kimchy f851279db1 delegate to the proper source method 2011-06-27 21:38:43 +03:00
kimchy cb0d89700c get shards should use preference as well when routing (fix wrong previous commit) 2011-06-26 23:07:40 +03:00
kimchy 0bbf71188c make broadcast action more extendable by refactoring out type/id 2011-06-26 16:33:44 +03:00
kimchy b670a7f2a3 Indices Segments API: Internal segments info of shard level Lucene indices, closes #1064. 2011-06-26 00:20:50 +03:00
kimchy 7acdda74f4 Transport Client: Adding more nodes causes more scheduled reconnect tasks, closes #1062. 2011-06-24 21:33:24 +03:00
kimchy e373bf09f2 upgrade to joda 1.6.2 2011-06-24 18:42:53 +03:00
kimchy 6521143a38 upgrade to mvel 2.1 Beta4 2011-06-24 18:27:09 +03:00
kimchy c884adf603 more get tests 2011-06-24 15:52:45 +03:00
kimchy 7ed5e9e79a Get API: Make type optional, closes #1061. 2011-06-24 13:43:37 +03:00
kimchy 89a46d1c87 filter out crappy gc reporting 2011-06-24 13:18:16 +03:00
Lukáš Vlček a9a80958ce commented out unused 2011-06-24 10:51:41 +03:00
Lukáš Vlček 2f9a1c7a6a Analysis: expose Lucene StemmerOverrideFilter. Closes #1053 2011-06-24 10:51:41 +03:00
Lukáš Vlček 5913e74286 Analysis: expose Lucene KeywordMarkerFilter. Closes #1052 2011-06-24 10:51:41 +03:00
Igor Motov bae67ca808 Fix NullPointerException when search request partially fails on one or more shards 2011-06-24 09:41:10 +03:00
kimchy 72ee0aaee7 Realtime GET, closes #1060. 2011-06-24 09:39:37 +03:00
kimchy 4547bc3ef4 upgrade to trove 3.0.0rc2 2011-06-20 00:11:28 +03:00
kimchy f3af1fd1d4 upgrade to jackson 1.8.2 (though with not real changes to us) 2011-06-19 20:58:56 +03:00
kimchy 35fa6d93ad Update Settings: Allow to change non dynamic settings on a closed index, closes #1048. 2011-06-19 17:15:05 +03:00
Igor Motov 8470e79aed Fix non-varargs call of varargs method with inexact argument type for last parameter exception warning 2011-06-19 10:10:35 +03:00
Igor Motov 4794345efb Remove unnecessary Thread.sleep calls after alias creation 2011-06-19 10:10:34 +03:00
Igor Motov ae5b963e97 Specify a unique cluster name for all Integration tests 2011-06-19 10:10:34 +03:00
kimchy 5540fbf7ab Delete API: Using refresh parameter might not refresh delete operation on replica, closes #1047. 2011-06-19 09:15:08 +03:00
kimchy 3e9dff8b7e add kstem also to the static shared token filters 2011-06-17 19:23:08 +03:00
Lukáš Vlček aefc3ab3e5 Closes #1041 2011-06-17 16:51:24 +02:00
Lukáš Vlček 44af2cda41 Adding Czech default stopwords into named stopwords map 2011-06-17 13:22:22 +02:00
kimchy dfed1b947e fix bench 2011-06-17 01:19:12 +03:00
kimchy 2e64edd4e7 Parent Child: complex parent child mapping (>2 hierarchy) might fail, closes #1039. 2011-06-17 01:03:34 +03:00
kimchy f5fbe0d66c River might not start properly after cluster shutdown (timing), closes #1038. 2011-06-16 14:04:50 +03:00
Paul_Loy e1514aa8e0 reverted adding IOException to NetworkService, return null if cannot resolve name and log 2011-06-15 22:03:16 +03:00
Paul_Loy 004f91dfc0 add throws IOException to CustomNameResolver interface 2011-06-15 22:03:15 +03:00
Paul_Loy 6a60bbba1d adding ability for gradle to create eclipse project files and classpaths 2011-06-15 22:03:15 +03:00
Igor Motov 1d8b545854 Wait for alias operations to be propagated to all nodes before returning from the call. 2011-06-15 17:16:18 +03:00
kimchy db6f5a7146 Search: When a search request failed completely (all shards fail) return a proper HTTP status code, closes #1035. 2011-06-15 16:28:53 +03:00
kimchy bbd73d5afa Search: When all shards fail on second / third phase, make sure to return a response with proper shard failures, closes #1033. 2011-06-15 15:28:31 +03:00
kimchy b7d492af4b fix synonym filter problem due to refactoring done in analysis components regestrations 2011-06-15 15:13:09 +03:00
kimchy cc39eb76d0 add a narrowing search scan test 2011-06-15 14:11:15 +03:00
kimchy 64bf849cb1 Analyzers for FLT / MLT, closes #1031. 2011-06-15 13:43:10 +03:00
kimchy 11f19ff6da Query DSL: Span Term Query wrongly parses when boost is provided, causing using it in span or to fail, closes #1032. 2011-06-15 13:11:22 +03:00
kimchy 551b98f2f8 fix error message 2011-06-15 12:32:28 +03:00
kimchy fee1747947 also support direct discovery.zen.ping_timeout setting even when it gets extended (like in the case of ec2 disco) 2011-06-14 20:50:05 +03:00
kimchy 8bb448473d more optimizations for sharing same analyzers across different indices on the same node 2011-06-14 18:51:34 +03:00
kimchy bdc0b88c49 Unicast discovery: Improve initial ping connection to nodes to be more lightweight, closes #1028. 2011-06-13 22:19:42 +03:00
kimchy fc17ba1652 allow to nullify routing values when providing then through REST API 2011-06-13 01:23:14 +03:00
kimchy adbe0565f1 validate when setting aliases that index routing does not resolve into several routing values 2011-06-13 01:21:03 +03:00
kimchy fbdf11d3f1 verify that index routing is not, by mistake, composed of several routing values 2011-06-13 01:00:34 +03:00
kimchy 7c67f11e7c when providing explicit routing in index/delete operation, and working against an alias with routing, fail the index operation 2011-06-13 00:41:32 +03:00
kimchy 00e010a52a on dynamic index creation when indexing, we might raise failure on routing (for example), but then not notify the listener 2011-06-12 23:22:12 +03:00
Igor Motov b35dfd3aa7 Add ability to specify routing information for aliases 2011-06-12 22:51:01 +03:00
kimchy 35b4cabed8 try and batch started shards events (causing rerouting) by draining a shared queue (not time based) 2011-06-12 21:35:22 +03:00
kimchy 110c4d0625 add version on a shard replication group level, optimizing both the initial allocation of large number of shards and persistency in case of local gateway 2011-06-12 21:16:58 +03:00
kimchy ffc7f3e12b make sure to initialize the routing table version with the cluster state version as well 2011-06-12 14:39:44 +03:00
kimchy 0eaccd483f Indices exists API, closes #1022. 2011-06-12 12:09:57 +03:00
kimchy 2dbe890022 Indices exists API, closes #1022. 2011-06-12 12:01:29 +03:00
kimchy 5ee6bbfae9 Numeric Types: By default, omit_norms (boosting) is set to true, automatically set it to false if explicit field mapping boosting is provided, closes #1021. 2011-06-12 11:13:06 +03:00
kimchy d4d80525de Numeric values always omit norms (boosting), regardless of the configuration set, closes #1020. 2011-06-12 11:03:43 +03:00
kimchy fd80fcbca0 add separator to several validation failures 2011-06-12 10:34:42 +03:00
kimchy eca244054f Merging complex objects / types (geo, objects) can cause failure to lookup field names (without type prefix), closes #1016. 2011-06-10 20:00:59 +03:00
kimchy 3e1e58e394 add debug logging to print when sigar is not loaded 2011-06-10 17:59:24 +03:00
kimchy 6382ddf43c some improvements to the many indices stess test 2011-06-10 05:12:44 +03:00
kimchy 03dc146928 optimize translog sync to not happen if there is no need for it 2011-06-10 04:58:41 +03:00
kimchy 3b2c186503 improve shutodwn with many indices / shards by bounding the concurrency of closing indices / shards 2011-06-10 03:48:43 +03:00
Erick Tryzelaar b143400bea Fix some typos. 2011-06-10 03:10:09 +03:00
Erick Tryzelaar 112935fcdb Allow fuzzy IP matches to accept a long min_similarity. 2011-06-10 03:10:09 +03:00
kimchy 4b6e2ddd7d add metadata level version, reducing the persistency requirements fo rit 2011-06-10 01:37:20 +03:00
kimchy f87b9e3656 add a version to routing table, so it can be reused when not changed after publishing 2011-06-09 22:51:40 +03:00
kimchy 1d9942847e fix check for dynamic update of a setting in tiered merge policy 2011-06-09 22:25:51 +03:00
kimchy a07030ccf3 improve local shard allocation to utilize same version shards allocation within the same replication group 2011-06-09 10:51:45 +03:00
kimchy 1a0ee00fbb change logging statement to indicate ping_timeout, not initial_ping_timeout 2011-06-08 19:00:02 +03:00
kimchy fff78d6a38 Transport: Improve concurrency when connecting to several nodes, closes #1007. 2011-06-08 18:47:37 +03:00
kimchy 597f3b7a8f throw explicit failure when trying to change the number of shards on an index 2011-06-08 13:49:22 +03:00
kimchy c9d4ce59ce add mime types and a todo 2011-06-06 11:18:12 +03:00
kimchy 4890e43980 Analysis: Add `reverse` and `skip` to `path_hierarchy` tokenizer, closes #999. 2011-06-05 15:39:19 +03:00
kimchy 9652ad0d08 New default merge policy - `tiered`, closes #998. 2011-06-05 14:23:51 +03:00
kimchy 6788c6c375 Upgrade to Lucene 3.2, closes #997. 2011-06-05 01:57:10 +03:00
kimchy c872be75ae make sure to reroute whenever required on the action itself (most already did, added index state case), and then, no need to do additional reroute (which probably does not do anything, and returns the same cluster state) on the routing update handler 2011-06-04 21:43:21 +03:00
kimchy abfc7f0db4 internal refactoring simplifying the type mapping system 2011-06-04 03:56:01 +03:00
kimchy dcd2bbd9a9 ',' can be used in type name, closes #996. 2011-06-04 01:26:41 +03:00
kimchy 5fbb4f7043 simplify plugin registration of custom queries and filters 2011-06-03 06:14:14 +03:00
kimchy f80d1c8fd9 share common query parsers and filter parsers among different indices 2011-06-03 06:02:18 +03:00
kimchy 0a4e582404 Query Parser Module Refactor, closes #994. 2011-06-03 04:32:30 +03:00
kimchy 58330d9c23 Aliases: Validate alias filter before adding it, closes #993. 2011-06-03 02:23:21 +03:00
kimchy 0f1655cf22 Query DSL: Simplify not filter to accept the filter directly, without a wrapping `filter` element, closes #992. 2011-06-03 01:42:57 +03:00
kimchy ec1f0b16f4 remove pretty from parameter when doing update settings 2011-06-02 22:01:51 +03:00
kimchy ee5bfba52f Get Mapping: Better error response when asking for specific index type, closes #991. 2011-06-02 18:30:06 +03:00
kimchy b72ba7d874 remove dead code 2011-06-02 18:23:30 +03:00
kimchy 2bf4a6766e Put Mapping: Fix rare case where the response will timeout (ack=false) even though it has been applied, closes #990. 2011-06-02 18:23:23 +03:00
kimchy e8ba7a7974 d'oh, remove debug out 2011-06-02 12:14:14 +03:00
kimchy 2fad1c4308 remove use of deprecated methods 2011-06-02 12:03:05 +03:00
kimchy 30127d6ed4 remove comment that is no longer relevant 2011-06-02 11:37:37 +03:00
kimchy 6ea2b9d263 Analysis: Improve custom analyzer construction time, closes #989. 2011-06-01 19:37:28 +03:00
kimchy c134233241 Update Settings: Properly ignore settings that are not allowed to be updated dynamically, closes #985. 2011-05-31 22:27:43 +03:00
kimchy 1f17e9d49d Request for more values identified as boolean for the boolean field type - `no`, closes #984. 2011-05-31 20:18:46 +03:00
kimchy 8267a76747 force the type to be set when using the put mapping API in Java 2011-05-31 16:21:59 +03:00
Nicolas Lalevée 198b219baf Remove the useless inner class Clause 2011-05-30 23:37:09 +03:00
Nicolas Lalevée 63ff39425a Simplification of the code with some early dispatching of the clauses before serialization 2011-05-30 23:37:09 +03:00
Nicolas Lalevée 9f52256d8e Produce xcontent compatible with json maps 2011-05-30 23:37:09 +03:00
kimchy 2cd77088f1 protected from changing teh number of shards in update settings 2011-05-30 19:26:45 +03:00
kimchy 31483e4a92 Node Stats: Remove low level transport stats from response, closes #979. 2011-05-30 12:53:03 +03:00
kimchy 2ef4a5e84c fix limit filter to properly handle cross segments cases 2011-05-28 23:14:58 +03:00
kimchy 3025205063 add a flag to allow and disable sites (http.disable_sites) 2011-05-28 19:04:46 +03:00
kimchy 94434a7522 add installed message at the end of a plugin installation 2011-05-28 18:54:45 +03:00
kimchy 4004406c11 add zip to explicit download plugin 2011-05-28 18:47:54 +03:00
kimchy 3652d57667 Plugins: Allow plugins to serve a _site, automatically download github plugins, closes #978. 2011-05-28 18:43:29 +03:00
kimchy 4cd2f79972 Mapping - Date Format: 3 or more custom date formats fail using '||' delimiter, closes #977. 2011-05-28 13:22:20 +03:00
kimchy ae9857cb45 Query DSL: Add limit filter, closes #976. 2011-05-28 12:37:42 +03:00
Bobby T d299672545 Found issue with hidden files attempting to be indexed when mappings being loaded. This allows mappings to skip hidden files.
failed to read / parse mapping [] from location [/opt/elastic/current/config/mappings/n233/.svn], ignoring...
java.io.FileNotFoundException: /opt/elastic/current/config/mappings/n233/.svn (Is a directory)
        at java.io.FileInputStream.open(Native Method)
2011-05-26 23:50:21 +03:00
Igor Motov 3e6a6ffd35 Add support for filtering aliases to MoreLikeThis 2011-05-26 11:47:35 +03:00
Igor Motov 646800cb29 Add support for filtering aliases to DeleteByQuery 2011-05-26 11:47:35 +03:00
kimchy d1d631794d Query DSL: Ids Filter / Query - allow to execute it with no type defined / several types, closes #969. 2011-05-26 11:17:20 +03:00
kimchy c90820e03b Query DSL: `query_string` - Expose QueryParser#setAutoGeneratePhraseQueries, closes #964. 2011-05-26 10:15:35 +03:00
Lukáš Vlček ba1bde64b9 Merge branch 'master' of github.com:elasticsearch/elasticsearch 2011-05-25 16:41:36 +02:00
Lukáš Vlček 1baee8e40f add missing @Override annotation 2011-05-25 16:41:15 +02:00
Nicolas Lalevée a9452bd0e6 Add support for setting the boost to a text query in the Java client 2011-05-25 16:27:56 +03:00
Igor Motov b979af109c Add support for filtering aliases to count 2011-05-25 07:07:08 +03:00
kimchy b76f5150ee Query DSL: `query_string` - Expose QueryParser#setAutoGeneratePhraseQueries, closes #964. 2011-05-25 03:58:59 +03:00
kimchy e022f744ee use AndFilter when there is both an alias filer and a filter 2011-05-25 03:06:03 +03:00
Igor Motov e3bffba327 Add support for filtering aliases to Search 2011-05-25 02:47:47 +03:00
kimchy becf4baaa2 optimize term and terms filter that do no match any documents 2011-05-25 00:16:53 +03:00
kimchy 4711be7061 optimize writing gateway data and reuse streams (if needed) 2011-05-24 15:31:50 +03:00
kimchy 68a56a0b58 optimize generation of rest responses and reduce copying bytes around 2011-05-24 14:12:17 +03:00
kimchy d44a796603 increase default keep alive of cache, management and merge thread pools 2011-05-24 02:21:13 +03:00
kimchy 7ff07ebaf1 Use cache streams to copy over byes, not the byte array 2011-05-24 01:02:43 +03:00
Nicolas Lalevée 123b21f4ae fix the build of a phrase query in the java client 2011-05-24 00:46:42 +03:00
kimchy fe52c5665f better cached stream output logic, and reduce byte array copying when sending a message over the transport 2011-05-24 00:43:24 +03:00
kimchy 45956a5a27 optimize empty cached filters to return null 2011-05-23 04:56:57 +03:00
kimchy b61735d8ea Filter Cache: Introduce new `node` level filter cache and make it default, closes #959. 2011-05-23 04:24:59 +03:00
kimchy e948c366f9 optimize cache recycler memory usage 2011-05-22 18:43:27 +03:00
kimchy 9eb9e738ac remove bytes caching for stream copy 2011-05-22 15:15:44 +03:00
kimchy 32294a4d4f no need for weak keys since readers map gets explicitly cleared 2011-05-22 07:35:22 +03:00
kimchy 6f80e306d6 Field Cache: Allow to set `index.cache.field.expire` when using `resident` type, closes #957. 2011-05-22 07:22:44 +03:00
kimchy 404a8f23de optimize single alias lookup 2011-05-22 07:06:23 +03:00
Igor Motov 3d5d25b03b Add IndexAliasService 2011-05-22 06:59:52 +03:00
kimchy 10de33c94e add explicit filter clears on reader finished 2011-05-22 01:15:23 +03:00
kimchy 0d334bfd03 Scripting - mvel: Fix thread safety misuse when compiling scripts, closes #886. Upgrade to mvel 2.1.Beta3 2011-05-21 21:08:51 +03:00
kimchy d310038701 Shared Gateway: Allow to dynamically update the `snapshot_interval` using update settings, closes #954. 2011-05-21 02:31:24 +03:00
kimchy 9a536b2c2b NPE when using "not" filter, closes #953. 2011-05-20 22:16:43 +03:00
kimchy 811f14465a Scripting: Optimize to native script execution when using just `doc.score`, closes #952. 2011-05-20 18:15:56 +03:00
kimchy 3bafba8904 IBM J9 failure to serialize nodes info, closes #950. 2011-05-20 14:41:03 +03:00
webdevuser 8b1765f5b8 Fix indentation mistake. 2011-05-19 23:59:17 +03:00
webdevuser 18dd9a5f18 Add "articles" setting to specify a list of stopword for the ElisionFilter. 2011-05-19 23:59:16 +03:00
Igor Motov 573114a446 Add an ability to define and store filter for aliases.
This commit only adds an ability to store filter source. The stored filters are not yet used to filter search results.
2011-05-19 19:33:41 +03:00
kimchy d5759efed7 allow for concurrent flushing while indexing 2011-05-19 19:29:02 +03:00
kimchy 1911368feb store the translog id in the commit point data of a lucene commit point. work done towards better concurrency on flush operation 2011-05-19 18:04:22 +03:00
kimchy 0d63fd68a8 fix division by zero error 2011-05-19 13:54:12 +03:00
kimchy 3b5c133c71 Filter Cache: `soft` filter cache can cause bad memory behavior, closes #946. 2011-05-19 13:12:47 +03:00
kimchy ebd95b7eb8 change internal fs translog to be less blocking, and easier to refactor later for better flush concurrency 2011-05-19 11:39:18 +03:00
kimchy ed8d6bbcd3 fix refresh logic after the change to not do it under write lock 2011-05-19 00:36:07 +03:00
kimchy 229c03e33f Analysis: Phonetic filter to support `cologne` encoder, closes #942. 2011-05-18 13:43:10 +03:00
kimchy 44595c06c6 improve custom name resolver logic to allow more options for control 2011-05-18 12:37:16 +03:00
kimchy 3f62c96951 Upgrade to jackson 1.8.1, closes #941. 2011-05-18 12:11:07 +03:00
Igor Motov b4b92a8e7f Move alias metadata from settings to a separate data structure 2011-05-17 23:41:33 +03:00
kimchy bcc3c6dd63 remove unused logger. 2011-05-17 16:57:22 +03:00
kimchy cc0a6ed690 Search: Empty facets element causes search failures, closes #938. 2011-05-17 16:15:45 +03:00
kimchy af222dc75c Analysis: Regression (0.16.1), Camel cased filters / tokenizers failed to load in custom analyzer, closes #937. 2011-05-17 14:20:32 +03:00
kimchy 518488b0b2 auto_expand_replicas: [0-auto] can cause data loss when nodes are removed, closes #934.
This is caused because of a race condition between when to handle the removed node and move a replica to a primary mode, and when to remove the replica because of the 0-auto setting.
2011-05-17 01:41:05 +03:00
kimchy c9aca9c6de upgrade to guava 09 2011-05-16 22:56:10 +03:00
kimchy ff09c19ae6 reuse exists collector 2011-05-16 18:08:04 +03:00
Igor Motov 671b48e007 Fix possible false matches with multiple percolators. 2011-05-16 18:04:03 +03:00
kimchy 30df0d8324 wrong type returned by date_histogram, closes #932. 2011-05-15 17:13:05 +03:00
kimchy c823355014 Deleting and recreating a new index with dynamic mapping can cause type failures, closes #931. 2011-05-15 12:52:17 +03:00
kimchy cb691ef54b add toString to SearchRequestBuilder 2011-05-14 14:52:36 +03:00
kimchy 603d462d4a improve flush concurrency by refreshing outside of the write lock 2011-05-14 00:49:17 +03:00
kimchy c5305a0545 Analysis: Add elision token filter, closes #930. 2011-05-13 15:11:19 +03:00
kimchy f02f63cf75 Mapping: dynamic templates of object type do not initialize some mapping data structures (like analyzers lookup), closes #929. 2011-05-13 14:52:09 +03:00
kimchy d61ba5c189 nicer javadoc 2011-05-13 13:58:56 +03:00
kimchy b531cf03e4 more javadoc 2011-05-13 13:56:20 +03:00
kimchy e4aee9cfbc check for early exit on max expansions on multi suffix terms with prefix, and handle no terms provided 2011-05-13 13:17:24 +03:00
kimchy f659ecc88b Analysis: Pattern Tokenizer, closes #928. 2011-05-13 01:22:22 +03:00
kimchy 03c0a05935 Merge branch 'master' of github.com:elasticsearch/elasticsearch 2011-05-12 00:42:08 +03:00
Igor Motov bc6d9c19e8 Fix double counts when count is executed on two aliases pointing to the same index 2011-05-12 00:29:17 +03:00
Lukáš Vlček 6fe1416173 Fixing Javadoc 2011-05-11 23:08:26 +02:00
kimchy aa9730834f Phonetic Filter : Double Metaphone, partial implementation (not using the secondary code), closes #924. 2011-05-11 22:51:11 +03:00
kimchy 133305da44 Simplified Disable Flush operation, closes #906. 2011-05-11 19:12:50 +03:00
kimchy 176f359e8b Possible failure when using TransportClient (with sniffing), closes #923. 2011-05-11 01:59:14 +03:00
kimchy 8c1171a6ef Mapping: Document's Field level boosting, closes #920. 2011-05-10 23:27:38 +03:00
kimchy 15d8f0b1ac Analysis: Synonym Token Filter, closes #900. 2011-05-10 22:37:33 +03:00
kimchy 1b686d3c2b Analysis: All analysis components that accept stopwords to allow to load stopwords from a file, closes #919. 2011-05-09 14:13:20 +03:00
kimchy 563ad625c0 Analysis: Word Delimiter Token Filter, closes #918. 2011-05-09 02:48:11 +03:00
kimchy 465036655f Query DSL: Text Queries (boolean, phrase, and phrase_prefix), closes #917. 2011-05-08 21:42:25 +03:00
kimchy e66c78ad64 format 2011-05-07 15:04:52 +03:00
kimchy 1565e10d06 allow to set fuzzy factor when merging 2011-05-07 14:56:07 +03:00
kimchy c05df433c6 optimize term creation (reduce interning) 2011-05-07 12:53:24 +03:00
kimchy 7cccacbcfa guard in boolean filter from null doc id sets and iterators 2011-05-06 23:10:21 +03:00
kimchy 3894472f49 Analysis: Stop words config to allow for automatic _lang_ expansion, closes #909. 2011-05-06 01:03:44 +03:00
kimchy 9ab671ed51 fix stop words 2011-05-06 00:46:07 +03:00
kimchy 7f5318e217 fix stop words for spanish analyzer 2011-05-06 00:41:32 +03:00
kimchy 85eae8b3f5 Analysis: Expose light and minimal language token filters, closes #908. 2011-05-05 23:45:59 +03:00
kimchy 0f78100b97 Query DSL: Fuzzy query support for numeric / date types, closes #907. 2011-05-05 16:36:06 +03:00
kimchy dffb11bdbf Query DSL: Fuzzy Query - add max_expansions, closes #905. 2011-05-05 13:46:19 +03:00
kimchy d3076945ac Week Interval on Date Histogram Facet 2011-05-05 01:01:29 +03:00
kimchy 3000dc78fa Failure when applying failed shards during local gateway allocation, closes #903. 2011-05-04 20:49:51 +03:00
kimchy 015e46930d Possible failure to start a river after cluster restart, closes #902. 2011-05-04 20:27:07 +03:00
Igor Motov 0386317aba Remove unnecessary aliasAndIndexToIndex map 2011-05-04 09:50:51 +03:00
kimchy 2b9bdc3796 wrong usage of initial lower/upper bound double aggregators 2011-05-03 16:33:52 +03:00
kimchy 1d2f95857d Sort missing wrongly sorts negative values, closes #772. 2011-05-03 16:16:30 +03:00
kimchy 98dbb46b3c make sure we close the parser even if it failed to parse a search request 2011-04-30 00:10:24 +03:00
kimchy 4558816bcf make sure we close the parser even if it failed to parse a search request 2011-04-30 00:09:36 +03:00
kimchy fcdd2ba11c And/Or Filter: Possible failure when inner filter does not match any docs, closes #892. 2011-04-29 21:45:00 +03:00
kimchy 887ac1fce6 Search: Optimize (perf) execution of global facets, closes #889. 2011-04-28 19:32:13 +03:00
kimchy 2c0bb9199a Search: Optimize (perf) execution of global facets, closes #889. 2011-04-28 17:20:31 +03:00
kimchy 0ab8d1f414 Search API: filter element should not be applied to global facets, closes #888. 2011-04-28 16:16:50 +03:00
kimchy 19448d7775 include_in_all not overridable in objects, closes #883. 2011-04-28 15:44:25 +03:00
kimchy 5c8fe598a6 Scripting - mvel: Fix thread safety misuse when compiling scripts, first go it so use ParserConfiguration, second is a fix in mvel itself, relates to #886. 2011-04-27 00:38:51 +03:00
kimchy 6ecbef463f Create Index API: Better logic to wait for ack for indices being created on nodes, closes #879. 2011-04-27 00:24:27 +03:00
kimchy 6ace8ba0d8 Query DSL: Allow to set boost on has_child query, closes #884. 2011-04-26 20:40:21 +03:00
kimchy f3e032315f (Small) optimization to has_child filter, closes #880. 2011-04-25 17:37:56 +03:00
kimchy 49ac30801e more cache cleaning 2011-04-25 00:16:42 +03:00
kimchy 23c17d7101 improved close logic on index query parser 2011-04-24 23:42:59 +03:00
kimchy 013c4e9fa4 improved cleaning of cached parser context 2011-04-24 23:34:59 +03:00
kimchy 990f371580 better cached streams logic 2011-04-24 23:28:35 +03:00
kimchy 9b262a7363 clean teh lzf buffer recycler 2011-04-24 22:48:38 +03:00
kimchy 1e5dc09848 Unexpected failure to create a shard can lead to data loss if it has no replicas, closes #878. 2011-04-23 13:29:14 +03:00
kimchy 3b07f77f3d clean indices when created just for mapping processing 2011-04-22 16:34:54 +03:00
kimchy 65e05538f0 refresh changed mapping in cluster metadata, this will happen when upgrading from 0.15 to 0.16 2011-04-22 16:07:18 +03:00
kimchy 0319972d77 change logging level to debug 2011-04-22 04:43:23 +03:00
kimchy 6ed2624772 fix wrong closing of possible null mappings in geo point mapping 2011-04-22 04:29:47 +03:00
kimchy d517c3dfef upgrade to jackson 1.8.0 2011-04-22 03:45:56 +03:00
kimchy e171596a6f default replacement char to delimiter char 2011-04-22 03:20:34 +03:00
kimchy 1f89fb26aa upgrade to mvel 2.1.beta2 (not to be confused with Beta2 :) ) 2011-04-22 02:33:39 +03:00
kimchy d8d47abcba no need to cache filters again when handling named filters 2011-04-22 00:37:20 +03:00
Igor Motov 4c295a28d5 Don't attempt to load camelCased version of the package name.
It's unlikely that a package would have a camelCased name and an attempt to load a class with wrong case is causing NoClassDefFoundError instead of ClassNotFoundException on non case-sensitive file systems.
2011-04-21 21:39:17 +03:00
kimchy db04649271 Search request intermittent failures with has_child query/filter, closes #875. 2011-04-21 17:54:01 +03:00
Lukáš Vlček adc3dc0e99 Fix for highlighting when number_of_fragments is set to 0 and term_vector is not set, closes #873 2011-04-21 14:55:21 +02:00
kimchy dedbedbb77 Update Settings: Allow to dynamically set filter cache settings, closes #874. 2011-04-21 14:40:57 +03:00
Lukáš Vlček add6db352d Added test for the highlighting using the source field. (This test probably dropped out in one of previous commits) 2011-04-21 11:55:35 +02:00
kimchy 568dec6b5a Simplify Filter Cache Eviction Settings, closes #871. 2011-04-21 02:05:05 +03:00
kimchy 90b88fe4b7 add TODO optimizations comments 2011-04-21 01:57:28 +03:00
kimchy 9c606c7b1d better caching of LZF streamns 2011-04-20 13:37:30 +03:00
kimchy f5dbcb2fa4 Failure to recover a shard might cause loosing translog data (especially with no replicas), closes #869. 2011-04-20 04:52:47 +03:00
kimchy 3c233347b8 make sure we keep order in mappings when recovering so there won't be reparsing of the mappings on nodes (introduced with faster recovery work done on gateway) 2011-04-20 03:42:51 +03:00
kimchy af39f07213 Mapping: By default, don't index _id, closes #868. 2011-04-20 02:49:14 +03:00
kimchy 3b21759bec Better support with _type is marked as not indexed, allowing to filter by type, closes #866. 2011-04-20 01:31:38 +03:00
kimchy c3f3c268c8 Query DSL: Add ids query and filter to fetch docs by ids (do not require _id field to be indexed), closes #865. 2011-04-20 00:30:30 +03:00
Lukáš Vlček be2a456cc0 improve test: check hits length and zero failures 2011-04-19 21:49:08 +02:00
kimchy 8e027b3baf properly handle cases where filter returns null docIdSet with and/or/not filters 2011-04-19 21:28:08 +03:00
kimchy 5cc943c7db remove some field caching logic, does not seem to do much perf wise, and simplifies back the code 2011-04-19 17:07:32 +03:00
kimchy 56c9783cb3 remove using field cache when indexing string fields for now 2011-04-19 16:16:31 +03:00
kimchy f8ff42d397 log when failing to process doc after index operation 2011-04-19 16:13:26 +03:00
kimchy 79ebcc31c5 double check that there are mappings before trying to call the post process method 2011-04-19 16:10:51 +03:00
kimchy 32127c4d73 register the future with teh listener when deleting an index, so it can be canceled 2011-04-19 15:25:02 +03:00
kimchy e40499f35f small improvement to bulk indexing to not allocated ops if no percolation is done 2011-04-19 13:53:21 +03:00
kimchy 3b82b013d5 eagerly reroute shards when opening an index 2011-04-19 12:56:08 +03:00
kimchy ffc8c3b68a Weird error message on syntax error, closes #864. 2011-04-19 12:23:29 +03:00
kimchy d29754121c don't log a versioning conflict failure, even in DEBUG level 2011-04-19 12:17:11 +03:00
kimchy b94fab34eb Mapping: Allow to set index to `no` for _id and _type, closes #863. 2011-04-17 21:06:46 +03:00
kimchy c4be4975d6 better message 2011-04-17 19:00:45 +03:00
kimchy c2ee6dd120 improve gateway recovery and applying indices, also improve speed of index creation 2011-04-17 18:39:00 +03:00
kimchy 287dc862e0 more options on stress test 2011-04-17 10:14:49 +03:00
kimchy 166493f9d5 properly clean mapper data, and cache some mapping structures 2011-04-17 09:52:29 +03:00
kimchy efb3e97ce4 don't return any id when doesn't exists 2011-04-17 06:21:39 +03:00
kimchy fb35b1c993 clean guice caches after creating injectors so it will take less memory 2011-04-17 05:16:34 +03:00
kimchy 343c80b100 shard tokenizers, token filters, char filters across indices / shards 2011-04-17 03:55:33 +03:00
kimchy 067b8379d5 internal cluster name 2011-04-17 01:45:02 +03:00
kimchy 4907ce4fec intern logger names 2011-04-17 01:20:24 +03:00
kimchy c51b481cc9 revert back to guice 2 2011-04-17 00:58:00 +03:00
kimchy 73e7ea4663 allow to control index indexing concurrency (pretty much internal) 2011-04-16 22:55:12 +03:00
kimchy e8306ac2c8 improve local gateway allocation by caching the started shards when possible and not asking the nodes for it 2011-04-16 22:33:45 +03:00
kimchy 658594fa70 improve gateway initial recovery time by creating the indices, and only after all have been created, do the rerouting 2011-04-16 18:23:48 +03:00
kimchy 763f986a30 Versioning: Better handling of deletes - time based eviction, closes #862. 2011-04-16 17:26:31 +03:00
kimchy 4eddaec8ba change defaults in stress test 2011-04-16 16:57:17 +03:00
kimchy a1796c3408 add an estimated time thread and use it where we don't need exact time 2011-04-16 16:57:02 +03:00
kimchy 2cc4a286f8 small refactor 2011-04-16 03:23:47 +03:00
kimchy 8fa8a72175 add refresh before verifying in the test 2011-04-16 03:20:52 +03:00
kimchy 9927fd4cdd fix none bloom cache to proper name 2011-04-16 03:15:43 +03:00
kimchy 5ab0ec4911 add a concurrent indexing stress test 2011-04-16 03:15:13 +03:00
kimchy 9c85500246 change additionalSettings to use Settings 2011-04-16 01:20:27 +03:00
Igor Motov 785fb11f2a Allow plugins to provide additional settings. 2011-04-16 01:17:23 +03:00
kimchy bba7179eeb automatically clean indices that no longer exists in the metadata, this can happen if we delete a closed index, or when a node joins a cluster, that no longer has those indices 2011-04-14 21:15:55 +03:00
kimchy 897587f981 Allow to delete a closed index, closes #859. 2011-04-14 20:51:20 +03:00
kimchy 7c38f20056 Query DSL: Geo Distance Range filter, closes #856. 2011-04-14 20:20:18 +03:00
kimchy 7874291c0e fix wrong initialization of mem evictions counter 2011-04-14 19:13:14 +03:00
kimchy 1e84c439e5 Shard Allocation: Closed indices are not properly taken into account when rebalancing, closes #858. 2011-04-14 15:00:54 +03:00
kimchy 7550fc570e Query DSL: Allow to directly wrap a query with a constant_score query, closes #857. 2011-04-14 14:19:24 +03:00
kimchy e5c1ab0ca6 add another reroute method to do no assignment but still elect new primaries on failed nodes 2011-04-14 13:43:01 +03:00
kimchy 25eba4b60d Unicast Discovery: Concurrently connect to nodes to improve cases where some listed nodes are not up, closes #855. 2011-04-14 02:27:59 +03:00
kimchy 3b72d63035 EC2 Zen Discovery: Automatically use the configured transport port to ping other nodes, closes #854. 2011-04-14 02:13:27 +03:00
kimchy 853ade7297 Upgrade to jackson 1.7.6 (fixes that long field name smile bug) 2011-04-14 01:36:19 +03:00
kimchy 65fde3e71e only remove shards if they have been started on all other nodes 2011-04-14 01:12:37 +03:00
kimchy 22b5e7ded8 Local Gateway: Listed active shards on each node does apply index deletion, closes #853. 2011-04-13 16:15:26 +03:00
kimchy 41af86dd7e internal option ot pretty print state 2011-04-13 16:04:18 +03:00
kimchy b80324db08 only serialize the cluster state ones when publishing it to multiple nodes 2011-04-13 15:36:28 +03:00
kimchy e9bc7f7d95 River: Failure to reallocate river to another node on rivers node failure, closes #850. 2011-04-12 21:52:02 +03:00
kimchy e8503c1455 Better handling when a shard hits OOM, closes #848. 2011-04-11 21:10:56 +03:00
kimchy decb5fa898 Optimize API: Don't execute concurrent optimize operations (shard level) on the same node, closes #846. 2011-04-10 23:12:00 +03:00
kimchy 7d8726a5e8 Better handling of shard failures, closes #845. 2011-04-10 21:59:59 +03:00
kimchy 8eab5ec528 experiment with lab for filter cache, disabled by default for now, also, move to use soft reference on the whole reader key value, and not per filter (less load) 2011-04-09 20:21:23 +03:00
kimchy b658fba22e allow to copy openbitset into a sliced one 2011-04-09 14:33:16 +03:00
kimchy 991683efa6 remove clearUnreferenced from caches, no longer need it 2011-04-09 14:20:18 +03:00
kimchy 49e2f55abd actually register the eviction listener with soft / resident filter cache 2011-04-09 14:11:42 +03:00
kimchy c934f04b0c remove weak caching of filters and stick with only caching when needed / flagged / defaulted 2011-04-09 02:47:31 +03:00
kimchy b71513a072 JMX: Don't use node id and name as part of the jmx registration, use static org.elasticsearch, closes #843. 2011-04-08 18:49:40 +03:00
kimchy 388f4febba add more terms stats bench 2011-04-07 20:41:20 +03:00
kimchy 93372868a2 fix error when trying to delete all indices and none exists 2011-04-07 20:08:53 +03:00
kimchy ca01dc7a09 Network Settings: Allow to explicitly set ipv4 and ipv4 when using _networkInterface_ notation, closes #841. 2011-04-07 20:01:52 +03:00
kimchy 1fdef91fc2 Allow to search across indices and types even if some types do not exists on some indices, closes #839. 2011-04-07 16:00:18 +03:00
kimchy 4603d10501 faster handling of a case where each doc has multi valued values for different facets, also, don't take into account missing value values (and in the future, we can also count those per bucket if needed) 2011-04-07 15:04:54 +03:00
kimchy b479bc58f9 faster handling of a case where each doc has multi valued values fields in histogram facet 2011-04-07 14:52:25 +03:00
kimchy 7fcf82af80 faster handling of a case where each doc has multi valued values fields in terms stats 2011-04-07 14:44:34 +03:00
kimchy 16a046f686 rename termsstats java facet builder to termsStatsFacet 2011-04-07 14:30:12 +03:00
kimchy 7decb701d9 nicer bench of terms facet 2011-04-07 14:16:21 +03:00
kimchy 7231e08f7c also test terms facet with execution hint of map 2011-04-07 13:32:35 +03:00
kimchy c0879c2055 add bench on nano time 2011-04-06 22:50:36 +03:00
kimchy 08f594c3a0 Get Mapping API: when asking for a mapping of a single index and single type, don't wrap the mapping with the index name, closes #838. 2011-04-06 22:12:34 +03:00
kimchy 8c50a65699 Percolator doesn't work correctly after index recreation, closes #837. 2011-04-06 21:00:49 +03:00
kimchy 6317483fe3 add total count to terms stats and compute mean properly, also better use caching 2011-04-06 15:50:09 +03:00
kimchy 35be46df71 Bug: Sort on a column of type 'short' throws an exception, closes #835. 2011-04-06 02:25:56 +03:00
kimchy 4721f9aa69 fix cache recycling logic to make sure we don't override our own data in facets 2011-04-05 23:25:39 +03:00
kimchy f0de086479 for some reason the copyright header got reformatted 2011-04-05 15:42:12 +03:00
kimchy 6f827731d6 normalize to/from properly in bounded histogram 2011-04-05 15:10:55 +03:00
kimchy 1428abf2b7 Upgrade to jackson 1.7.5 2011-04-05 14:15:48 +03:00
kimchy 9b8eceb229 Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834. 2011-04-05 13:53:19 +03:00
kimchy 14def814fa fix typo 2011-04-05 12:07:46 +03:00
kimchy d845a306fa fill sentinal proeprly when its not in cache 2011-04-05 03:09:33 +03:00
kimchy a89aeb3a6d add JVM mem to node info API 2011-04-05 01:46:09 +03:00
kimchy 83b728a384 rename some histogram collectors 2011-04-05 01:32:36 +03:00
kimchy cea8c5fefa Geo Distance Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #833. 2011-04-05 00:52:58 +03:00
kimchy 79939222e4 Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832. 2011-04-05 00:42:46 +03:00
kimchy 90a339ad5e Date Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #831. 2011-04-05 00:17:07 +03:00
kimchy 8d1e9dbd3c Histogram Facet: Add min/max stats when providing value field / script, closes #830. 2011-04-04 23:48:54 +03:00
kimchy 46088b9f8a Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829. 2011-04-04 21:30:46 +03:00
kimchy 58c606d6d9 break field data value iterator into two callback types, one with support for missing, and one without 2011-04-04 19:53:09 +03:00
kimchy c9838d5c75 use cache recycler for count histo and data histo facets 2011-04-04 19:44:46 +03:00
kimchy 105d60ac9c Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824. 2011-04-04 17:44:38 +03:00
kimchy 5d6e84f206 Upgrade Lucene 3.1: Analyzers, closes #826. 2011-04-04 14:36:13 +03:00
kimchy 4e4495ff1d Upgrade to Lucene 3.1, closes #825. 2011-04-04 12:54:15 +03:00
kimchy db1dcaded3 Concurrent calls to refresh might result in "dangling" searchers, closes #823. 2011-04-01 22:43:48 +03:00
kimchy 1280512097 also support regex pattern matching with ordinals 2011-04-01 16:54:37 +03:00
kimchy e4cbdfa05b Terms Facet: Performance improvements, closes #822. 2011-04-01 16:30:45 +03:00
kimchy fb8a389380 more bench work 2011-03-31 18:25:23 +02:00
kimchy 44d4474f95 anoter small bench 2011-03-31 17:48:57 +02:00
kimchy a0cddf0745 small improvement to stats facet computing min/max 2011-03-31 17:41:21 +02:00
kimchy 3ff35d42b5 Indexing Buffer: Automatically inactivate unindexed into shards and lower their indexing buffer size, closes #821. 2011-03-31 17:03:37 +02:00
kimchy 09d3b882f0 more small bench 2011-03-31 02:30:17 +02:00
kimchy 74838fe1aa Translog: Reduce the number of translog ops to flush after from 20000 to 5000, closes #820. 2011-03-31 01:09:03 +02:00
kimchy 14d98a7319 Shard Allocation: Add node_initial_primaries_recoveries setting, closes #819. 2011-03-31 01:04:09 +02:00
kimchy f90b4e6fee some more micro bench support 2011-03-30 23:32:33 +02:00
kimchy ae0eed937b update to the new lzf compression (0.7) 2011-03-30 20:43:20 +02:00
kimchy 2dd5094d37 Shard Allocation: Rename cluster.routing.allocation.concurrent_recoveries to cluster.routing.allocation.node_concurrent_recoveries (old one still works), closes #817. 2011-03-30 15:43:56 +02:00
kimchy 7ce7fb33e5 Shard Allocation: Allow to control how many cluster wide concurrent rebalance (relocation) are allowed, default to 3, closes #816. 2011-03-30 15:40:11 +02:00
kimchy 8a5dd90885 HTTP: Support compression (gzip, deflate) when using Accept-Encoding header, closes #815. 2011-03-30 14:46:39 +02:00
kimchy eafe686013 warm up with compression bench 2011-03-30 13:52:52 +02:00
kimchy fdbccf28b0 Shard Allocation: Add a setting to control when rebalancing will happen based on the cluster wide active shards state, closes #814. 2011-03-30 12:56:53 +02:00
kimchy 9bb0bcf4e3 add logging when trying to obtain node lock 2011-03-29 21:34:15 +02:00
kimchy 0069d5a75d add adler to checksum, faster and is good enough with length check for our use case 2011-03-29 21:27:18 +02:00
kimchy a1be2bbf20 add adler to checksum tests 2011-03-29 18:17:09 +02:00
kimchy 3138269573 Indices Status API: Add refresh stats, closes #811. 2011-03-29 17:54:00 +02:00
kimchy 2a032f8718 add remote many indices creation test 2011-03-29 17:17:54 +02:00
kimchy 0e6bbf3f85 call shard refresh API and not directly the engine one 2011-03-29 17:17:39 +02:00
kimchy ff8dc2673f Get Settings API: Allow to retrieve (just) a specific index / indices settings, closes #810. 2011-03-29 13:50:25 +02:00
kimchy 508d1d40fb Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809. 2011-03-29 13:05:36 +02:00
kimchy 95e36a073a move index/delete refresh to happen outside of the engine 2011-03-29 01:28:37 +02:00
kimchy 53935f078a optimize array list creation with exact size 2011-03-28 21:50:39 +02:00
kimchy 49f79f54d2 log when search failure happen when scanning 2011-03-28 18:17:36 +02:00
kimchy f00664621f more scan tests to try and recreate the context missing failure, no luck yet... 2011-03-28 17:21:59 +02:00
kimchy e0d8094f3d clear listeners only if not null (can cause failure to properly close a shard), also, do the CLOSE check if to reschedule within the sync block 2011-03-28 17:20:07 +02:00
kimchy 953a99c75c fix a bug in new checksum mechanism that caused for replicas not to retain the _checksums file. Also, now that checksums are widely used, consider files without checksums as ones that need to be recovered 2011-03-28 16:08:01 +02:00
kimchy 64a89eb0e4 add the ability to control the number of shards and replicas in the restart stress test, also add a step to verify version numbers 2011-03-28 14:21:49 +02:00
kimchy af419cc636 upgrade to guice 3.0 2011-03-27 19:31:51 +02:00
kimchy b28461dd0e compress cluster state when publishing it 2011-03-24 01:12:36 +02:00
kimchy 992becf013 add value_script as an option to terms stats 2011-03-24 01:03:17 +02:00
kimchy f20c6ec9cf check if index service is null, and don't load percolators in this case 2011-03-24 00:40:21 +02:00
kimchy 36edcef640 compress metadata stored in gateway 2011-03-24 00:38:16 +02:00
kimchy 4f27fa3f45 add the version to the jvm info, and, warn if running using the client vm 2011-03-23 18:06:29 +02:00
kimchy 20593fb966 Mapping: Add _size field mapping, indexing the original source size, closes #804. 2011-03-23 17:37:40 +02:00
kimchy b2d7cd78b7 don't clean up indices if there is a block disabling persistence 2011-03-22 18:41:29 +02:00
kimchy 8c9000c54c Extend stats API to include filter's cache count and eviction count, closes #802. 2011-03-22 13:30:14 +02:00
kimchy e759b4c971 Add option to expire filter's cache based on access time, closes #803. 2011-03-22 13:14:31 +02:00
kimchy 0d150e6918 Date Field Mapper: Allow to use timestamp value (milliseconds since epoch, UTC), closes #801. 2011-03-22 01:29:41 +02:00
kimchy 9f44c93a25 make sure to log failures in search when reducing results 2011-03-22 01:05:54 +02:00
kimchy 61034f5c86 Mapping: Failure to update _source mapping - compress and compress_threshold, closes #800. 2011-03-21 18:10:13 +02:00
kimchy 8f8fb89c4e Update Settings: Allow to control `index.auto_expand_replicas`, closes #799. 2011-03-21 16:18:03 +02:00
kimchy 2f1aba962c add the exception as well to the logging 2011-03-21 14:36:56 +02:00
kimchy 6c241f3de8 protected against a wrong format in the index.auto_expand_replicas setting 2011-03-21 14:36:28 +02:00
kimchy d2e61af9ee maintain total hits across scan scroll requests 2011-03-20 00:19:26 +02:00
kimchy 52c750fc42 internal support for custom attributes in scroll id 2011-03-19 21:51:18 +02:00
kimchy f3160b71bb can't check on token value, since it might be valid, so, handle the null token case better 2011-03-19 21:34:31 +02:00
kimchy c19a93da89 countDown the latch if no need to delete percolator, introduced when added delete to percolated queries when deleting an index 2011-03-19 21:28:17 +02:00
kimchy fb7fbc8c83 NPE when the JSON to index doesn't match the mapping's expectations, closes #795. 2011-03-19 20:42:50 +02:00
kimchy 70fc8d9af0 Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793. 2011-03-19 00:24:20 +02:00
kimchy bd3f490d60 Delete IndexAPI: Allow to delete more than one index or _all indices, closes #791. 2011-03-18 20:44:59 +02:00
kimchy 09fbc919b8 "exclude" functionality missing for terms facet on numeric fields, closes #789. 2011-03-18 11:08:11 +02:00
kimchy 923fcf239c Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790. 2011-03-18 10:49:28 +02:00
kimchy 616b3dcb18 shard the default analyzer (standard) on the node level 2011-03-18 01:35:29 +02:00
kimchy 25124b084b Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787. 2011-03-17 22:01:22 +02:00
kimchy 96d06d6dc8 Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781. 2011-03-15 21:22:46 +02:00
kimchy 0291ab1d8d sync version when getting the state from master 2011-03-15 14:15:16 +02:00
kimchy 1bcd3b67ee Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769. 2011-03-14 11:30:01 +02:00
kimchy 3192654e80 add iterator based on specific index 2011-03-13 19:51:21 +02:00
kimchy 96dfdcf97c Bulk Request: Streamline parameters names to be the same as the single REST request, closes #778. 2011-03-13 11:43:30 +02:00
kimchy 700a2a9577 Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772. 2011-03-13 02:29:05 +02:00
kimchy 7c04ef6cbc use byte value 2011-03-13 00:51:12 +02:00
kimchy 09006f17c3 Support true|false for the 'store' parameter in mappings, closes #775. 2011-03-13 00:41:58 +02:00
kimchy 6d108e77f1 handle whitespace text on search fields query string parameter to be treated as no fields 2011-03-13 00:37:25 +02:00
kimchy aff8a4407f better exception message 2011-03-13 00:31:21 +02:00
kimchy bdb0fd23e9 Versioning: Add a new version_type parameter, with a new type - `external`, closes #776. 2011-03-12 20:41:55 +02:00
kimchy 7bab5270fc add a comment on max shard buffer size 2011-03-12 17:17:02 +02:00
kimchy 73dec5d63f Add `max_shard_index_buffer_size` to control the upper limit of a shard indexing buffer size (defaults to `512mb`), closes #773. 2011-03-12 17:03:04 +02:00
kimchy 19052a3538 Add another flag to gateway if it even requires snapshot, so we don't try and snapshot on shutdown for none/local gateway (even though its a no op) 2011-03-11 15:20:16 +02:00
kimchy 3e624bf9e0 better failure when trying to obtain a native lock on the node data location, and reduce the tries from 100 to 50. 2011-03-11 15:05:22 +02:00
kimchy e1c86b86e5 add simplified ways to create XContentBuilder that will output to OutputStream using XContentFactory 2011-03-10 16:00:19 +02:00
kimchy 0df3dfd72b add the ability to set source and extra source on the SearchRequestBuilder 2011-03-09 21:55:46 +02:00
kimchy 80a797fc4f Update Settings: Allow to dynamically update `index.translog` settings, closes #765. 2011-03-09 14:17:34 +02:00
kimchy c2a0e0b767 Mapper: Using `dynamic_template` can result in warning of parsed and original source difference (resulting in excessive mapping parsing), closes #764. 2011-03-09 11:36:51 +02:00
kimchy f694b9dfd8 Percolator: Failures when using docs where fields repeat, such as arrays, closes #763. 2011-03-09 11:31:05 +02:00
kimchy ad0d681b6d Update Settings: Allow to dynamically change `index.term_index_interval` and `index.term_index_divisor, closes #762. 2011-03-09 07:36:18 +02:00
kimchy 353d2cb21f Mvel Script: add more random options, and optimize random, closes #759. 2011-03-08 22:24:22 +02:00
kimchy 016e5bce04 Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758. 2011-03-08 21:53:33 +02:00
kimchy 77cf3e1924 small refactor in index settings, allowing for future dynamic changes to it 2011-03-08 11:12:40 +02:00
kimchy e709a0bde4 Logging: Add merge level logging, closes #755. 2011-03-08 08:20:48 +02:00
kimchy 9e2143f343 add a warning for types not to include dots (can't really throw a failure because of it since it will break backward) 2011-03-07 19:17:39 +02:00
kimchy 4bdae621f9 Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752. 2011-03-07 13:09:07 +02:00
kimchy 1242cf59f6 upgrade to guice 3 rc3 2011-03-07 06:52:55 +02:00
kimchy cb912de255 ignore engine closed exception as well 2011-03-05 10:46:00 +02:00
kimchy f0825414d3 upgrade to jackson 1.7.4 2011-03-05 10:45:20 +02:00
kimchy bc882182ab change scripts to start the ElasticSearch main class (a wrapper around Bootstrap) just so the process name will look nicely on jps 2011-03-04 20:14:22 +02:00
kimchy c097735196 improve async merge process, don't spawn a thread unless a merge is really needed, and add an optimized "maybeMerge" operation 2011-03-04 20:05:52 +02:00
kimchy 20ed540fe7 don't block node master node startup if recover_after_time is set and nodes settings are not met (we already handle it with the not recovered state) 2011-03-04 05:11:28 +02:00
kimchy 4b92928c77 Internal: Improve checksum process by bulk writing them into a single file instead of checksum file per index file, closes #747. 2011-03-04 04:22:47 +02:00
kimchy b629d36d8b add a merge thread pool that only does async merges (optimize), so it can be controlled by itself 2011-03-04 01:04:59 +02:00
kimchy 06ad13f373 no need to call maybe merge as part of flush, we do it async anyhow 2011-03-04 00:56:34 +02:00
kimchy 607ada75a6 optimize the index status response 2011-03-04 00:55:39 +02:00
kimchy 41ddcdca93 Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:26:47 +02:00
kimchy f901429aaa Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:20:05 +02:00
kimchy 682ad7e2fc Indices Status / Node Stats: Add (Lucene) index merge stats, closes #745. 2011-03-03 23:53:28 +02:00
kimchy 2909060af8 Query DSL: flt_field does not allow to set min_similarity and prefix_length, closes #744. 2011-03-03 04:17:02 +02:00
kimchy 78c6f951a3 All Field: All field cane fail to analyze input data (rare cases), closes #743. 2011-03-03 02:59:27 +02:00
kimchy 68c1dd771c upgrade to mvel 2.1 beta2 2011-03-02 22:37:36 +02:00
kimchy 4631df9d01 Delete API: Allow to set _parent on it (will simply set the routing value), closes #742. 2011-03-02 22:14:49 +02:00
kimchy 655cbb9440 improve failure when disabling dynamic creating of types, and trying to index into a non existing type 2011-03-02 20:42:43 +02:00
kimchy faefc772a4 Searching while an index is being allocated and no active shards exists within a "shard replication group" can cause search "misses", closes #736. 2011-03-02 05:11:02 +02:00
kimchy bb1668c2b7 count date histo using the wrong counts aggregator to return results when using time based setting interval 2011-03-02 03:13:25 +02:00
kimchy 3361a9365b since we now take all#enabled into account when checking for include_in_all, there is no need to set it on every mapper 2011-03-02 03:01:01 +02:00
kimchy 185cd68045 really fix time format interval for date_histogram now 2011-03-02 00:39:18 +02:00
kimchy 1d240aaff6 prefix inside a dis_max / bool query broken, closes #732. 2011-03-02 00:36:30 +02:00
kimchy ce862da8f4 add tests for boosted wildcard and prefix queries 2011-03-02 00:26:49 +02:00
kimchy 9560451896 optimize query facet to extract filter from constant_score queries automatically 2011-03-02 00:18:26 +02:00
kimchy 60b423b741 Don't "double" cache a facet filter / query facet, closes #734. 2011-03-01 22:14:36 +02:00
kimchy 0e30ad90f5 support 'w' as suffix for time format 2011-03-01 20:16:18 +02:00
kimchy 0183516221 better failure message 2011-03-01 05:34:21 +02:00
kimchy e639ffbc93 Search: Allow to use has_child filter in facets, closes #730. 2011-03-01 04:45:25 +02:00
kimchy 6097365738 eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729. 2011-03-01 00:49:41 +02:00
kimchy 9d81d01c93 only flush when the index shard is in STARTED mode (nothing will break flushing on non started index, just remove a possible warn logging) 2011-03-01 00:26:03 +02:00
kimchy 0662f65fda log warning when failing to list started shards on other nodes when doing local gateway allocation 2011-03-01 00:25:03 +02:00
kimchy 906ec57f20 Ids with # in them will cause search failures, also, fail when # is used in a type name, closes #728. 2011-02-28 22:43:48 +02:00
kimchy 3bac33e69e don't use AfterTest / BeforeTest in any tests 2011-02-28 22:28:55 +02:00
kimchy 24199a3394 add simple unicast disco test on hte node level 2011-02-28 21:43:31 +02:00
kimchy 47a6065805 Date Histogram Facet: NPE if using "1w" interval, closes #727. 2011-02-28 20:31:02 +02:00
kimchy d395c0a844 better failure message when failing to find a type mapping for a document loaded from the index 2011-02-28 20:21:47 +02:00
kimchy 3b967040da Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725. 2011-02-27 01:06:50 +02:00
kimchy fdef88debb Bulk API: Improve memory usage when executing large bulk requests, closes #724. 2011-02-26 23:46:22 +02:00
kimchy 3cda177b9b Zen Discovery: Rename `discovery.zen.initial_ping_timeout` to `discovery.zen.ping_timeout` (still support the old setting), closes #723. 2011-02-26 22:25:26 +02:00
kimchy 4634ca5cb8 Mapping: When _all is disabled, optimize to not gather all entries, closes #722. 2011-02-26 04:16:03 +02:00
kimchy 608c5a838d Index Filter Cache: Add `resident` type, and `max_size` to `soft`/`weak` types, closes #721. 2011-02-25 03:54:18 +02:00
kimchy ecc1a3cd8c Acknowledge problem for put mapping with multiple indices or all indices, closes #720. 2011-02-24 21:17:24 +02:00
kimchy 4def1f4b8e upgrade to google guava r08 2011-02-24 08:49:38 +02:00
kimchy 8a03ca1114 Search: Allow to filter out docs based on a minimum score, closes #719. 2011-02-24 06:55:16 +02:00
kimchy a0fd47159e improve internal scan handling, by using count type for the first scan 2011-02-24 01:04:49 +02:00
kimchy ee9beda398 Search: Add search_type for `count` to return count but still support facets, closes #718. 2011-02-24 00:29:42 +02:00
kimchy f7100c0698 Improve from hits pagination (duplicates), closes #717. 2011-02-23 22:57:44 +02:00
kimchy 6b7192e744 add from/to test without sorting on single shard 2011-02-23 21:41:31 +02:00
kimchy 5082ad6d11 Clear Cache API: Add specific cache clear for `id`, `filter`, `field_data`, `bloom`, closes #716. 2011-02-23 21:17:09 +02:00
kimchy 8371920a89 add min/max to terms stats facet 2011-02-23 20:36:12 +02:00
kimchy be1b46061e add filter and scope parameters when creating terms stats facet 2011-02-23 19:37:20 +02:00
kimchy 8617e3b0e3 enhance memory usage when doing reduce on histogram facets 2011-02-23 05:55:23 +02:00
kimchy 9cccfc3bd3 improve terms stats facet internal data structure and sorting 2011-02-23 05:04:45 +02:00
kimchy 2845cbefaa move to mvel 2.1.beta1 (versioning changed from 2.1.rc1) 2011-02-23 02:32:56 +02:00
kimchy 1a48007174 Single node cluster comes up as red with local gateway, closes #714. 2011-02-23 01:21:17 +02:00
kimchy 58dbf6d5ca fix terms facet TOTAL comparator to also do secondary sort when totals are equal 2011-02-23 00:55:40 +02:00
kimchy c6f58321e4 Node Stats: Add number of docs per node, closes #713. 2011-02-22 22:27:12 +02:00
kimchy 45ec2c6e21 Allow to register custom rivers under a custom type name (And not full class names), closes #712. 2011-02-22 22:13:31 +02:00
kimchy 06850f8673 add another test to scan 2011-02-22 21:01:11 +02:00
kimchy 7dda421cfa River not recovered when using single node after shutdown, closes #711. 2011-02-22 20:38:52 +02:00
kimchy 953fcbc58c Get API: Allow to provide a script as a field, closes #708. 2011-02-22 02:28:19 +02:00
kimchy 818f3b4d75 Search: Add search type `scan` allowing to efficiently scan large result set, closes #707. 2011-02-22 00:11:31 +02:00
kimchy 65ca857027 Add `http` and `transport` simplified host settings, closes #706. 2011-02-21 19:51:18 +02:00
kimchy be372bee7d ignore a case where we can't find an index trying to apply shards, it gets deleted on us 2011-02-20 02:04:44 +02:00
Benoit Sigoure fcdd103345 Simplify some error-handling logic a bit. 2011-02-20 00:45:25 +02:00
kimchy d76f12a9f3 return 0 as prefix / suffix content length for utf8 response 2011-02-20 00:18:48 +02:00
kimchy 352cb74f96 Search: Terms Stats Facet, closes #705. 2011-02-19 23:37:04 +02:00
kimchy 745614f53d notify listener on failure 2011-02-19 23:19:02 +02:00
kimchy d3ba8bd487 use parsing field to check for order 2011-02-19 01:41:48 +02:00
kimchy d7a02fb28f Handle cluster join request on a non IO thread, closes #702. 2011-02-18 23:46:15 +02:00
kimchy 9ac048c68c add "same" thread pool type (really, just for testing) 2011-02-18 07:59:14 +02:00
kimchy 585c310aa4 add edge histogram test 2011-02-18 07:35:33 +02:00
kimchy d8bec39b73 more support for wares 2011-02-18 05:03:46 +02:00
kimchy 8d867dc24c explicitly set the cat under which jdk logging is logged 2011-02-18 05:00:08 +02:00
kimchy 60578aef4d add name as another setting to set on snowball, not just language 2011-02-17 22:22:34 +02:00