Commit Graph

1926 Commits

Author SHA1 Message Date
kimchy 36edcef640 compress metadata stored in gateway 2011-03-24 00:38:16 +02:00
kimchy 4f27fa3f45 add the version to the jvm info, and, warn if running using the client vm 2011-03-23 18:06:29 +02:00
kimchy 20593fb966 Mapping: Add _size field mapping, indexing the original source size, closes #804. 2011-03-23 17:37:40 +02:00
kimchy b2d7cd78b7 don't clean up indices if there is a block disabling persistence 2011-03-22 18:41:29 +02:00
kimchy 8c9000c54c Extend stats API to include filter's cache count and eviction count, closes #802. 2011-03-22 13:30:14 +02:00
kimchy e759b4c971 Add option to expire filter's cache based on access time, closes #803. 2011-03-22 13:14:31 +02:00
kimchy 0d150e6918 Date Field Mapper: Allow to use timestamp value (milliseconds since epoch, UTC), closes #801. 2011-03-22 01:29:41 +02:00
kimchy 9f44c93a25 make sure to log failures in search when reducing results 2011-03-22 01:05:54 +02:00
kimchy 61034f5c86 Mapping: Failure to update _source mapping - compress and compress_threshold, closes #800. 2011-03-21 18:10:13 +02:00
kimchy 8f8fb89c4e Update Settings: Allow to control `index.auto_expand_replicas`, closes #799. 2011-03-21 16:18:03 +02:00
kimchy 2f1aba962c add the exception as well to the logging 2011-03-21 14:36:56 +02:00
kimchy 6c241f3de8 protected against a wrong format in the index.auto_expand_replicas setting 2011-03-21 14:36:28 +02:00
kimchy d2e61af9ee maintain total hits across scan scroll requests 2011-03-20 00:19:26 +02:00
kimchy 52c750fc42 internal support for custom attributes in scroll id 2011-03-19 21:51:18 +02:00
kimchy f3160b71bb can't check on token value, since it might be valid, so, handle the null token case better 2011-03-19 21:34:31 +02:00
kimchy c19a93da89 countDown the latch if no need to delete percolator, introduced when added delete to percolated queries when deleting an index 2011-03-19 21:28:17 +02:00
kimchy fb7fbc8c83 NPE when the JSON to index doesn't match the mapping's expectations, closes #795. 2011-03-19 20:42:50 +02:00
kimchy 70fc8d9af0 Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793. 2011-03-19 00:24:20 +02:00
kimchy bd3f490d60 Delete IndexAPI: Allow to delete more than one index or _all indices, closes #791. 2011-03-18 20:44:59 +02:00
kimchy 09fbc919b8 "exclude" functionality missing for terms facet on numeric fields, closes #789. 2011-03-18 11:08:11 +02:00
kimchy 923fcf239c Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790. 2011-03-18 10:49:28 +02:00
kimchy 616b3dcb18 shard the default analyzer (standard) on the node level 2011-03-18 01:35:29 +02:00
kimchy 25124b084b Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787. 2011-03-17 22:01:22 +02:00
kimchy 96d06d6dc8 Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781. 2011-03-15 21:22:46 +02:00
kimchy 0291ab1d8d sync version when getting the state from master 2011-03-15 14:15:16 +02:00
kimchy 1bcd3b67ee Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769. 2011-03-14 11:30:01 +02:00
kimchy 3192654e80 add iterator based on specific index 2011-03-13 19:51:21 +02:00
kimchy 96dfdcf97c Bulk Request: Streamline parameters names to be the same as the single REST request, closes #778. 2011-03-13 11:43:30 +02:00
kimchy 700a2a9577 Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772. 2011-03-13 02:29:05 +02:00
kimchy 7c04ef6cbc use byte value 2011-03-13 00:51:12 +02:00
kimchy 09006f17c3 Support true|false for the 'store' parameter in mappings, closes #775. 2011-03-13 00:41:58 +02:00
kimchy 6d108e77f1 handle whitespace text on search fields query string parameter to be treated as no fields 2011-03-13 00:37:25 +02:00
kimchy aff8a4407f better exception message 2011-03-13 00:31:21 +02:00
kimchy bdb0fd23e9 Versioning: Add a new version_type parameter, with a new type - `external`, closes #776. 2011-03-12 20:41:55 +02:00
kimchy 7bab5270fc add a comment on max shard buffer size 2011-03-12 17:17:02 +02:00
kimchy 73dec5d63f Add `max_shard_index_buffer_size` to control the upper limit of a shard indexing buffer size (defaults to `512mb`), closes #773. 2011-03-12 17:03:04 +02:00
kimchy 19052a3538 Add another flag to gateway if it even requires snapshot, so we don't try and snapshot on shutdown for none/local gateway (even though its a no op) 2011-03-11 15:20:16 +02:00
kimchy 3e624bf9e0 better failure when trying to obtain a native lock on the node data location, and reduce the tries from 100 to 50. 2011-03-11 15:05:22 +02:00
kimchy e1c86b86e5 add simplified ways to create XContentBuilder that will output to OutputStream using XContentFactory 2011-03-10 16:00:19 +02:00
kimchy 0df3dfd72b add the ability to set source and extra source on the SearchRequestBuilder 2011-03-09 21:55:46 +02:00
kimchy 80a797fc4f Update Settings: Allow to dynamically update `index.translog` settings, closes #765. 2011-03-09 14:17:34 +02:00
kimchy c2a0e0b767 Mapper: Using `dynamic_template` can result in warning of parsed and original source difference (resulting in excessive mapping parsing), closes #764. 2011-03-09 11:36:51 +02:00
kimchy f694b9dfd8 Percolator: Failures when using docs where fields repeat, such as arrays, closes #763. 2011-03-09 11:31:05 +02:00
kimchy ad0d681b6d Update Settings: Allow to dynamically change `index.term_index_interval` and `index.term_index_divisor, closes #762. 2011-03-09 07:36:18 +02:00
kimchy 353d2cb21f Mvel Script: add more random options, and optimize random, closes #759. 2011-03-08 22:24:22 +02:00
kimchy 016e5bce04 Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758. 2011-03-08 21:53:33 +02:00
kimchy 77cf3e1924 small refactor in index settings, allowing for future dynamic changes to it 2011-03-08 11:12:40 +02:00
kimchy e709a0bde4 Logging: Add merge level logging, closes #755. 2011-03-08 08:20:48 +02:00
kimchy 9e2143f343 add a warning for types not to include dots (can't really throw a failure because of it since it will break backward) 2011-03-07 19:17:39 +02:00
kimchy 4bdae621f9 Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752. 2011-03-07 13:09:07 +02:00
kimchy 1242cf59f6 upgrade to guice 3 rc3 2011-03-07 06:52:55 +02:00
kimchy cb912de255 ignore engine closed exception as well 2011-03-05 10:46:00 +02:00
kimchy f0825414d3 upgrade to jackson 1.7.4 2011-03-05 10:45:20 +02:00
kimchy bc882182ab change scripts to start the ElasticSearch main class (a wrapper around Bootstrap) just so the process name will look nicely on jps 2011-03-04 20:14:22 +02:00
kimchy c097735196 improve async merge process, don't spawn a thread unless a merge is really needed, and add an optimized "maybeMerge" operation 2011-03-04 20:05:52 +02:00
kimchy 20ed540fe7 don't block node master node startup if recover_after_time is set and nodes settings are not met (we already handle it with the not recovered state) 2011-03-04 05:11:28 +02:00
kimchy 4b92928c77 Internal: Improve checksum process by bulk writing them into a single file instead of checksum file per index file, closes #747. 2011-03-04 04:22:47 +02:00
kimchy b629d36d8b add a merge thread pool that only does async merges (optimize), so it can be controlled by itself 2011-03-04 01:04:59 +02:00
kimchy 06ad13f373 no need to call maybe merge as part of flush, we do it async anyhow 2011-03-04 00:56:34 +02:00
kimchy 607ada75a6 optimize the index status response 2011-03-04 00:55:39 +02:00
kimchy 41ddcdca93 Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:26:47 +02:00
kimchy f901429aaa Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:20:05 +02:00
kimchy 682ad7e2fc Indices Status / Node Stats: Add (Lucene) index merge stats, closes #745. 2011-03-03 23:53:28 +02:00
kimchy 2909060af8 Query DSL: flt_field does not allow to set min_similarity and prefix_length, closes #744. 2011-03-03 04:17:02 +02:00
kimchy 78c6f951a3 All Field: All field cane fail to analyze input data (rare cases), closes #743. 2011-03-03 02:59:27 +02:00
kimchy 68c1dd771c upgrade to mvel 2.1 beta2 2011-03-02 22:37:36 +02:00
kimchy 4631df9d01 Delete API: Allow to set _parent on it (will simply set the routing value), closes #742. 2011-03-02 22:14:49 +02:00
kimchy 655cbb9440 improve failure when disabling dynamic creating of types, and trying to index into a non existing type 2011-03-02 20:42:43 +02:00
kimchy faefc772a4 Searching while an index is being allocated and no active shards exists within a "shard replication group" can cause search "misses", closes #736. 2011-03-02 05:11:02 +02:00
kimchy bb1668c2b7 count date histo using the wrong counts aggregator to return results when using time based setting interval 2011-03-02 03:13:25 +02:00
kimchy 3361a9365b since we now take all#enabled into account when checking for include_in_all, there is no need to set it on every mapper 2011-03-02 03:01:01 +02:00
kimchy 185cd68045 really fix time format interval for date_histogram now 2011-03-02 00:39:18 +02:00
kimchy 1d240aaff6 prefix inside a dis_max / bool query broken, closes #732. 2011-03-02 00:36:30 +02:00
kimchy ce862da8f4 add tests for boosted wildcard and prefix queries 2011-03-02 00:26:49 +02:00
kimchy 9560451896 optimize query facet to extract filter from constant_score queries automatically 2011-03-02 00:18:26 +02:00
kimchy 60b423b741 Don't "double" cache a facet filter / query facet, closes #734. 2011-03-01 22:14:36 +02:00
kimchy 0e30ad90f5 support 'w' as suffix for time format 2011-03-01 20:16:18 +02:00
kimchy 0183516221 better failure message 2011-03-01 05:34:21 +02:00
kimchy e639ffbc93 Search: Allow to use has_child filter in facets, closes #730. 2011-03-01 04:45:25 +02:00
kimchy 6097365738 eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729. 2011-03-01 00:49:41 +02:00
kimchy 9d81d01c93 only flush when the index shard is in STARTED mode (nothing will break flushing on non started index, just remove a possible warn logging) 2011-03-01 00:26:03 +02:00
kimchy 0662f65fda log warning when failing to list started shards on other nodes when doing local gateway allocation 2011-03-01 00:25:03 +02:00
kimchy 906ec57f20 Ids with # in them will cause search failures, also, fail when # is used in a type name, closes #728. 2011-02-28 22:43:48 +02:00
kimchy 3bac33e69e don't use AfterTest / BeforeTest in any tests 2011-02-28 22:28:55 +02:00
kimchy 24199a3394 add simple unicast disco test on hte node level 2011-02-28 21:43:31 +02:00
kimchy 47a6065805 Date Histogram Facet: NPE if using "1w" interval, closes #727. 2011-02-28 20:31:02 +02:00
kimchy d395c0a844 better failure message when failing to find a type mapping for a document loaded from the index 2011-02-28 20:21:47 +02:00
kimchy 3b967040da Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725. 2011-02-27 01:06:50 +02:00
kimchy fdef88debb Bulk API: Improve memory usage when executing large bulk requests, closes #724. 2011-02-26 23:46:22 +02:00
kimchy 3cda177b9b Zen Discovery: Rename `discovery.zen.initial_ping_timeout` to `discovery.zen.ping_timeout` (still support the old setting), closes #723. 2011-02-26 22:25:26 +02:00
kimchy 4634ca5cb8 Mapping: When _all is disabled, optimize to not gather all entries, closes #722. 2011-02-26 04:16:03 +02:00
kimchy 608c5a838d Index Filter Cache: Add `resident` type, and `max_size` to `soft`/`weak` types, closes #721. 2011-02-25 03:54:18 +02:00
kimchy ecc1a3cd8c Acknowledge problem for put mapping with multiple indices or all indices, closes #720. 2011-02-24 21:17:24 +02:00
kimchy 4def1f4b8e upgrade to google guava r08 2011-02-24 08:49:38 +02:00
kimchy 8a03ca1114 Search: Allow to filter out docs based on a minimum score, closes #719. 2011-02-24 06:55:16 +02:00
kimchy a0fd47159e improve internal scan handling, by using count type for the first scan 2011-02-24 01:04:49 +02:00
kimchy ee9beda398 Search: Add search_type for `count` to return count but still support facets, closes #718. 2011-02-24 00:29:42 +02:00
kimchy f7100c0698 Improve from hits pagination (duplicates), closes #717. 2011-02-23 22:57:44 +02:00
kimchy 6b7192e744 add from/to test without sorting on single shard 2011-02-23 21:41:31 +02:00
kimchy 5082ad6d11 Clear Cache API: Add specific cache clear for `id`, `filter`, `field_data`, `bloom`, closes #716. 2011-02-23 21:17:09 +02:00
kimchy 8371920a89 add min/max to terms stats facet 2011-02-23 20:36:12 +02:00
kimchy be1b46061e add filter and scope parameters when creating terms stats facet 2011-02-23 19:37:20 +02:00
kimchy 8617e3b0e3 enhance memory usage when doing reduce on histogram facets 2011-02-23 05:55:23 +02:00
kimchy 9cccfc3bd3 improve terms stats facet internal data structure and sorting 2011-02-23 05:04:45 +02:00
kimchy 2845cbefaa move to mvel 2.1.beta1 (versioning changed from 2.1.rc1) 2011-02-23 02:32:56 +02:00
kimchy 1a48007174 Single node cluster comes up as red with local gateway, closes #714. 2011-02-23 01:21:17 +02:00
kimchy 58dbf6d5ca fix terms facet TOTAL comparator to also do secondary sort when totals are equal 2011-02-23 00:55:40 +02:00
kimchy c6f58321e4 Node Stats: Add number of docs per node, closes #713. 2011-02-22 22:27:12 +02:00
kimchy 45ec2c6e21 Allow to register custom rivers under a custom type name (And not full class names), closes #712. 2011-02-22 22:13:31 +02:00
kimchy 06850f8673 add another test to scan 2011-02-22 21:01:11 +02:00
kimchy 7dda421cfa River not recovered when using single node after shutdown, closes #711. 2011-02-22 20:38:52 +02:00
kimchy 953fcbc58c Get API: Allow to provide a script as a field, closes #708. 2011-02-22 02:28:19 +02:00
kimchy 818f3b4d75 Search: Add search type `scan` allowing to efficiently scan large result set, closes #707. 2011-02-22 00:11:31 +02:00
kimchy 65ca857027 Add `http` and `transport` simplified host settings, closes #706. 2011-02-21 19:51:18 +02:00
kimchy be372bee7d ignore a case where we can't find an index trying to apply shards, it gets deleted on us 2011-02-20 02:04:44 +02:00
Benoit Sigoure fcdd103345 Simplify some error-handling logic a bit. 2011-02-20 00:45:25 +02:00
kimchy d76f12a9f3 return 0 as prefix / suffix content length for utf8 response 2011-02-20 00:18:48 +02:00
kimchy 352cb74f96 Search: Terms Stats Facet, closes #705. 2011-02-19 23:37:04 +02:00
kimchy 745614f53d notify listener on failure 2011-02-19 23:19:02 +02:00
kimchy d3ba8bd487 use parsing field to check for order 2011-02-19 01:41:48 +02:00
kimchy d7a02fb28f Handle cluster join request on a non IO thread, closes #702. 2011-02-18 23:46:15 +02:00
kimchy 9ac048c68c add "same" thread pool type (really, just for testing) 2011-02-18 07:59:14 +02:00
kimchy 585c310aa4 add edge histogram test 2011-02-18 07:35:33 +02:00
kimchy d8bec39b73 more support for wares 2011-02-18 05:03:46 +02:00
kimchy 8d867dc24c explicitly set the cat under which jdk logging is logged 2011-02-18 05:00:08 +02:00
kimchy 60578aef4d add name as another setting to set on snowball, not just language 2011-02-17 22:22:34 +02:00
kimchy c67912e259 reset stream when getting all stream so it can be reused 2011-02-17 19:25:23 +02:00
kimchy 9ca8165f3b Cluster Shutdown API: On full/_all shutdown, shutdown only data/master nodes, not client nodes, closes #697. 2011-02-17 03:33:34 +02:00
kimchy 245d241a5c handle any exception on first phase 2011-02-17 02:06:59 +02:00
kimchy 09d650fae7 Index Status: Peer recovery does not compute the index size correctly to report the full size, closes #695. 2011-02-17 01:43:56 +02:00
kimchy fb90392040 add status based test 2011-02-17 01:28:54 +02:00
kimchy 6ffd60dfb5 change var name to better reflect the fact that its data and not work 2011-02-17 01:07:05 +02:00
kimchy 3c9dafe67b better reason for disco state change 2011-02-16 23:30:40 +02:00
kimchy bc504d6c08 add simple netty benchmark 2011-02-16 08:17:31 +02:00
kimchy 2f5dd85bd5 change handlers from CHM to volatile Immutable Map 2011-02-16 05:24:29 +02:00
kimchy 3679efa840 default management TP to max at 20 2011-02-16 02:44:48 +02:00
kimchy 087f5d6bea fix scheduling to actually schedule the correct runnable 2011-02-16 02:44:24 +02:00
kimchy d1d3f8c4ca REST codes: Improve returned error codes on REST APIs, associate codes with internal exceptions, closes #690. 2011-02-16 01:41:01 +02:00
Lukáš Vlček 12a33e6a91 Add new Access-Control-Allow-Headers value into http response header, closes #688 2011-02-15 23:53:53 +02:00
kimchy 442ce9daaa ignore closed exception when async loading bloom filters 2011-02-15 23:23:49 +02:00
kimchy f14305e95c upgrade to jackson 1.7.3 2011-02-15 20:57:13 +02:00
kimchy 36efde8c1d simplify threaded listener invocation by wrapping the listener with a threaded listener and not check in each action for it 2011-02-15 07:52:24 +02:00
kimchy 3ed848a495 ThreadPool: Refactor into several pools, with configurable types per pool, closes #687. 2011-02-15 07:00:24 +02:00
kimchy 1b5cdb181a Query: boosting query, closes #683. 2011-02-11 19:59:15 +02:00
kimchy 65197ba39d don't return null highlighted fields if no highlighting was done 2011-02-11 18:31:09 +02:00
kimchy d054c8c14e use cached thread pool to do cluster state gateway snapshotting 2011-02-11 03:14:13 +02:00
kimchy e63e5f232c only actually fork to another thread if a flush is really needed 2011-02-11 02:35:02 +02:00
kimchy fc88cccfb4 only fork a refresh if it actually needs to be refreshed 2011-02-11 02:27:29 +02:00
kimchy 7c4d574a32 only call refresh if its needed, so we check outside of the readLock when async refreshing 2011-02-11 01:53:48 +02:00
kimchy df4f4f056a protected against a possible null for lastGC in the previous collection 2011-02-11 01:48:23 +02:00