Commit Graph

2210 Commits

Author SHA1 Message Date
kimchy 65fde3e71e only remove shards if they have been started on all other nodes 2011-04-14 01:12:37 +03:00
kimchy 22b5e7ded8 Local Gateway: Listed active shards on each node does apply index deletion, closes #853. 2011-04-13 16:15:26 +03:00
kimchy 41af86dd7e internal option ot pretty print state 2011-04-13 16:04:18 +03:00
kimchy b80324db08 only serialize the cluster state ones when publishing it to multiple nodes 2011-04-13 15:36:28 +03:00
kimchy e9bc7f7d95 River: Failure to reallocate river to another node on rivers node failure, closes #850. 2011-04-12 21:52:02 +03:00
kimchy e8503c1455 Better handling when a shard hits OOM, closes #848. 2011-04-11 21:10:56 +03:00
kimchy decb5fa898 Optimize API: Don't execute concurrent optimize operations (shard level) on the same node, closes #846. 2011-04-10 23:12:00 +03:00
kimchy 7d8726a5e8 Better handling of shard failures, closes #845. 2011-04-10 21:59:59 +03:00
kimchy 8eab5ec528 experiment with lab for filter cache, disabled by default for now, also, move to use soft reference on the whole reader key value, and not per filter (less load) 2011-04-09 20:21:23 +03:00
kimchy b658fba22e allow to copy openbitset into a sliced one 2011-04-09 14:33:16 +03:00
kimchy 991683efa6 remove clearUnreferenced from caches, no longer need it 2011-04-09 14:20:18 +03:00
kimchy 49e2f55abd actually register the eviction listener with soft / resident filter cache 2011-04-09 14:11:42 +03:00
kimchy c934f04b0c remove weak caching of filters and stick with only caching when needed / flagged / defaulted 2011-04-09 02:47:31 +03:00
kimchy b71513a072 JMX: Don't use node id and name as part of the jmx registration, use static org.elasticsearch, closes #843. 2011-04-08 18:49:40 +03:00
kimchy 388f4febba add more terms stats bench 2011-04-07 20:41:20 +03:00
kimchy 93372868a2 fix error when trying to delete all indices and none exists 2011-04-07 20:08:53 +03:00
kimchy ca01dc7a09 Network Settings: Allow to explicitly set ipv4 and ipv4 when using _networkInterface_ notation, closes #841. 2011-04-07 20:01:52 +03:00
kimchy 1fdef91fc2 Allow to search across indices and types even if some types do not exists on some indices, closes #839. 2011-04-07 16:00:18 +03:00
kimchy 4603d10501 faster handling of a case where each doc has multi valued values for different facets, also, don't take into account missing value values (and in the future, we can also count those per bucket if needed) 2011-04-07 15:04:54 +03:00
kimchy b479bc58f9 faster handling of a case where each doc has multi valued values fields in histogram facet 2011-04-07 14:52:25 +03:00
kimchy 7fcf82af80 faster handling of a case where each doc has multi valued values fields in terms stats 2011-04-07 14:44:34 +03:00
kimchy 16a046f686 rename termsstats java facet builder to termsStatsFacet 2011-04-07 14:30:12 +03:00
kimchy 7decb701d9 nicer bench of terms facet 2011-04-07 14:16:21 +03:00
kimchy 7231e08f7c also test terms facet with execution hint of map 2011-04-07 13:32:35 +03:00
kimchy c0879c2055 add bench on nano time 2011-04-06 22:50:36 +03:00
kimchy 08f594c3a0 Get Mapping API: when asking for a mapping of a single index and single type, don't wrap the mapping with the index name, closes #838. 2011-04-06 22:12:34 +03:00
kimchy 8c50a65699 Percolator doesn't work correctly after index recreation, closes #837. 2011-04-06 21:00:49 +03:00
kimchy 6317483fe3 add total count to terms stats and compute mean properly, also better use caching 2011-04-06 15:50:09 +03:00
kimchy 35be46df71 Bug: Sort on a column of type 'short' throws an exception, closes #835. 2011-04-06 02:25:56 +03:00
kimchy 4721f9aa69 fix cache recycling logic to make sure we don't override our own data in facets 2011-04-05 23:25:39 +03:00
kimchy f0de086479 for some reason the copyright header got reformatted 2011-04-05 15:42:12 +03:00
kimchy 6f827731d6 normalize to/from properly in bounded histogram 2011-04-05 15:10:55 +03:00
kimchy 1428abf2b7 Upgrade to jackson 1.7.5 2011-04-05 14:15:48 +03:00
kimchy 9b8eceb229 Histogram Facet: Add ability to define bounds (from/to) to both improve performance and provide additional bound filtering, closes #834. 2011-04-05 13:53:19 +03:00
kimchy 14def814fa fix typo 2011-04-05 12:07:46 +03:00
kimchy d845a306fa fill sentinal proeprly when its not in cache 2011-04-05 03:09:33 +03:00
kimchy a89aeb3a6d add JVM mem to node info API 2011-04-05 01:46:09 +03:00
kimchy 83b728a384 rename some histogram collectors 2011-04-05 01:32:36 +03:00
kimchy cea8c5fefa Geo Distance Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #833. 2011-04-05 00:52:58 +03:00
kimchy 79939222e4 Range Facet: Fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #832. 2011-04-05 00:42:46 +03:00
kimchy 90a339ad5e Date Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, add min/max stats, closes #831. 2011-04-05 00:17:07 +03:00
kimchy 8d1e9dbd3c Histogram Facet: Add min/max stats when providing value field / script, closes #830. 2011-04-04 23:48:54 +03:00
kimchy 46088b9f8a Histogram Facet: Improve value field case performance, fix wrong total computation with multi valued fields by introducing total_count, closes #829. 2011-04-04 21:30:46 +03:00
kimchy 58c606d6d9 break field data value iterator into two callback types, one with support for missing, and one without 2011-04-04 19:53:09 +03:00
kimchy c9838d5c75 use cache recycler for count histo and data histo facets 2011-04-04 19:44:46 +03:00
kimchy 105d60ac9c Geo Distance / Range Facets might count documents several times for a range entry if the field is multi valued, closes #824. 2011-04-04 17:44:38 +03:00
kimchy 5d6e84f206 Upgrade Lucene 3.1: Analyzers, closes #826. 2011-04-04 14:36:13 +03:00
kimchy 4e4495ff1d Upgrade to Lucene 3.1, closes #825. 2011-04-04 12:54:15 +03:00
kimchy db1dcaded3 Concurrent calls to refresh might result in "dangling" searchers, closes #823. 2011-04-01 22:43:48 +03:00
kimchy 1280512097 also support regex pattern matching with ordinals 2011-04-01 16:54:37 +03:00
kimchy e4cbdfa05b Terms Facet: Performance improvements, closes #822. 2011-04-01 16:30:45 +03:00
kimchy fb8a389380 more bench work 2011-03-31 18:25:23 +02:00
kimchy 44d4474f95 anoter small bench 2011-03-31 17:48:57 +02:00
kimchy a0cddf0745 small improvement to stats facet computing min/max 2011-03-31 17:41:21 +02:00
kimchy 3ff35d42b5 Indexing Buffer: Automatically inactivate unindexed into shards and lower their indexing buffer size, closes #821. 2011-03-31 17:03:37 +02:00
kimchy 09d3b882f0 more small bench 2011-03-31 02:30:17 +02:00
kimchy 74838fe1aa Translog: Reduce the number of translog ops to flush after from 20000 to 5000, closes #820. 2011-03-31 01:09:03 +02:00
kimchy 14d98a7319 Shard Allocation: Add node_initial_primaries_recoveries setting, closes #819. 2011-03-31 01:04:09 +02:00
kimchy f90b4e6fee some more micro bench support 2011-03-30 23:32:33 +02:00
kimchy ae0eed937b update to the new lzf compression (0.7) 2011-03-30 20:43:20 +02:00
kimchy 2dd5094d37 Shard Allocation: Rename cluster.routing.allocation.concurrent_recoveries to cluster.routing.allocation.node_concurrent_recoveries (old one still works), closes #817. 2011-03-30 15:43:56 +02:00
kimchy 7ce7fb33e5 Shard Allocation: Allow to control how many cluster wide concurrent rebalance (relocation) are allowed, default to 3, closes #816. 2011-03-30 15:40:11 +02:00
kimchy 8a5dd90885 HTTP: Support compression (gzip, deflate) when using Accept-Encoding header, closes #815. 2011-03-30 14:46:39 +02:00
kimchy eafe686013 warm up with compression bench 2011-03-30 13:52:52 +02:00
kimchy fdbccf28b0 Shard Allocation: Add a setting to control when rebalancing will happen based on the cluster wide active shards state, closes #814. 2011-03-30 12:56:53 +02:00
kimchy 9bb0bcf4e3 add logging when trying to obtain node lock 2011-03-29 21:34:15 +02:00
kimchy 0069d5a75d add adler to checksum, faster and is good enough with length check for our use case 2011-03-29 21:27:18 +02:00
kimchy a1be2bbf20 add adler to checksum tests 2011-03-29 18:17:09 +02:00
kimchy 3138269573 Indices Status API: Add refresh stats, closes #811. 2011-03-29 17:54:00 +02:00
kimchy 2a032f8718 add remote many indices creation test 2011-03-29 17:17:54 +02:00
kimchy 0e6bbf3f85 call shard refresh API and not directly the engine one 2011-03-29 17:17:39 +02:00
kimchy ff8dc2673f Get Settings API: Allow to retrieve (just) a specific index / indices settings, closes #810. 2011-03-29 13:50:25 +02:00
kimchy 508d1d40fb Indices Status API: Remove settings/aliases section, and add `recovery`/`snapshot` flags, closes #809. 2011-03-29 13:05:36 +02:00
kimchy 95e36a073a move index/delete refresh to happen outside of the engine 2011-03-29 01:28:37 +02:00
kimchy 53935f078a optimize array list creation with exact size 2011-03-28 21:50:39 +02:00
kimchy 49f79f54d2 log when search failure happen when scanning 2011-03-28 18:17:36 +02:00
kimchy f00664621f more scan tests to try and recreate the context missing failure, no luck yet... 2011-03-28 17:21:59 +02:00
kimchy e0d8094f3d clear listeners only if not null (can cause failure to properly close a shard), also, do the CLOSE check if to reschedule within the sync block 2011-03-28 17:20:07 +02:00
kimchy 953a99c75c fix a bug in new checksum mechanism that caused for replicas not to retain the _checksums file. Also, now that checksums are widely used, consider files without checksums as ones that need to be recovered 2011-03-28 16:08:01 +02:00
kimchy 64a89eb0e4 add the ability to control the number of shards and replicas in the restart stress test, also add a step to verify version numbers 2011-03-28 14:21:49 +02:00
kimchy af419cc636 upgrade to guice 3.0 2011-03-27 19:31:51 +02:00
kimchy b28461dd0e compress cluster state when publishing it 2011-03-24 01:12:36 +02:00
kimchy 992becf013 add value_script as an option to terms stats 2011-03-24 01:03:17 +02:00
kimchy f20c6ec9cf check if index service is null, and don't load percolators in this case 2011-03-24 00:40:21 +02:00
kimchy 36edcef640 compress metadata stored in gateway 2011-03-24 00:38:16 +02:00
kimchy 4f27fa3f45 add the version to the jvm info, and, warn if running using the client vm 2011-03-23 18:06:29 +02:00
kimchy 20593fb966 Mapping: Add _size field mapping, indexing the original source size, closes #804. 2011-03-23 17:37:40 +02:00
kimchy b2d7cd78b7 don't clean up indices if there is a block disabling persistence 2011-03-22 18:41:29 +02:00
kimchy 8c9000c54c Extend stats API to include filter's cache count and eviction count, closes #802. 2011-03-22 13:30:14 +02:00
kimchy e759b4c971 Add option to expire filter's cache based on access time, closes #803. 2011-03-22 13:14:31 +02:00
kimchy 0d150e6918 Date Field Mapper: Allow to use timestamp value (milliseconds since epoch, UTC), closes #801. 2011-03-22 01:29:41 +02:00
kimchy 9f44c93a25 make sure to log failures in search when reducing results 2011-03-22 01:05:54 +02:00
kimchy 61034f5c86 Mapping: Failure to update _source mapping - compress and compress_threshold, closes #800. 2011-03-21 18:10:13 +02:00
kimchy 8f8fb89c4e Update Settings: Allow to control `index.auto_expand_replicas`, closes #799. 2011-03-21 16:18:03 +02:00
kimchy 2f1aba962c add the exception as well to the logging 2011-03-21 14:36:56 +02:00
kimchy 6c241f3de8 protected against a wrong format in the index.auto_expand_replicas setting 2011-03-21 14:36:28 +02:00
kimchy d2e61af9ee maintain total hits across scan scroll requests 2011-03-20 00:19:26 +02:00
kimchy 52c750fc42 internal support for custom attributes in scroll id 2011-03-19 21:51:18 +02:00
kimchy f3160b71bb can't check on token value, since it might be valid, so, handle the null token case better 2011-03-19 21:34:31 +02:00
kimchy c19a93da89 countDown the latch if no need to delete percolator, introduced when added delete to percolated queries when deleting an index 2011-03-19 21:28:17 +02:00
kimchy fb7fbc8c83 NPE when the JSON to index doesn't match the mapping's expectations, closes #795. 2011-03-19 20:42:50 +02:00
kimchy 70fc8d9af0 Percolator: When deleting an index, make sure to delete all its percolated queries from the _percolator index, closes #793. 2011-03-19 00:24:20 +02:00
kimchy bd3f490d60 Delete IndexAPI: Allow to delete more than one index or _all indices, closes #791. 2011-03-18 20:44:59 +02:00
kimchy 09fbc919b8 "exclude" functionality missing for terms facet on numeric fields, closes #789. 2011-03-18 11:08:11 +02:00
kimchy 923fcf239c Percolator failure when deleting and creating an index, also causes problem with percolated queries isolation between different indices, closes #790. 2011-03-18 10:49:28 +02:00
kimchy 616b3dcb18 shard the default analyzer (standard) on the node level 2011-03-18 01:35:29 +02:00
kimchy 25124b084b Query: Provide an option to analyze wildcard/prefix in query_string / field queries, closes #787. 2011-03-17 22:01:22 +02:00
kimchy 96d06d6dc8 Cluster Health API: Asking for health on an index that does not exists should return RED status, closes #781. 2011-03-15 21:22:46 +02:00
kimchy 0291ab1d8d sync version when getting the state from master 2011-03-15 14:15:16 +02:00
kimchy 1bcd3b67ee Search / Get: Allow to specify a preference on which shards (or order) it will be executed, closes #769. 2011-03-14 11:30:01 +02:00
kimchy 3192654e80 add iterator based on specific index 2011-03-13 19:51:21 +02:00
kimchy 96dfdcf97c Bulk Request: Streamline parameters names to be the same as the single REST request, closes #778. 2011-03-13 11:43:30 +02:00
kimchy 700a2a9577 Sort: Support "missing" specific handling, include _last, _first, and custom value (for numeric values), closes #772. 2011-03-13 02:29:05 +02:00
kimchy 7c04ef6cbc use byte value 2011-03-13 00:51:12 +02:00
kimchy 09006f17c3 Support true|false for the 'store' parameter in mappings, closes #775. 2011-03-13 00:41:58 +02:00
kimchy 6d108e77f1 handle whitespace text on search fields query string parameter to be treated as no fields 2011-03-13 00:37:25 +02:00
kimchy aff8a4407f better exception message 2011-03-13 00:31:21 +02:00
kimchy bdb0fd23e9 Versioning: Add a new version_type parameter, with a new type - `external`, closes #776. 2011-03-12 20:41:55 +02:00
kimchy 7bab5270fc add a comment on max shard buffer size 2011-03-12 17:17:02 +02:00
kimchy 73dec5d63f Add `max_shard_index_buffer_size` to control the upper limit of a shard indexing buffer size (defaults to `512mb`), closes #773. 2011-03-12 17:03:04 +02:00
kimchy 19052a3538 Add another flag to gateway if it even requires snapshot, so we don't try and snapshot on shutdown for none/local gateway (even though its a no op) 2011-03-11 15:20:16 +02:00
kimchy 3e624bf9e0 better failure when trying to obtain a native lock on the node data location, and reduce the tries from 100 to 50. 2011-03-11 15:05:22 +02:00
kimchy e1c86b86e5 add simplified ways to create XContentBuilder that will output to OutputStream using XContentFactory 2011-03-10 16:00:19 +02:00
kimchy 0df3dfd72b add the ability to set source and extra source on the SearchRequestBuilder 2011-03-09 21:55:46 +02:00
kimchy 80a797fc4f Update Settings: Allow to dynamically update `index.translog` settings, closes #765. 2011-03-09 14:17:34 +02:00
kimchy c2a0e0b767 Mapper: Using `dynamic_template` can result in warning of parsed and original source difference (resulting in excessive mapping parsing), closes #764. 2011-03-09 11:36:51 +02:00
kimchy f694b9dfd8 Percolator: Failures when using docs where fields repeat, such as arrays, closes #763. 2011-03-09 11:31:05 +02:00
kimchy ad0d681b6d Update Settings: Allow to dynamically change `index.term_index_interval` and `index.term_index_divisor, closes #762. 2011-03-09 07:36:18 +02:00
kimchy 353d2cb21f Mvel Script: add more random options, and optimize random, closes #759. 2011-03-08 22:24:22 +02:00
kimchy 016e5bce04 Update Settings: Allow to dynamically change refresh_interval and merge policy settings, closes #758. 2011-03-08 21:53:33 +02:00
kimchy 77cf3e1924 small refactor in index settings, allowing for future dynamic changes to it 2011-03-08 11:12:40 +02:00
kimchy e709a0bde4 Logging: Add merge level logging, closes #755. 2011-03-08 08:20:48 +02:00
kimchy 9e2143f343 add a warning for types not to include dots (can't really throw a failure because of it since it will break backward) 2011-03-07 19:17:39 +02:00
kimchy 4bdae621f9 Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752. 2011-03-07 13:09:07 +02:00
kimchy 1242cf59f6 upgrade to guice 3 rc3 2011-03-07 06:52:55 +02:00
kimchy cb912de255 ignore engine closed exception as well 2011-03-05 10:46:00 +02:00
kimchy f0825414d3 upgrade to jackson 1.7.4 2011-03-05 10:45:20 +02:00
kimchy bc882182ab change scripts to start the ElasticSearch main class (a wrapper around Bootstrap) just so the process name will look nicely on jps 2011-03-04 20:14:22 +02:00
kimchy c097735196 improve async merge process, don't spawn a thread unless a merge is really needed, and add an optimized "maybeMerge" operation 2011-03-04 20:05:52 +02:00
kimchy 20ed540fe7 don't block node master node startup if recover_after_time is set and nodes settings are not met (we already handle it with the not recovered state) 2011-03-04 05:11:28 +02:00
kimchy 4b92928c77 Internal: Improve checksum process by bulk writing them into a single file instead of checksum file per index file, closes #747. 2011-03-04 04:22:47 +02:00
kimchy b629d36d8b add a merge thread pool that only does async merges (optimize), so it can be controlled by itself 2011-03-04 01:04:59 +02:00
kimchy 06ad13f373 no need to call maybe merge as part of flush, we do it async anyhow 2011-03-04 00:56:34 +02:00
kimchy 607ada75a6 optimize the index status response 2011-03-04 00:55:39 +02:00
kimchy 41ddcdca93 Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:26:47 +02:00
kimchy f901429aaa Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:20:05 +02:00
kimchy 682ad7e2fc Indices Status / Node Stats: Add (Lucene) index merge stats, closes #745. 2011-03-03 23:53:28 +02:00
kimchy 2909060af8 Query DSL: flt_field does not allow to set min_similarity and prefix_length, closes #744. 2011-03-03 04:17:02 +02:00
kimchy 78c6f951a3 All Field: All field cane fail to analyze input data (rare cases), closes #743. 2011-03-03 02:59:27 +02:00
kimchy 68c1dd771c upgrade to mvel 2.1 beta2 2011-03-02 22:37:36 +02:00
kimchy 4631df9d01 Delete API: Allow to set _parent on it (will simply set the routing value), closes #742. 2011-03-02 22:14:49 +02:00
kimchy 655cbb9440 improve failure when disabling dynamic creating of types, and trying to index into a non existing type 2011-03-02 20:42:43 +02:00
kimchy faefc772a4 Searching while an index is being allocated and no active shards exists within a "shard replication group" can cause search "misses", closes #736. 2011-03-02 05:11:02 +02:00
kimchy bb1668c2b7 count date histo using the wrong counts aggregator to return results when using time based setting interval 2011-03-02 03:13:25 +02:00
kimchy 3361a9365b since we now take all#enabled into account when checking for include_in_all, there is no need to set it on every mapper 2011-03-02 03:01:01 +02:00
kimchy 185cd68045 really fix time format interval for date_histogram now 2011-03-02 00:39:18 +02:00
kimchy 1d240aaff6 prefix inside a dis_max / bool query broken, closes #732. 2011-03-02 00:36:30 +02:00
kimchy ce862da8f4 add tests for boosted wildcard and prefix queries 2011-03-02 00:26:49 +02:00
kimchy 9560451896 optimize query facet to extract filter from constant_score queries automatically 2011-03-02 00:18:26 +02:00
kimchy 60b423b741 Don't "double" cache a facet filter / query facet, closes #734. 2011-03-01 22:14:36 +02:00
kimchy 0e30ad90f5 support 'w' as suffix for time format 2011-03-01 20:16:18 +02:00
kimchy 0183516221 better failure message 2011-03-01 05:34:21 +02:00
kimchy e639ffbc93 Search: Allow to use has_child filter in facets, closes #730. 2011-03-01 04:45:25 +02:00
kimchy 6097365738 eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729. 2011-03-01 00:49:41 +02:00
kimchy 9d81d01c93 only flush when the index shard is in STARTED mode (nothing will break flushing on non started index, just remove a possible warn logging) 2011-03-01 00:26:03 +02:00
kimchy 0662f65fda log warning when failing to list started shards on other nodes when doing local gateway allocation 2011-03-01 00:25:03 +02:00
kimchy 906ec57f20 Ids with # in them will cause search failures, also, fail when # is used in a type name, closes #728. 2011-02-28 22:43:48 +02:00
kimchy 3bac33e69e don't use AfterTest / BeforeTest in any tests 2011-02-28 22:28:55 +02:00
kimchy 24199a3394 add simple unicast disco test on hte node level 2011-02-28 21:43:31 +02:00
kimchy 47a6065805 Date Histogram Facet: NPE if using "1w" interval, closes #727. 2011-02-28 20:31:02 +02:00
kimchy d395c0a844 better failure message when failing to find a type mapping for a document loaded from the index 2011-02-28 20:21:47 +02:00
kimchy 3b967040da Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725. 2011-02-27 01:06:50 +02:00
kimchy fdef88debb Bulk API: Improve memory usage when executing large bulk requests, closes #724. 2011-02-26 23:46:22 +02:00
kimchy 3cda177b9b Zen Discovery: Rename `discovery.zen.initial_ping_timeout` to `discovery.zen.ping_timeout` (still support the old setting), closes #723. 2011-02-26 22:25:26 +02:00
kimchy 4634ca5cb8 Mapping: When _all is disabled, optimize to not gather all entries, closes #722. 2011-02-26 04:16:03 +02:00
kimchy 608c5a838d Index Filter Cache: Add `resident` type, and `max_size` to `soft`/`weak` types, closes #721. 2011-02-25 03:54:18 +02:00
kimchy ecc1a3cd8c Acknowledge problem for put mapping with multiple indices or all indices, closes #720. 2011-02-24 21:17:24 +02:00
kimchy 4def1f4b8e upgrade to google guava r08 2011-02-24 08:49:38 +02:00
kimchy 8a03ca1114 Search: Allow to filter out docs based on a minimum score, closes #719. 2011-02-24 06:55:16 +02:00
kimchy a0fd47159e improve internal scan handling, by using count type for the first scan 2011-02-24 01:04:49 +02:00
kimchy ee9beda398 Search: Add search_type for `count` to return count but still support facets, closes #718. 2011-02-24 00:29:42 +02:00
kimchy f7100c0698 Improve from hits pagination (duplicates), closes #717. 2011-02-23 22:57:44 +02:00
kimchy 6b7192e744 add from/to test without sorting on single shard 2011-02-23 21:41:31 +02:00
kimchy 5082ad6d11 Clear Cache API: Add specific cache clear for `id`, `filter`, `field_data`, `bloom`, closes #716. 2011-02-23 21:17:09 +02:00
kimchy 8371920a89 add min/max to terms stats facet 2011-02-23 20:36:12 +02:00
kimchy be1b46061e add filter and scope parameters when creating terms stats facet 2011-02-23 19:37:20 +02:00
kimchy 8617e3b0e3 enhance memory usage when doing reduce on histogram facets 2011-02-23 05:55:23 +02:00
kimchy 9cccfc3bd3 improve terms stats facet internal data structure and sorting 2011-02-23 05:04:45 +02:00
kimchy 2845cbefaa move to mvel 2.1.beta1 (versioning changed from 2.1.rc1) 2011-02-23 02:32:56 +02:00
kimchy 1a48007174 Single node cluster comes up as red with local gateway, closes #714. 2011-02-23 01:21:17 +02:00
kimchy 58dbf6d5ca fix terms facet TOTAL comparator to also do secondary sort when totals are equal 2011-02-23 00:55:40 +02:00
kimchy c6f58321e4 Node Stats: Add number of docs per node, closes #713. 2011-02-22 22:27:12 +02:00
kimchy 45ec2c6e21 Allow to register custom rivers under a custom type name (And not full class names), closes #712. 2011-02-22 22:13:31 +02:00
kimchy 06850f8673 add another test to scan 2011-02-22 21:01:11 +02:00
kimchy 7dda421cfa River not recovered when using single node after shutdown, closes #711. 2011-02-22 20:38:52 +02:00
kimchy 953fcbc58c Get API: Allow to provide a script as a field, closes #708. 2011-02-22 02:28:19 +02:00
kimchy 818f3b4d75 Search: Add search type `scan` allowing to efficiently scan large result set, closes #707. 2011-02-22 00:11:31 +02:00
kimchy 65ca857027 Add `http` and `transport` simplified host settings, closes #706. 2011-02-21 19:51:18 +02:00
kimchy be372bee7d ignore a case where we can't find an index trying to apply shards, it gets deleted on us 2011-02-20 02:04:44 +02:00
Benoit Sigoure fcdd103345 Simplify some error-handling logic a bit. 2011-02-20 00:45:25 +02:00
kimchy d76f12a9f3 return 0 as prefix / suffix content length for utf8 response 2011-02-20 00:18:48 +02:00
kimchy 352cb74f96 Search: Terms Stats Facet, closes #705. 2011-02-19 23:37:04 +02:00
kimchy 745614f53d notify listener on failure 2011-02-19 23:19:02 +02:00
kimchy d3ba8bd487 use parsing field to check for order 2011-02-19 01:41:48 +02:00
kimchy d7a02fb28f Handle cluster join request on a non IO thread, closes #702. 2011-02-18 23:46:15 +02:00
kimchy 9ac048c68c add "same" thread pool type (really, just for testing) 2011-02-18 07:59:14 +02:00
kimchy 585c310aa4 add edge histogram test 2011-02-18 07:35:33 +02:00
kimchy d8bec39b73 more support for wares 2011-02-18 05:03:46 +02:00
kimchy 8d867dc24c explicitly set the cat under which jdk logging is logged 2011-02-18 05:00:08 +02:00
kimchy 60578aef4d add name as another setting to set on snowball, not just language 2011-02-17 22:22:34 +02:00
kimchy c67912e259 reset stream when getting all stream so it can be reused 2011-02-17 19:25:23 +02:00
kimchy 9ca8165f3b Cluster Shutdown API: On full/_all shutdown, shutdown only data/master nodes, not client nodes, closes #697. 2011-02-17 03:33:34 +02:00
kimchy 245d241a5c handle any exception on first phase 2011-02-17 02:06:59 +02:00
kimchy 09d650fae7 Index Status: Peer recovery does not compute the index size correctly to report the full size, closes #695. 2011-02-17 01:43:56 +02:00
kimchy fb90392040 add status based test 2011-02-17 01:28:54 +02:00
kimchy 6ffd60dfb5 change var name to better reflect the fact that its data and not work 2011-02-17 01:07:05 +02:00
kimchy 3c9dafe67b better reason for disco state change 2011-02-16 23:30:40 +02:00
kimchy bc504d6c08 add simple netty benchmark 2011-02-16 08:17:31 +02:00
kimchy 2f5dd85bd5 change handlers from CHM to volatile Immutable Map 2011-02-16 05:24:29 +02:00
kimchy 3679efa840 default management TP to max at 20 2011-02-16 02:44:48 +02:00
kimchy 087f5d6bea fix scheduling to actually schedule the correct runnable 2011-02-16 02:44:24 +02:00
kimchy d1d3f8c4ca REST codes: Improve returned error codes on REST APIs, associate codes with internal exceptions, closes #690. 2011-02-16 01:41:01 +02:00
Lukáš Vlček 12a33e6a91 Add new Access-Control-Allow-Headers value into http response header, closes #688 2011-02-15 23:53:53 +02:00
kimchy 442ce9daaa ignore closed exception when async loading bloom filters 2011-02-15 23:23:49 +02:00
kimchy f14305e95c upgrade to jackson 1.7.3 2011-02-15 20:57:13 +02:00
kimchy 36efde8c1d simplify threaded listener invocation by wrapping the listener with a threaded listener and not check in each action for it 2011-02-15 07:52:24 +02:00
kimchy 3ed848a495 ThreadPool: Refactor into several pools, with configurable types per pool, closes #687. 2011-02-15 07:00:24 +02:00
kimchy 1b5cdb181a Query: boosting query, closes #683. 2011-02-11 19:59:15 +02:00
kimchy 65197ba39d don't return null highlighted fields if no highlighting was done 2011-02-11 18:31:09 +02:00
kimchy d054c8c14e use cached thread pool to do cluster state gateway snapshotting 2011-02-11 03:14:13 +02:00
kimchy e63e5f232c only actually fork to another thread if a flush is really needed 2011-02-11 02:35:02 +02:00
kimchy fc88cccfb4 only fork a refresh if it actually needs to be refreshed 2011-02-11 02:27:29 +02:00
kimchy 7c4d574a32 only call refresh if its needed, so we check outside of the readLock when async refreshing 2011-02-11 01:53:48 +02:00
kimchy df4f4f056a protected against a possible null for lastGC in the previous collection 2011-02-11 01:48:23 +02:00
kimchy 260aab21fd filtered collector should set the next reader on the wrapped collector 2011-02-11 00:34:20 +02:00
kimchy 44b06bee3b open indexing searcher lazily when indexing, and not when flushing 2011-02-10 20:31:01 +02:00
Alberto Paro 7bbf69b194 Added support to define rest actions in plugins 2011-02-10 19:00:17 +02:00
Alberto Paro 35c339f5f3 Removed empty fragments in highlight results 2011-02-10 19:00:17 +02:00
Alberto Paro 5ea58a3387 Don't fail search if highlight field is missing for a specific type. Close #682 2011-02-10 19:00:17 +02:00
kimchy a3af51a1d9 add fixed thread pool module so one can create it 2011-02-10 17:42:34 +02:00
kimchy 2e12e5b279 make optimize default parameters constants 2011-02-10 16:48:05 +02:00
kimchy 9ae9ab9553 add flush to search 1 stress test 2011-02-10 16:47:43 +02:00
kimchy 57108c8575 REST API: Failure to index docs that have their ids URL encoded and contain `/`, closes #681. 2011-02-10 03:18:01 +02:00
kimchy 89ac4d108a make forkjoin an option in fixed thread pool 2011-02-10 00:05:08 +02:00
kimchy 30510a8320 add forkjoin TP 2011-02-09 23:47:38 +02:00
kimchy 5e96d3d93d add fixed thread pool (mainly for internal testing for now) 2011-02-09 23:47:13 +02:00
kimchy 5047f4aa6f fix wrong parsing of of version / explain causing NPE on search 2011-02-09 22:56:52 +02:00
kimchy 2b8a6742dd move transport benchmark to the micro bench 2011-02-09 22:50:44 +02:00
kimchy b26d86293f terms facet on an IP field returns terms as numbers, not IPs, closes #678. 2011-02-09 21:37:42 +02:00
kimchy d35f397608 remove timer service 2011-02-09 19:01:05 +02:00
kimchy 9f2afeb4ca move to use scheduled TP and not timer service 2011-02-09 17:21:16 +02:00
kimchy 27d6c71d5b move to use scheduled TP and not timer service 2011-02-09 16:47:04 +02:00
kimchy ccb30d42e9 move to use a single thread for the scheduled tasks, forking where need to another TP 2011-02-09 16:25:09 +02:00
kimchy f6dced3750 upgrade to netty 3.2.4 2011-02-09 02:07:02 +02:00
kimchy d442f33d0b more api cleaning 2011-02-09 00:37:27 +02:00
kimchy f7aee2a423 clean thread pool interface 2011-02-09 00:30:21 +02:00
kimchy f09a66bf12 upgrade to latest jsr166y code 2011-02-09 00:26:09 +02:00
kimchy ff044c1882 Add safeJsonBuilder and safeSmileBuilder for cases where the builder needs to be used outside the scope of directly passing it to an API 2011-02-08 23:41:20 +02:00
kimchy 9c011d5b79 improve get perf by using bloom filter to fetch the doc 2011-02-08 23:40:49 +02:00
kimchy 7a8995e6a8 add max_size to bloom filter, defaults to 500m 2011-02-08 23:02:29 +02:00
kimchy 1db2d993cb have a 500 million docs cap on the creation of a bloom filter 2011-02-08 22:57:50 +02:00
kimchy 4bcedde011 don't require to provide the type of the doc in the doc element in percolator request, also, change the REST endpoint for percolator to include the type, basically: {index}/{type}/_percolate 2011-02-08 22:24:44 +02:00
kimchy 3062d5b86c nice usage of versioning parse element 2011-02-08 17:50:28 +02:00
kimchy ac8646deb7 Search: By default, don't return the version per hit, unless `version` is set to `true`, closes #676. 2011-02-08 17:48:13 +02:00
kimchy 18ff92662e bulk request does not refresh on shard replicas 2011-02-08 15:03:03 +02:00
kimchy 4084db378d more eager refresh logic, execute a refresh even if one is on going so no operations are missed 2011-02-08 12:52:45 +02:00
kimchy 37b1415b57 Improve error when creating a percolator with no query, closes #669. 2011-02-08 11:57:07 +02:00
kimchy da9f4992e0 flush with full=true is broken: this IndexWriter is closed, closes #670. 2011-02-08 11:50:23 +02:00
kimchy 059936fc84 make custom CMS static 2011-02-08 11:41:08 +02:00
kimchy 43a95de9db dynamic flag on object type should lower case itself when serialized back to its json representation 2011-02-08 11:38:02 +02:00
kimchy b8c644cab5 ip mapping no longer enabled 2011-02-08 11:24:14 +02:00
kimchy 490ddc5d1d ip mapping no longer enabled 2011-02-08 11:08:50 +02:00
Edward Dale f319625cb5 Adding Analysis.getWordList method which retrieves list of words from setting or file specified by setting. 2011-02-08 11:02:18 +02:00
Edward Dale c95544141b Adding a decompounding token filter. 2011-02-08 11:02:18 +02:00
kimchy a663b7ced9 default snowball token filter to English (similar to the analyzer) 2011-02-08 01:38:09 +02:00
kimchy 689b20a518 Mapping: Disable automatic ip type detection on new fields, closes #674. 2011-02-08 01:14:34 +02:00
kimchy 4319e3cb05 add a test to fetch just an array element (which has no mapping) 2011-02-07 20:24:15 +02:00
kimchy f0a8bf3783 remove monitoring dead locks 2011-02-06 23:37:38 +02:00
kimchy 3dc3206e0f don't use time estimator to wakeup a thread each time 2011-02-06 23:33:11 +02:00
kimchy 02a2ebb84b add geo_bbox as an alias to geo bounding box 2011-02-06 21:58:49 +02:00
kimchy 151e24c5bd upgrade to jackson 1.7.2 2011-02-03 23:36:55 +02:00
kimchy 1f68d7eabf when introducing a new type or new fields as part of an index request, wait (with a cap) until they are introduced on to the cluster before returning from the index request 2011-02-03 22:55:16 +02:00
kimchy 28dbbaa3fa allow to set an internal source builder on search request builder 2011-02-03 22:54:31 +02:00
kimchy 00cba66eb8 move to use mvel 2.1.RC1 2011-02-03 11:29:24 +02:00
kimchy 5fe2615ba7 Index Status: Add primary store size to include only primary shards store sizes, also move index store and translog into their own elements, closes #666. 2011-02-03 00:50:24 +02:00
kimchy 13869239b0 better help on -url for plugin command 2011-02-02 17:56:57 +02:00
kimchy 904bee12bc Search: Failure when sorting on `short` type, closes #665. 2011-02-02 17:55:21 +02:00
kimchy 95ea6153a7 no need for thread pool to notify listeners 2011-02-02 16:16:29 +02:00
kimchy da17be34c1 if no shards are allocated for a deleted index, then no need to wait for a response 2011-02-02 15:28:48 +02:00
kimchy 4ed82023ce another embedded test for query and fetch on a single shard 2011-02-02 14:04:24 +02:00
kimchy 0bce34cb5a optimize single shard search (or search result) by not doing another round of sorting 2011-02-02 13:52:34 +02:00
kimchy 8c196d8b84 better logging, and disable strange failure in thread locals test when run with gradle (for now) 2011-02-02 12:15:18 +02:00
kimchy 3f62b9ea96 check for trace logging 2011-02-02 11:25:13 +02:00
kimchy c86551d9b5 move master node tests to cluster package, and force it to use zen disco always 2011-02-02 11:15:12 +02:00
kimchy d2a3f5142f improve the order of shutdown of top level components in node, close indices first and applying cluster changes, also, improve atomicity of closing of indices and shards 2011-02-01 23:10:15 +02:00
kimchy eb1db1140b better to close the channels on another thread as well, just to be safe 2011-02-01 23:08:52 +02:00
kimchy 8587f16119 make sure to call releaseExternalResources on another thread to make sure its not called from a netty IO handler 2011-02-01 22:16:09 +02:00
kimchy 237e936884 if action is performing the operation, return true to indicate it 2011-02-01 17:00:59 +02:00
kimchy 8927e1dee4 Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663. 2011-02-01 13:41:58 +02:00
kimchy cc6f65f8b8 Search: When sorting, allow to pass `track_scores` and set it to `true` to get scores/max_score back, closes #662. 2011-02-01 12:38:46 +02:00
kimchy 5da14a7ed1 Geo: All geo components that accept an array of [lat, lon] to change to do [lon, lat] to conform with GeoJSON, closes #661. 2011-02-01 01:39:01 +02:00
kimchy f8b5628db9 have rolling restart stress test create incremental ids 2011-01-31 21:41:46 +02:00
kimchy c7add5f377 upgrade to mvel 2.1 snapshot to gain performance improvements 2011-01-31 21:41:23 +02:00
kimchy 54c770bcc9 improve hash wheel timer 2011-01-31 16:26:17 +02:00
kimchy cebdae5707 refactor script execution handling to improve performance, also introduce specific search script executor 2011-01-31 16:08:06 +02:00
kimchy 5d39cc93dd refresh for test 2011-01-31 15:51:39 +02:00
kimchy 04c2a2a543 move ngram to the default processor 2011-01-31 11:52:02 +02:00
kimchy e85f9c276f only allow _score to be used, and remove score from custom_score scripts 2011-01-31 02:19:41 +02:00
kimchy bdb87c7a62 refactor a bit search script execution 2011-01-31 01:29:30 +02:00
kimchy 919143f6b6 don't break if no document mapper exists 2011-01-31 00:00:24 +02:00
kimchy e516051ea5 Search: When fetching _parent, only the _id should be returned, and not type#id, closes #658. 2011-01-30 21:16:45 +02:00
kimchy 8b9ec890c3 Thread Pool: Increase the keep alive time of threads from 60 seconds to 60 minutes, closes #657. 2011-01-30 20:34:34 +02:00
kimchy 5b4846b0b6 Translog Flushing: Improve logic, flush not just by operations in the translog, closes #656. 2011-01-30 17:41:22 +02:00
kimchy 8884b575c1 more doc 2011-01-30 16:30:17 +02:00
kimchy 94c632b79b Java Client - Allow to set facets in binary format, closes #442. 2011-01-30 15:53:10 +02:00
kimchy e5db3175fb add explicit internal methods for getting doc fields 2011-01-30 00:34:50 +02:00
kimchy ad4bb464e8 upgraded to new trove, major upgrade, better perf, but damn, 2mb larger in size... 2011-01-30 00:05:56 +02:00
kimchy 0b09fd0806 Facets: Remove redundant data returned as part of facet response (for example, the field name being faceted), closes #655. 2011-01-29 20:44:58 +02:00
kimchy 7fa5b0cb57 only add highlighted fragments that have a score > 0 (when ending up using the default highlighter) 2011-01-29 15:29:25 +02:00
kimchy 2d94087f90 explicitly set optimize parameters when doing async merge 2011-01-29 04:11:56 +02:00
kimchy 4a27671d0c moe internal stats on translog 2011-01-29 04:04:58 +02:00
kimchy 332c4cfa53 use bloom filter to reduce seeks when needing to load version 2011-01-29 03:55:00 +02:00
kimchy ead4d600be add a test for term docs version deletes 2011-01-27 00:00:29 +02:00
kimchy 30f54fe23e change default async interval to 1 second, to do merges (if needed) more often 2011-01-26 23:29:24 +02:00
kimchy 00fa7c95fb improve test time 2011-01-26 23:04:10 +02:00
kimchy 5ecb847a3a improve test time 2011-01-26 22:59:35 +02:00
kimchy 24d5a758f0 fix thread name 2011-01-26 22:43:02 +02:00
kimchy c7e73e4558 tookInMillis is not serialized over network for bulk response 2011-01-26 22:41:41 +02:00
kimchy 6c21c30f31 Index Merge: Improve internal (segment) merging by not initiating it on doc operations, closes #653. 2011-01-26 22:39:40 +02:00
kimchy e1d56ea467 call maybeMerge outside of writeLock to reduce work done under writeLock 2011-01-26 17:16:32 +02:00
kimchy 5a4686aee5 Search: Allow to pass a search filter, applying only on the query (and not on facets for example), closes #650. 2011-01-26 12:55:30 +02:00
kimchy 10ff150bb8 don't log index missing exception when trying to optimize single shard search request 2011-01-25 18:29:28 +02:00
kimchy 00aad4c123 rename tests 2011-01-25 14:40:04 +02:00
kimchy a5e02d559f optimize single index conversion from alias to concrete index 2011-01-24 21:25:20 +02:00
kimchy 95dc08fa3b refactor search tests into separate packages 2011-01-24 16:06:28 +02:00
kimchy 256f1d3611 add a test for collector ordering 2011-01-24 13:58:09 +02:00
kimchy 9735d3e6d7 don't establish a connection between two client nodes 2011-01-24 13:34:43 +02:00
kimchy 9d75849362 better shutdown of sockets 2011-01-24 13:15:57 +02:00
kimchy 3537de4530 don't have the constructor private 2011-01-23 21:07:04 +02:00
kimchy 95b6184135 Terms Facets: Allow to get `all_terms` back (possibly with count 0), closes #647. 2011-01-23 16:09:18 +02:00
kimchy 85ee6eaf10 add logging on which state file failed to load 2011-01-23 02:59:42 +02:00
kimchy ce4f09c2b1 Strict dynamic setting: Refuse to index a document with fields not present in the mapping definition, closes #643. 2011-01-22 01:08:41 +02:00
kimchy 3907c8c680 add a test for custom type class name in token filter factory 2011-01-21 02:07:02 +02:00
kimchy 9801ddeb0d Analysis: Add phonetic token filter (metaphone, soundex, ...), closes #644. 2011-01-21 01:57:16 +02:00
kimchy 5316cd1931 should be debug logging, not warn 2011-01-20 17:38:24 +02:00
kimchy 545d8f35df No cluster name filtering when sniffing is not enabled, closes #637. 2011-01-20 17:28:45 +02:00
kimchy 9ff8006d37 have compilation and javadoc use UTF8 encoding 2011-01-20 14:24:12 +02:00
kimchy 034a66263a Analysis: Add stemming to czech analyzer, closes #642. 2011-01-20 13:30:48 +02:00
Lukáš Vlček e0fa15a365 added Czech Stemmer, closes #635 2011-01-20 12:34:51 +02:00
kimchy 04f8b55686 ES hangs connection when parent is not specified in bulk index, closes #641. 2011-01-20 12:28:55 +02:00