Commit Graph

2280 Commits

Author SHA1 Message Date
kimchy 77cf3e1924 small refactor in index settings, allowing for future dynamic changes to it 2011-03-08 11:12:40 +02:00
kimchy e709a0bde4 Logging: Add merge level logging, closes #755. 2011-03-08 08:20:48 +02:00
kimchy 9e2143f343 add a warning for types not to include dots (can't really throw a failure because of it since it will break backward) 2011-03-07 19:17:39 +02:00
kimchy 4bdae621f9 Scripts: Allow to register native scripts (Java) for better script execution performance, closes #752. 2011-03-07 13:09:07 +02:00
kimchy 1242cf59f6 upgrade to guice 3 rc3 2011-03-07 06:52:55 +02:00
kimchy cb912de255 ignore engine closed exception as well 2011-03-05 10:46:00 +02:00
kimchy f0825414d3 upgrade to jackson 1.7.4 2011-03-05 10:45:20 +02:00
kimchy bc882182ab change scripts to start the ElasticSearch main class (a wrapper around Bootstrap) just so the process name will look nicely on jps 2011-03-04 20:14:22 +02:00
kimchy c097735196 improve async merge process, don't spawn a thread unless a merge is really needed, and add an optimized "maybeMerge" operation 2011-03-04 20:05:52 +02:00
kimchy 20ed540fe7 don't block node master node startup if recover_after_time is set and nodes settings are not met (we already handle it with the not recovered state) 2011-03-04 05:11:28 +02:00
kimchy 4b92928c77 Internal: Improve checksum process by bulk writing them into a single file instead of checksum file per index file, closes #747. 2011-03-04 04:22:47 +02:00
kimchy b629d36d8b add a merge thread pool that only does async merges (optimize), so it can be controlled by itself 2011-03-04 01:04:59 +02:00
kimchy 06ad13f373 no need to call maybe merge as part of flush, we do it async anyhow 2011-03-04 00:56:34 +02:00
kimchy 607ada75a6 optimize the index status response 2011-03-04 00:55:39 +02:00
kimchy 41ddcdca93 Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:26:47 +02:00
kimchy f901429aaa Node Stats API: Change the structure of the response (more structured), closes #746. 2011-03-04 00:20:05 +02:00
kimchy 682ad7e2fc Indices Status / Node Stats: Add (Lucene) index merge stats, closes #745. 2011-03-03 23:53:28 +02:00
kimchy 2909060af8 Query DSL: flt_field does not allow to set min_similarity and prefix_length, closes #744. 2011-03-03 04:17:02 +02:00
kimchy 78c6f951a3 All Field: All field cane fail to analyze input data (rare cases), closes #743. 2011-03-03 02:59:27 +02:00
kimchy 68c1dd771c upgrade to mvel 2.1 beta2 2011-03-02 22:37:36 +02:00
kimchy 4631df9d01 Delete API: Allow to set _parent on it (will simply set the routing value), closes #742. 2011-03-02 22:14:49 +02:00
kimchy 655cbb9440 improve failure when disabling dynamic creating of types, and trying to index into a non existing type 2011-03-02 20:42:43 +02:00
kimchy faefc772a4 Searching while an index is being allocated and no active shards exists within a "shard replication group" can cause search "misses", closes #736. 2011-03-02 05:11:02 +02:00
kimchy bb1668c2b7 count date histo using the wrong counts aggregator to return results when using time based setting interval 2011-03-02 03:13:25 +02:00
kimchy 3361a9365b since we now take all#enabled into account when checking for include_in_all, there is no need to set it on every mapper 2011-03-02 03:01:01 +02:00
kimchy 185cd68045 really fix time format interval for date_histogram now 2011-03-02 00:39:18 +02:00
kimchy 1d240aaff6 prefix inside a dis_max / bool query broken, closes #732. 2011-03-02 00:36:30 +02:00
kimchy ce862da8f4 add tests for boosted wildcard and prefix queries 2011-03-02 00:26:49 +02:00
kimchy 9560451896 optimize query facet to extract filter from constant_score queries automatically 2011-03-02 00:18:26 +02:00
kimchy 60b423b741 Don't "double" cache a facet filter / query facet, closes #734. 2011-03-01 22:14:36 +02:00
kimchy 0e30ad90f5 support 'w' as suffix for time format 2011-03-01 20:16:18 +02:00
kimchy 0183516221 better failure message 2011-03-01 05:34:21 +02:00
kimchy e639ffbc93 Search: Allow to use has_child filter in facets, closes #730. 2011-03-01 04:45:25 +02:00
kimchy 6097365738 eer Recovery: Batch translog based operation recovery based on size and not just number of operations, closes #729. 2011-03-01 00:49:41 +02:00
kimchy 9d81d01c93 only flush when the index shard is in STARTED mode (nothing will break flushing on non started index, just remove a possible warn logging) 2011-03-01 00:26:03 +02:00
kimchy 0662f65fda log warning when failing to list started shards on other nodes when doing local gateway allocation 2011-03-01 00:25:03 +02:00
kimchy 906ec57f20 Ids with # in them will cause search failures, also, fail when # is used in a type name, closes #728. 2011-02-28 22:43:48 +02:00
kimchy 3bac33e69e don't use AfterTest / BeforeTest in any tests 2011-02-28 22:28:55 +02:00
kimchy 24199a3394 add simple unicast disco test on hte node level 2011-02-28 21:43:31 +02:00
kimchy 47a6065805 Date Histogram Facet: NPE if using "1w" interval, closes #727. 2011-02-28 20:31:02 +02:00
kimchy d395c0a844 better failure message when failing to find a type mapping for a document loaded from the index 2011-02-28 20:21:47 +02:00
kimchy 3b967040da Percolate: Failure to percolate with specific query (when creating the _percolate index before the actual index), closes #725. 2011-02-27 01:06:50 +02:00
kimchy fdef88debb Bulk API: Improve memory usage when executing large bulk requests, closes #724. 2011-02-26 23:46:22 +02:00
kimchy 3cda177b9b Zen Discovery: Rename `discovery.zen.initial_ping_timeout` to `discovery.zen.ping_timeout` (still support the old setting), closes #723. 2011-02-26 22:25:26 +02:00
kimchy 4634ca5cb8 Mapping: When _all is disabled, optimize to not gather all entries, closes #722. 2011-02-26 04:16:03 +02:00
kimchy 608c5a838d Index Filter Cache: Add `resident` type, and `max_size` to `soft`/`weak` types, closes #721. 2011-02-25 03:54:18 +02:00
kimchy ecc1a3cd8c Acknowledge problem for put mapping with multiple indices or all indices, closes #720. 2011-02-24 21:17:24 +02:00
kimchy 4def1f4b8e upgrade to google guava r08 2011-02-24 08:49:38 +02:00
kimchy 8a03ca1114 Search: Allow to filter out docs based on a minimum score, closes #719. 2011-02-24 06:55:16 +02:00
kimchy a0fd47159e improve internal scan handling, by using count type for the first scan 2011-02-24 01:04:49 +02:00
kimchy ee9beda398 Search: Add search_type for `count` to return count but still support facets, closes #718. 2011-02-24 00:29:42 +02:00
kimchy f7100c0698 Improve from hits pagination (duplicates), closes #717. 2011-02-23 22:57:44 +02:00
kimchy 6b7192e744 add from/to test without sorting on single shard 2011-02-23 21:41:31 +02:00
kimchy 5082ad6d11 Clear Cache API: Add specific cache clear for `id`, `filter`, `field_data`, `bloom`, closes #716. 2011-02-23 21:17:09 +02:00
kimchy 8371920a89 add min/max to terms stats facet 2011-02-23 20:36:12 +02:00
kimchy be1b46061e add filter and scope parameters when creating terms stats facet 2011-02-23 19:37:20 +02:00
kimchy 8617e3b0e3 enhance memory usage when doing reduce on histogram facets 2011-02-23 05:55:23 +02:00
kimchy 9cccfc3bd3 improve terms stats facet internal data structure and sorting 2011-02-23 05:04:45 +02:00
kimchy 2845cbefaa move to mvel 2.1.beta1 (versioning changed from 2.1.rc1) 2011-02-23 02:32:56 +02:00
kimchy 1a48007174 Single node cluster comes up as red with local gateway, closes #714. 2011-02-23 01:21:17 +02:00
kimchy 58dbf6d5ca fix terms facet TOTAL comparator to also do secondary sort when totals are equal 2011-02-23 00:55:40 +02:00
kimchy c6f58321e4 Node Stats: Add number of docs per node, closes #713. 2011-02-22 22:27:12 +02:00
kimchy 45ec2c6e21 Allow to register custom rivers under a custom type name (And not full class names), closes #712. 2011-02-22 22:13:31 +02:00
kimchy 06850f8673 add another test to scan 2011-02-22 21:01:11 +02:00
kimchy 7dda421cfa River not recovered when using single node after shutdown, closes #711. 2011-02-22 20:38:52 +02:00
kimchy 953fcbc58c Get API: Allow to provide a script as a field, closes #708. 2011-02-22 02:28:19 +02:00
kimchy 818f3b4d75 Search: Add search type `scan` allowing to efficiently scan large result set, closes #707. 2011-02-22 00:11:31 +02:00
kimchy 65ca857027 Add `http` and `transport` simplified host settings, closes #706. 2011-02-21 19:51:18 +02:00
kimchy be372bee7d ignore a case where we can't find an index trying to apply shards, it gets deleted on us 2011-02-20 02:04:44 +02:00
Benoit Sigoure fcdd103345 Simplify some error-handling logic a bit. 2011-02-20 00:45:25 +02:00
kimchy d76f12a9f3 return 0 as prefix / suffix content length for utf8 response 2011-02-20 00:18:48 +02:00
kimchy 352cb74f96 Search: Terms Stats Facet, closes #705. 2011-02-19 23:37:04 +02:00
kimchy 745614f53d notify listener on failure 2011-02-19 23:19:02 +02:00
kimchy d3ba8bd487 use parsing field to check for order 2011-02-19 01:41:48 +02:00
kimchy d7a02fb28f Handle cluster join request on a non IO thread, closes #702. 2011-02-18 23:46:15 +02:00
kimchy 9ac048c68c add "same" thread pool type (really, just for testing) 2011-02-18 07:59:14 +02:00
kimchy 585c310aa4 add edge histogram test 2011-02-18 07:35:33 +02:00
kimchy d8bec39b73 more support for wares 2011-02-18 05:03:46 +02:00
kimchy 8d867dc24c explicitly set the cat under which jdk logging is logged 2011-02-18 05:00:08 +02:00
kimchy 60578aef4d add name as another setting to set on snowball, not just language 2011-02-17 22:22:34 +02:00
kimchy c67912e259 reset stream when getting all stream so it can be reused 2011-02-17 19:25:23 +02:00
kimchy 9ca8165f3b Cluster Shutdown API: On full/_all shutdown, shutdown only data/master nodes, not client nodes, closes #697. 2011-02-17 03:33:34 +02:00
kimchy 245d241a5c handle any exception on first phase 2011-02-17 02:06:59 +02:00
kimchy 09d650fae7 Index Status: Peer recovery does not compute the index size correctly to report the full size, closes #695. 2011-02-17 01:43:56 +02:00
kimchy fb90392040 add status based test 2011-02-17 01:28:54 +02:00
kimchy 6ffd60dfb5 change var name to better reflect the fact that its data and not work 2011-02-17 01:07:05 +02:00
kimchy 3c9dafe67b better reason for disco state change 2011-02-16 23:30:40 +02:00
kimchy bc504d6c08 add simple netty benchmark 2011-02-16 08:17:31 +02:00
kimchy 2f5dd85bd5 change handlers from CHM to volatile Immutable Map 2011-02-16 05:24:29 +02:00
kimchy 3679efa840 default management TP to max at 20 2011-02-16 02:44:48 +02:00
kimchy 087f5d6bea fix scheduling to actually schedule the correct runnable 2011-02-16 02:44:24 +02:00
kimchy d1d3f8c4ca REST codes: Improve returned error codes on REST APIs, associate codes with internal exceptions, closes #690. 2011-02-16 01:41:01 +02:00
Lukáš Vlček 12a33e6a91 Add new Access-Control-Allow-Headers value into http response header, closes #688 2011-02-15 23:53:53 +02:00
kimchy 442ce9daaa ignore closed exception when async loading bloom filters 2011-02-15 23:23:49 +02:00
kimchy f14305e95c upgrade to jackson 1.7.3 2011-02-15 20:57:13 +02:00
kimchy 36efde8c1d simplify threaded listener invocation by wrapping the listener with a threaded listener and not check in each action for it 2011-02-15 07:52:24 +02:00
kimchy 3ed848a495 ThreadPool: Refactor into several pools, with configurable types per pool, closes #687. 2011-02-15 07:00:24 +02:00
kimchy 1b5cdb181a Query: boosting query, closes #683. 2011-02-11 19:59:15 +02:00
kimchy 65197ba39d don't return null highlighted fields if no highlighting was done 2011-02-11 18:31:09 +02:00
kimchy d054c8c14e use cached thread pool to do cluster state gateway snapshotting 2011-02-11 03:14:13 +02:00
kimchy e63e5f232c only actually fork to another thread if a flush is really needed 2011-02-11 02:35:02 +02:00
kimchy fc88cccfb4 only fork a refresh if it actually needs to be refreshed 2011-02-11 02:27:29 +02:00
kimchy 7c4d574a32 only call refresh if its needed, so we check outside of the readLock when async refreshing 2011-02-11 01:53:48 +02:00
kimchy df4f4f056a protected against a possible null for lastGC in the previous collection 2011-02-11 01:48:23 +02:00
kimchy 260aab21fd filtered collector should set the next reader on the wrapped collector 2011-02-11 00:34:20 +02:00
kimchy 44b06bee3b open indexing searcher lazily when indexing, and not when flushing 2011-02-10 20:31:01 +02:00
Alberto Paro 7bbf69b194 Added support to define rest actions in plugins 2011-02-10 19:00:17 +02:00
Alberto Paro 35c339f5f3 Removed empty fragments in highlight results 2011-02-10 19:00:17 +02:00
Alberto Paro 5ea58a3387 Don't fail search if highlight field is missing for a specific type. Close #682 2011-02-10 19:00:17 +02:00
kimchy a3af51a1d9 add fixed thread pool module so one can create it 2011-02-10 17:42:34 +02:00
kimchy 2e12e5b279 make optimize default parameters constants 2011-02-10 16:48:05 +02:00
kimchy 9ae9ab9553 add flush to search 1 stress test 2011-02-10 16:47:43 +02:00
kimchy 57108c8575 REST API: Failure to index docs that have their ids URL encoded and contain `/`, closes #681. 2011-02-10 03:18:01 +02:00
kimchy 89ac4d108a make forkjoin an option in fixed thread pool 2011-02-10 00:05:08 +02:00
kimchy 30510a8320 add forkjoin TP 2011-02-09 23:47:38 +02:00
kimchy 5e96d3d93d add fixed thread pool (mainly for internal testing for now) 2011-02-09 23:47:13 +02:00
kimchy 5047f4aa6f fix wrong parsing of of version / explain causing NPE on search 2011-02-09 22:56:52 +02:00
kimchy 2b8a6742dd move transport benchmark to the micro bench 2011-02-09 22:50:44 +02:00
kimchy b26d86293f terms facet on an IP field returns terms as numbers, not IPs, closes #678. 2011-02-09 21:37:42 +02:00
kimchy d35f397608 remove timer service 2011-02-09 19:01:05 +02:00
kimchy 9f2afeb4ca move to use scheduled TP and not timer service 2011-02-09 17:21:16 +02:00
kimchy 27d6c71d5b move to use scheduled TP and not timer service 2011-02-09 16:47:04 +02:00
kimchy ccb30d42e9 move to use a single thread for the scheduled tasks, forking where need to another TP 2011-02-09 16:25:09 +02:00
kimchy f6dced3750 upgrade to netty 3.2.4 2011-02-09 02:07:02 +02:00
kimchy d442f33d0b more api cleaning 2011-02-09 00:37:27 +02:00
kimchy f7aee2a423 clean thread pool interface 2011-02-09 00:30:21 +02:00
kimchy f09a66bf12 upgrade to latest jsr166y code 2011-02-09 00:26:09 +02:00
kimchy ff044c1882 Add safeJsonBuilder and safeSmileBuilder for cases where the builder needs to be used outside the scope of directly passing it to an API 2011-02-08 23:41:20 +02:00
kimchy 9c011d5b79 improve get perf by using bloom filter to fetch the doc 2011-02-08 23:40:49 +02:00
kimchy 7a8995e6a8 add max_size to bloom filter, defaults to 500m 2011-02-08 23:02:29 +02:00
kimchy 1db2d993cb have a 500 million docs cap on the creation of a bloom filter 2011-02-08 22:57:50 +02:00
kimchy 4bcedde011 don't require to provide the type of the doc in the doc element in percolator request, also, change the REST endpoint for percolator to include the type, basically: {index}/{type}/_percolate 2011-02-08 22:24:44 +02:00
kimchy 3062d5b86c nice usage of versioning parse element 2011-02-08 17:50:28 +02:00
kimchy ac8646deb7 Search: By default, don't return the version per hit, unless `version` is set to `true`, closes #676. 2011-02-08 17:48:13 +02:00
kimchy 18ff92662e bulk request does not refresh on shard replicas 2011-02-08 15:03:03 +02:00
kimchy 4084db378d more eager refresh logic, execute a refresh even if one is on going so no operations are missed 2011-02-08 12:52:45 +02:00
kimchy 37b1415b57 Improve error when creating a percolator with no query, closes #669. 2011-02-08 11:57:07 +02:00
kimchy da9f4992e0 flush with full=true is broken: this IndexWriter is closed, closes #670. 2011-02-08 11:50:23 +02:00
kimchy 059936fc84 make custom CMS static 2011-02-08 11:41:08 +02:00
kimchy 43a95de9db dynamic flag on object type should lower case itself when serialized back to its json representation 2011-02-08 11:38:02 +02:00
kimchy b8c644cab5 ip mapping no longer enabled 2011-02-08 11:24:14 +02:00
kimchy 490ddc5d1d ip mapping no longer enabled 2011-02-08 11:08:50 +02:00
Edward Dale f319625cb5 Adding Analysis.getWordList method which retrieves list of words from setting or file specified by setting. 2011-02-08 11:02:18 +02:00
Edward Dale c95544141b Adding a decompounding token filter. 2011-02-08 11:02:18 +02:00
kimchy a663b7ced9 default snowball token filter to English (similar to the analyzer) 2011-02-08 01:38:09 +02:00
kimchy 689b20a518 Mapping: Disable automatic ip type detection on new fields, closes #674. 2011-02-08 01:14:34 +02:00
kimchy 4319e3cb05 add a test to fetch just an array element (which has no mapping) 2011-02-07 20:24:15 +02:00
kimchy f0a8bf3783 remove monitoring dead locks 2011-02-06 23:37:38 +02:00
kimchy 3dc3206e0f don't use time estimator to wakeup a thread each time 2011-02-06 23:33:11 +02:00
kimchy 02a2ebb84b add geo_bbox as an alias to geo bounding box 2011-02-06 21:58:49 +02:00
kimchy 151e24c5bd upgrade to jackson 1.7.2 2011-02-03 23:36:55 +02:00
kimchy 1f68d7eabf when introducing a new type or new fields as part of an index request, wait (with a cap) until they are introduced on to the cluster before returning from the index request 2011-02-03 22:55:16 +02:00
kimchy 28dbbaa3fa allow to set an internal source builder on search request builder 2011-02-03 22:54:31 +02:00
kimchy 00cba66eb8 move to use mvel 2.1.RC1 2011-02-03 11:29:24 +02:00
kimchy 5fe2615ba7 Index Status: Add primary store size to include only primary shards store sizes, also move index store and translog into their own elements, closes #666. 2011-02-03 00:50:24 +02:00
kimchy 13869239b0 better help on -url for plugin command 2011-02-02 17:56:57 +02:00
kimchy 904bee12bc Search: Failure when sorting on `short` type, closes #665. 2011-02-02 17:55:21 +02:00
kimchy 95ea6153a7 no need for thread pool to notify listeners 2011-02-02 16:16:29 +02:00
kimchy da17be34c1 if no shards are allocated for a deleted index, then no need to wait for a response 2011-02-02 15:28:48 +02:00
kimchy 4ed82023ce another embedded test for query and fetch on a single shard 2011-02-02 14:04:24 +02:00
kimchy 0bce34cb5a optimize single shard search (or search result) by not doing another round of sorting 2011-02-02 13:52:34 +02:00
kimchy 8c196d8b84 better logging, and disable strange failure in thread locals test when run with gradle (for now) 2011-02-02 12:15:18 +02:00
kimchy 3f62b9ea96 check for trace logging 2011-02-02 11:25:13 +02:00
kimchy c86551d9b5 move master node tests to cluster package, and force it to use zen disco always 2011-02-02 11:15:12 +02:00
kimchy d2a3f5142f improve the order of shutdown of top level components in node, close indices first and applying cluster changes, also, improve atomicity of closing of indices and shards 2011-02-01 23:10:15 +02:00
kimchy eb1db1140b better to close the channels on another thread as well, just to be safe 2011-02-01 23:08:52 +02:00
kimchy 8587f16119 make sure to call releaseExternalResources on another thread to make sure its not called from a netty IO handler 2011-02-01 22:16:09 +02:00
kimchy 237e936884 if action is performing the operation, return true to indicate it 2011-02-01 17:00:59 +02:00
kimchy 8927e1dee4 Search Scripts: Allow to access score in facet related scripts using `doc.score`, closes #663. 2011-02-01 13:41:58 +02:00
kimchy cc6f65f8b8 Search: When sorting, allow to pass `track_scores` and set it to `true` to get scores/max_score back, closes #662. 2011-02-01 12:38:46 +02:00
kimchy 5da14a7ed1 Geo: All geo components that accept an array of [lat, lon] to change to do [lon, lat] to conform with GeoJSON, closes #661. 2011-02-01 01:39:01 +02:00
kimchy f8b5628db9 have rolling restart stress test create incremental ids 2011-01-31 21:41:46 +02:00
kimchy c7add5f377 upgrade to mvel 2.1 snapshot to gain performance improvements 2011-01-31 21:41:23 +02:00
kimchy 54c770bcc9 improve hash wheel timer 2011-01-31 16:26:17 +02:00
kimchy cebdae5707 refactor script execution handling to improve performance, also introduce specific search script executor 2011-01-31 16:08:06 +02:00
kimchy 5d39cc93dd refresh for test 2011-01-31 15:51:39 +02:00
kimchy 04c2a2a543 move ngram to the default processor 2011-01-31 11:52:02 +02:00
kimchy e85f9c276f only allow _score to be used, and remove score from custom_score scripts 2011-01-31 02:19:41 +02:00
kimchy bdb87c7a62 refactor a bit search script execution 2011-01-31 01:29:30 +02:00
kimchy 919143f6b6 don't break if no document mapper exists 2011-01-31 00:00:24 +02:00
kimchy e516051ea5 Search: When fetching _parent, only the _id should be returned, and not type#id, closes #658. 2011-01-30 21:16:45 +02:00
kimchy 8b9ec890c3 Thread Pool: Increase the keep alive time of threads from 60 seconds to 60 minutes, closes #657. 2011-01-30 20:34:34 +02:00
kimchy 5b4846b0b6 Translog Flushing: Improve logic, flush not just by operations in the translog, closes #656. 2011-01-30 17:41:22 +02:00
kimchy 8884b575c1 more doc 2011-01-30 16:30:17 +02:00
kimchy 94c632b79b Java Client - Allow to set facets in binary format, closes #442. 2011-01-30 15:53:10 +02:00
kimchy e5db3175fb add explicit internal methods for getting doc fields 2011-01-30 00:34:50 +02:00
kimchy ad4bb464e8 upgraded to new trove, major upgrade, better perf, but damn, 2mb larger in size... 2011-01-30 00:05:56 +02:00
kimchy 0b09fd0806 Facets: Remove redundant data returned as part of facet response (for example, the field name being faceted), closes #655. 2011-01-29 20:44:58 +02:00
kimchy 7fa5b0cb57 only add highlighted fragments that have a score > 0 (when ending up using the default highlighter) 2011-01-29 15:29:25 +02:00
kimchy 2d94087f90 explicitly set optimize parameters when doing async merge 2011-01-29 04:11:56 +02:00
kimchy 4a27671d0c moe internal stats on translog 2011-01-29 04:04:58 +02:00
kimchy 332c4cfa53 use bloom filter to reduce seeks when needing to load version 2011-01-29 03:55:00 +02:00
kimchy ead4d600be add a test for term docs version deletes 2011-01-27 00:00:29 +02:00
kimchy 30f54fe23e change default async interval to 1 second, to do merges (if needed) more often 2011-01-26 23:29:24 +02:00
kimchy 00fa7c95fb improve test time 2011-01-26 23:04:10 +02:00
kimchy 5ecb847a3a improve test time 2011-01-26 22:59:35 +02:00
kimchy 24d5a758f0 fix thread name 2011-01-26 22:43:02 +02:00
kimchy c7e73e4558 tookInMillis is not serialized over network for bulk response 2011-01-26 22:41:41 +02:00
kimchy 6c21c30f31 Index Merge: Improve internal (segment) merging by not initiating it on doc operations, closes #653. 2011-01-26 22:39:40 +02:00
kimchy e1d56ea467 call maybeMerge outside of writeLock to reduce work done under writeLock 2011-01-26 17:16:32 +02:00
kimchy 5a4686aee5 Search: Allow to pass a search filter, applying only on the query (and not on facets for example), closes #650. 2011-01-26 12:55:30 +02:00
kimchy 10ff150bb8 don't log index missing exception when trying to optimize single shard search request 2011-01-25 18:29:28 +02:00
kimchy 00aad4c123 rename tests 2011-01-25 14:40:04 +02:00
kimchy a5e02d559f optimize single index conversion from alias to concrete index 2011-01-24 21:25:20 +02:00
kimchy 95dc08fa3b refactor search tests into separate packages 2011-01-24 16:06:28 +02:00
kimchy 256f1d3611 add a test for collector ordering 2011-01-24 13:58:09 +02:00
kimchy 9735d3e6d7 don't establish a connection between two client nodes 2011-01-24 13:34:43 +02:00
kimchy 9d75849362 better shutdown of sockets 2011-01-24 13:15:57 +02:00
kimchy 3537de4530 don't have the constructor private 2011-01-23 21:07:04 +02:00
kimchy 95b6184135 Terms Facets: Allow to get `all_terms` back (possibly with count 0), closes #647. 2011-01-23 16:09:18 +02:00
kimchy 85ee6eaf10 add logging on which state file failed to load 2011-01-23 02:59:42 +02:00
kimchy ce4f09c2b1 Strict dynamic setting: Refuse to index a document with fields not present in the mapping definition, closes #643. 2011-01-22 01:08:41 +02:00
kimchy 3907c8c680 add a test for custom type class name in token filter factory 2011-01-21 02:07:02 +02:00
kimchy 9801ddeb0d Analysis: Add phonetic token filter (metaphone, soundex, ...), closes #644. 2011-01-21 01:57:16 +02:00
kimchy 5316cd1931 should be debug logging, not warn 2011-01-20 17:38:24 +02:00
kimchy 545d8f35df No cluster name filtering when sniffing is not enabled, closes #637. 2011-01-20 17:28:45 +02:00
kimchy 9ff8006d37 have compilation and javadoc use UTF8 encoding 2011-01-20 14:24:12 +02:00
kimchy 034a66263a Analysis: Add stemming to czech analyzer, closes #642. 2011-01-20 13:30:48 +02:00
Lukáš Vlček e0fa15a365 added Czech Stemmer, closes #635 2011-01-20 12:34:51 +02:00
kimchy 04f8b55686 ES hangs connection when parent is not specified in bulk index, closes #641. 2011-01-20 12:28:55 +02:00
kimchy b4467c7d1f use caching scorer when there are multiple collectors, so if they call score as well, it will not be computed again 2011-01-19 22:59:28 +02:00
kimchy 7359f7983f handle rest HEAD on / path 2011-01-19 21:56:53 +02:00
kimchy b1d13febbf Percolate on Index and Bulk, closes #636. 2011-01-19 16:45:45 +02:00
kimchy 2eb8278a80 better logging when not allocating a shard due to required number of existing shards 2011-01-19 00:30:56 +02:00
kimchy 574c455203 Terms Facet: Add option include counts where term is missing, closes #632. 2011-01-18 21:51:16 +02:00
kimchy e4a6e99f69 improve handling when not to persist current state to gateway based on blocks and have a block indicate if it also blocks state persistence 2011-01-18 15:28:55 +02:00
kimchy 87d5a92edb move handling of recovered metadata to GatewayService, reducing code duplication in different gateway implementations 2011-01-18 14:38:10 +02:00
kimchy a4c2087511 initial not recovered block on node init, and remove it as usual (once node is initialized / recovered) 2011-01-18 14:08:45 +02:00
kimchy 4750ccdc1c move nullable annotation to the common package, and move javax inject (from guice 3) to internal common as well 2011-01-17 19:45:37 +02:00
kimchy ba725f8986 fix a (rare) case where search will fail due to failed serialization 2011-01-17 14:37:36 +02:00
kimchy b4e5a542f3 internal refactoring/simplification in percolator 2011-01-17 13:57:32 +02:00
kimchy f2bd2c7bbd protect against a case when string field data value is null 2011-01-17 12:39:11 +02:00
kimchy 89d31bbfde properly print debug statement when nodes based operations fail 2011-01-17 12:38:08 +02:00
kimchy f55fa4223e improve loading queries by adding all of them in batch to the executor 2011-01-17 11:11:13 +02:00
kimchy 20c77a2ac5 clear the percolator reader from the cache explicitly 2011-01-17 10:11:14 +02:00
kimchy 1f289df128 more append benchmark 2011-01-16 12:47:54 +02:00
kimchy 285afe8053 add refresh interval to os/process/network info api which represents the refresh interval of their respective stats 2011-01-16 12:33:23 +02:00
kimchy c0e2e14c36 fix javadoc 2011-01-15 02:15:36 +02:00
kimchy 998f5f4188 add lt(Object) to range filter builder 2011-01-15 02:15:29 +02:00
kimchy 771e028e54 simple fs bench test 2011-01-15 02:14:10 +02:00
kimchy 2381f668f8 wait for mappings to be created on other nodes before returning from the put mapping request 2011-01-15 02:13:57 +02:00
kimchy f8b1d1eebd add explicit type missing exception when trying to search on a type that is not registered 2011-01-14 17:53:45 +02:00
kimchy a8be99b7e0 Node Stats: Process / Network / Os should only refresh every 5 seconds (refresh_interval to set it), closes #626. 2011-01-14 16:00:55 +02:00
kimchy 38d10d19bc Add `prefer_local` flag to analyze and percolate request, closes #625. 2011-01-14 01:01:37 +02:00
kimchy ff347858c5 properly report teh files and size recovered when doing primary local gateway recovery 2011-01-13 23:59:35 +02:00
kimchy 7fc04a4ab6 make sure to close the term docs when loading version 2011-01-13 22:49:56 +02:00
kimchy ad236d19ee add logging if failing to execute on a node 2011-01-13 16:51:06 +02:00
kimchy 180d225016 Percolator, closes #624. 2011-01-13 16:20:31 +02:00
kimchy 2d180eb28a upgrade to sigar 1.6.4 2011-01-13 16:02:35 +02:00
kimchy 577135db97 upgrade jackson to 1.7.1 2011-01-13 15:50:58 +02:00
kimchy 7213539d72 factor out exists collector 2011-01-12 20:51:19 +02:00
kimchy f8b1a8e38b add internal event when an index shard is started 2011-01-12 20:47:35 +02:00
kimchy 5e27e3fca4 support reader as well 2011-01-12 17:11:23 +02:00
kimchy 85b6a982d4 A setting to auto expand the number of replicas of an index (based on data nodes), closes #623. 2011-01-12 16:27:36 +02:00
kimchy f5a9f2d948 If the cluster does not contain any indices then index templates do not survive cluster restart, closes #617. 2011-01-11 23:38:46 +02:00
kimchy a0a714e6a5 Shared Gateway: Allow to set the number of concurrent streams doing snapshot operations, closes #621. 2011-01-11 22:03:44 +02:00
kimchy 93dec72e43 optimize a filtered query with match_all query into a constant score that just wraps the filter 2011-01-11 19:17:17 +02:00
kimchy 6130ac2ee7 optimize query facet in case the query is a filtered query with match_all query to use just the filter 2011-01-11 18:49:05 +02:00
kimchy ba9a12e201 Mapper: Add `byte` type (8bit signed), closes #620. 2011-01-11 16:01:10 +02:00
kimchy 38ea07cfbe fix field data cache setting: used under index.cache.field.type, available values: resident, soft, weak 2011-01-11 06:33:24 +02:00
kimchy a5432ba7ce limit the number of addresses to try and connect to when doing unicast discovery with just the host and not the port to 5 2011-01-11 00:53:53 +02:00
kimchy 90d005a330 add trace logging to unicast discovery 2011-01-10 23:30:46 +02:00
kimchy 50cdf2920f Make ToXContent return a builder 2011-01-10 22:11:12 +02:00
kimchy 89314f29a7 improve multi value field cache handling both in terms of memory usage and GC behavior 2011-01-10 20:58:31 +02:00
kimchy 233ed1f8c6 improve multi value field cache handling both in terms of memory usage and GC behavior 2011-01-10 20:18:12 +02:00
kimchy cb8ceb1a39 upgrade to guice 3.0 rc2 2011-01-10 17:49:39 +02:00
kimchy d4246da7b3 /_open is not recovering indices correctly, closes #615. 2011-01-09 23:31:10 +02:00
kimchy d650705a03 refresh param to bulk not working, closes #614. 2011-01-09 22:06:51 +02:00
kimchy 373af6b1e0 use fs channel to write to file to improve speed of adding to translog 2011-01-09 20:53:40 +02:00
kimchy 5c08271e74 improve numeric stream analysis performance 2011-01-09 19:35:24 +02:00
kimchy 3c3d01347e improve all stream analysis performance 2011-01-09 02:51:41 +02:00
kimchy 8de7beadc8 Highlighting: Sometimes highlighting returns empty fragments even thought there should be, closes #613. 2011-01-08 03:19:49 +02:00
kimchy 7364159d69 NPE for when passing null date to content builder, closes #610. 2011-01-07 23:28:57 +02:00
kimchy 286a6fac76 upgrade to jackson 1.7, also fix (really unused case) of getting compressed smile stored through REST with smile context type 2011-01-07 16:35:52 +02:00
kimchy b9be6d9ea7 Geo-distance in scripts (like custom_score), closes #607. 2011-01-07 15:22:11 +02:00
kimchy 8b8bad7572 build on aferreira improvements to handle empty parameters with no =, and improve component decoding logic 2011-01-07 14:34:34 +02:00
Adriano Ferreira 2d81acbbf2 Adding test for edge cases of RestUtils.decodeQueryString()
When writing tests for the fix of decodeQueryString() to
handle gracefully edge cases like:

    &a
    &a&b

it arises the question of what behavior is desirable
for these pathological cases (vs the regular p=v pairs).
This change just skips them which is consonant
to the preexisting code.

To be thorough, we add tests for a bunch of edge cases, like:

    QUERY           PARSED PARAMS

    ?               {}
    ?&              {}
    ?=              { "": "" }
    ?a              {}
    ?p=v&a          { "p": "v" }
    ?p=v&a&p1=v1    { "p": "v", "p1": "v1" }
    ?a&b            {}
2011-01-07 14:13:26 +02:00
Adriano Ferreira 154dcf007e Make RestUtils.decodeQueryString() more robust in edge cases
The code of decodeQueryString() had some trouble with weird URLs:

(1) an input like "uri?param&p=v" causes an exception to be thrown
(2) an input like "uri?param1&param2" causes an infinite loop

This could be verified against an ES server with requests like

    curl -XGET localhost:9200/test/_analyze?t&text=this+is+a+test
    # the exception stack trace shows up in logs

    curl -XGET localhost:9200/test/_analyze?t1&t2&text=this+is+a+test
    # never returns, never ends

This change fixes these issues.
2011-01-07 14:13:25 +02:00
Adriano Ferreira edb075b611 Minor changes to RestUtils.decodeQueryString() tests
Testing

    RestUtils.decodeQueryString("something", "something".indexOf('?') + 1, params);

is not really checking decoding of an empty query.
Instead, it is testing decoding of "something"
as a query (because "something.index('?')+1" evaluates to 0).
The parameter map is left empty because
"malformed" pairs like "something" are currently skipped.

Instead, this change modify this test to check the edge cases:

+ fromIndex >= queryString.length()
+ fromIndex < 0
2011-01-07 14:13:25 +02:00
kimchy fe0f9ebc9d make lucene document creation allowed to be indexed twice 2011-01-07 14:09:39 +02:00
kimchy c7cb353956 fix serialization of count request 2011-01-06 20:44:36 +02:00
kimchy 6a0a9ff374 parse query with offset 2011-01-06 16:13:15 +02:00
kimchy b9e808f755 improve version loading by going directly to the relevant reader 2011-01-06 11:50:16 +02:00
kimchy 26c5f6c482 Allow ./bin/plugin to install plugins from the local filesystem / custom url, closes #595. 2011-01-06 10:46:42 +02:00
kimchy cc5978393b with the new stemmer analyzer, don't break when there is no language stopwords, but just create it without stopwords 2011-01-06 09:53:56 +02:00
harryf 4a45df88c6 Add Snowball stemmer as analyzer and filter 2011-01-06 09:40:49 +02:00
kimchy 66d63055df Add to node stats the number of times field cache was evicted due to memory constraints, closes #603. 2011-01-05 22:37:15 +02:00
kimchy 754b0d7a0f Add `resident` field cache type, closes #602. 2011-01-05 21:23:47 +02:00
kimchy 0954df0623 change the default interval for gc checks to 1 second 2011-01-05 20:40:52 +02:00
kimchy 31231531e1 Highlighting: The result of highlighting for a hit can contain data from another document, closes #600. 2011-01-05 15:45:46 +02:00
kimchy 6258915205 Bulk API: Add how long the bulk API took (in milliseconds) to the response, closes #599. 2011-01-05 14:12:45 +02:00
kimchy 29b308005a try to be more predictable when doing pagination (still can return duplicates when going to different shards) by sorting on the shards results based on the shard id first 2011-01-04 23:42:44 +02:00
kimchy 0faa05b3f2 add more integration versioning tests 2011-01-04 18:09:46 +02:00
kimchy 9423378f27 add heavy concurrent updates to same doc, and make sure it has the same data on all replicas 2011-01-04 17:44:33 +02:00
kimchy 45c1ab06b3 Versioning, closes #594. 2011-01-04 04:04:30 +02:00
kimchy 9335b3a9e6 Search: Add a `timed_out` element indicating if the search request timed out, closes #592. 2011-01-03 15:25:24 +02:00
kimchy ff6d7254fe optimize query parsing to use single field parser when executing on single field 2011-01-03 15:14:28 +02:00
kimchy 2c8c6aa22a add a uid scan benchmark to check perf 2011-01-03 14:34:38 +02:00
kimchy dc17d10b81 small refactor 2011-01-03 13:32:09 +02:00
kimchy 5e029865a8 Des.config=/path/to/config/file doesn't replace $ES_HOME/elasticsearch.conf, just appends to it, closes #588. 2011-01-03 12:53:50 +02:00
kimchy ccdbbef276 don't send leave request when the master node is null 2011-01-03 12:01:33 +02:00
kimchy d2a70b21cd key (which is time) can be negative as well 2011-01-02 22:03:52 +02:00
kimchy 07d361816e Search: Date Histogram Facet, closes #591. 2011-01-02 15:07:45 +02:00
kimchy d523104b91 add some sanity tests with joda for date time manipulation 2011-01-01 23:48:25 +02:00
kimchy b7b775228e add some sanity tests with joda for date time manipulation 2011-01-01 23:40:46 +02:00
kimchy aec720218d Histogram Facet: Improve perf / memory by defaulting to just providing counts with no totals, closes #587. 2011-01-01 17:27:55 +02:00
kimchy 45b93e2781 add histogram facet benchmark 2011-01-01 16:33:18 +02:00
kimchy e6b4834768 Highlighting: Allow to highlight on fields without term vectors, closes #585. 2010-12-31 18:57:26 +02:00
kimchy 7c959e7ec3 Master based operations (create index, delete index) to automatically retry on retryable cluster blocks (like recovery from gateway) 2010-12-31 14:09:45 +02:00
kimchy a92dbc537a those two should not be final... 2010-12-31 00:23:04 +02:00
Tim Dysinger fd593acafe make every static field final (immutable) 2010-12-31 00:22:31 +02:00
Tim Dysinger 6b672e29f5 Remove infinite loop typo 2010-12-31 00:01:45 +02:00
kimchy 82298d890c Terms Facet: Performance and memory improvements when faceting numeric fields, closes #583. 2010-12-30 19:45:36 +02:00
kimchy 019359a896 add more scanning options on the field data cache 2010-12-30 17:08:32 +02:00
kimchy 6c8b06c967 clean unused method 2010-12-30 16:45:12 +02:00
kimchy 8e8a3a894f upgrade testing framework jars, improve build scripts to share the testing jars 2010-12-30 16:08:38 +02:00
kimchy fea93b7fea Delete By Query: Types are not serialized over network, causing them to be ignored, closes #580. 2010-12-30 14:43:08 +02:00
kimchy 789e1a343f failing to load plugins, return an empty map 2010-12-30 13:16:09 +02:00
kimchy 2e46add991 remove debugging dead code 2010-12-30 13:14:49 +02:00
kimchy 51277a9486 no need to check for shard if tis null, we know its not 2010-12-30 13:12:08 +02:00
kimchy c4646a2b55 use close helper method to close streams 2010-12-30 13:11:20 +02:00
kimchy 76d042f3c5 explicitly pass null values to methods where applicable 2010-12-30 13:09:11 +02:00
kimchy 5a45e9c8bd close stream if file not found (though a stream is not really opened in this case...) 2010-12-30 12:30:50 +02:00
kimchy 20b6e0bdde close stream if file not found (though a stream is not really opened in this case...) 2010-12-30 12:30:33 +02:00
kimchy 4f8b4b405c though not really needed (working on in memory byte array), close the stream opened 2010-12-30 12:27:46 +02:00
kimchy ed996c3e85 Non-data master nodes and non-master data nodes fail to store data, closes #579. 2010-12-30 12:10:40 +02:00
kimchy e3322836b5 make settings prefix simpler and not bail when not prefixed with org.elasticsearch, allow to provide settings prefix for analyzer provider 2010-12-29 19:12:38 +02:00
kimchy f73a5e62d3 improve error message 2010-12-29 18:55:37 +02:00
kimchy c7fca8f0e0 refactor terms facet into string terms facets, paving the way for optimized ones for numeric values 2010-12-29 18:34:08 +02:00
kimchy e764f41341 await closing sockets on shutdown 2010-12-29 12:49:37 +02:00
kimchy f993c4b72b start refactoring of facets to make them more pluggable 2010-12-29 12:49:02 +02:00
kimchy c8bfa455ad REST Create Index: Not taking JSON index settings into account unless wrapped in settings. 2010-12-29 12:10:51 +02:00
kimchy d8aef57baa add filter_cache_size to node stats 2010-12-28 16:57:55 +02:00
kimchy f908a73ec6 allow to construct transport client with settings builder 2010-12-27 20:11:28 +02:00
kimchy a84e0a49b7 change scope to _score 2010-12-27 19:19:17 +02:00
kimchy d73a459f1e when parent mapping is set, fix setting routing to required 2010-12-27 18:41:28 +02:00
kimchy d560ceabe4 use high transport type when sending the cluster state 2010-12-27 16:50:55 +02:00
kimchy 4245eb7395 add node level field cache size to node stats api 2010-12-26 12:18:15 +02:00
kimchy 5dcba8a38c revert back a stupid bug in setting compress to true always introduced in the last commit 2010-12-26 12:05:22 +02:00
kimchy 49deb80d03 when compression is enabled, use the compressed byte buffer to write it to the translog (less data to write), and handle recovery by being able to parse also compressed source 2010-12-24 01:09:15 +02:00
kimchy f2eae5b605 Memory Index Store: Separate to two buffer size types, and fix bugs, closes #577. 2010-12-23 23:21:32 +02:00
kimchy 22fa91efa0 add reconnection code between nodes that are not masters 2010-12-23 17:26:55 +02:00
kimchy f6afc01fe5 add reconnection code between nodes that are not masters 2010-12-23 17:26:32 +02:00
kimchy ff5990daec listener should be threaded 2010-12-23 17:24:23 +02:00
kimchy de7dd3c070 default to try and connect after network disconnection with fault detection 2010-12-23 16:51:09 +02:00
kimchy e313379ed5 only force shutdown on cached threadpool if its not the same as the execture service 2010-12-23 16:13:05 +02:00
kimchy 42e8567477 interrupt joining the cluster thread if shutting down 2010-12-23 16:11:43 +02:00
kimchy 5f25ae4f2f check if the scheduled thread pool is not terminated when trying to terminate it 2010-12-23 15:18:22 +02:00
kimchy 9f72a8d68b use cached thread pool for notifying on disconnections 2010-12-23 14:22:40 +02:00
kimchy 6dcc04b59c Transport: Increase the default transport.tcp.connect_timeout from 1s to 30s, also add `network.tcp.connect_timeout` to conform with other common network settings, closes #576. 2010-12-23 14:20:11 +02:00
kimchy 5c338b7af2 add message to connect transport failure exception 2010-12-23 13:05:39 +02:00
kimchy 5a58ed4274 when replacing a mapping, clear the aggregated mapping information and then readd it 2010-12-23 11:32:16 +02:00
kimchy 473c2fa8f4 add reason for state change logging in index shard, add debug logging on ignore recovery in when handling cluster change in indices cluster 2010-12-23 10:56:37 +02:00
kimchy 5ac42f2a4f Excessive mapping parsing when cluster state changes, closes #575. 2010-12-23 09:53:05 +02:00
kimchy f869951364 rename type method on MapperService to the more descriptive documentMapperWithAutoCreate 2010-12-23 08:43:17 +02:00
kimchy e0b2b4b4a6 add a warn when not using the custom FieldCache with eager reader based eviction 2010-12-23 07:58:43 +02:00
kimchy 800b7f39bd add toString to CompressedString to show when logging it 2010-12-23 07:45:04 +02:00
kimchy 3b30930460 improve logging when trying to delete unallocated shard, check first if deleting is required, and only then delete it 2010-12-23 07:37:49 +02:00
kimchy ac73334c87 make id cache an index component, so a new instance will be created per index 2010-12-22 14:21:59 +02:00
kimchy bb0d7190e9 make id cache an index component, so a new instance will be created per index 2010-12-22 14:21:31 +02:00
kimchy 1ee24ce60f add an option to provide an OutputStream to a builder, allowing to generate directly into a stream provided by the user 2010-12-22 13:26:29 +02:00
kimchy eef3a95fa6 move the query parser cache to be index level and not node level 2010-12-22 12:31:30 +02:00
kimchy 33339ae4b1 improve concurrency control in filter caching, reuse one if it was created already under concurrent request 2010-12-22 10:42:38 +02:00
kimchy d283c158d2 optimize for the more common case of single value facets when loading values 2010-12-22 09:04:35 +02:00
kimchy 59ee8493ce use public terms filter in all places 2010-12-21 23:43:05 +02:00
kimchy a1df3c637c improve logic of when to load fields from source, only if they actually have mappings, otherwise, ignore them (as was the previous behavior) 2010-12-21 13:02:15 +02:00
kimchy 3035254885 Search API: Allow to pass `&fields=` without any fields to cause only id and type to be returned, closes #572. 2010-12-21 12:01:51 +02:00
kimchy a96b294de0 add multicast socket to execption message 2010-12-20 20:07:51 +02:00
kimchy efc95dc00a Java Search API: Passing a the query as json fails, closes #568. 2010-12-20 11:31:09 +02:00
kimchy 789073639d fix transport client compilation problem, the client cluster service was not used and removed 2010-12-19 05:50:07 +02:00
kimchy 8dfc3acba0 when using dates in scripts, initialize the dates (DateTime) with UTC 2010-12-19 05:01:59 +02:00
kimchy 96a2950ab5 Disable calling mlockall by default, can be enabled by setting bootstrap.mlockall to `true`, closes #567. 2010-12-19 02:30:48 +02:00
kimchy 415bb5d7f3 Java TransportClient: By default, don't sniff other nodes and use addresses provided as is, closes #565. 2010-12-17 19:31:28 +02:00
kimchy 005c6d9124 allow to set term index divisor 2010-12-16 21:56:59 +02:00
kimchy ff0eeb3d1a improve getting setting as array, automatically support comma delimited values under the exact setting 2010-12-16 05:02:24 +02:00
kimchy f827b7cff5 fix settings 2010-12-16 00:48:26 +02:00
kimchy d6bab1a892 Tcp Transport: Connection pool between nodes and different connection types, closes #564. 2010-12-15 20:11:10 +02:00
kimchy 085066ed19 set, by default, the send and receive buffers to 32k on tcp 2010-12-15 05:54:09 +02:00
kimchy 36be13ffb3 bring back the file chunk size in recovery to 100kb from 500kb 2010-12-15 01:28:21 +02:00
kimchy b6277ac14d increase netty worker count to default to the updated value netty defaults to 2010-12-15 01:16:00 +02:00
kimchy bb178c9c1a cleanup 2010-12-13 21:30:26 +02:00
kimchy d0eed79175 add log message on hte concurrent streams used 2010-12-13 00:08:57 +02:00
kimchy ceb7b90740 Recovery: Allow to control `concurrent_streams` (per node) during recovery 2010-12-13 00:03:04 +02:00
kimchy 1c5477d4ed Improve local node recovery process, removing using a block as indication for an index not being recovered. Moving to shard replication group level allocation (with the ability to distinguish between api based creation or recovery based creation). This also allows for throttling based control on initial local gateway based shard allocation. 2010-12-12 22:46:27 +02:00
kimchy bc04243a2b Search Fields: If a field is not stored, automatically extract it from _source (without the need for _source prefix), closes #562. 2010-12-12 05:00:24 +02:00
kimchy 216b2ab912 Highlighting: Automatically use the field values extracted from _source if not stored explicitly in the mapping, closes #561. 2010-12-12 04:40:25 +02:00
kimchy fe3f5d45de remove global settings from the settings conf, a relic that is no longer needed... 2010-12-12 02:37:36 +02:00
kimchy dddca692b8 add search hit phase, which operates on a hit, and have all relevant hit phases implement and use it 2010-12-12 02:01:13 +02:00
kimchy be4b2e2de6 externalize script search lookup into a generalized lookup that can be used outside of scripts 2010-12-12 01:01:56 +02:00
kimchy a914865c45 Close API might cause index data to be wiped, closes #560. 2010-12-10 22:19:45 +02:00
kimchy bc2dc9465a add to the receive timeout exception the request id that it timed out on 2010-12-10 12:40:39 +02:00
kimchy 2a7f964ca2 Geo search fails to find some docs when wrapping over IDL, closes #559. 2010-12-10 08:39:10 +02:00
kimchy 9d2fe162fa better log message 2010-12-10 00:17:55 +02:00
kimchy 3f6ed7e1de improve update mapping on master, if we end up with the same mappings as the one the cluster state has, no need for a new cluster state... 2010-12-10 00:17:10 +02:00
kimchy 167d35807c Add terms/in query, alias terms filter to be in filter as well, closes #557. 2010-12-09 07:25:05 +02:00
kimchy 0828f18738 better child bench 2010-12-09 06:11:06 +02:00
kimchy e1495ff8be add scrolling update test 2010-12-08 20:56:09 +02:00
kimchy 34f3f3f79e Aliased analyzers cause index deletion / cleanup failure, closes #555. 2010-12-08 19:30:38 +02:00
kimchy f5a8c3881f add debug logging on failed bug items executions 2010-12-08 01:21:21 +02:00
kimchy 54437c1bd3 Parent / Child Support, closes #553. 2010-12-08 00:16:05 +02:00
kimchy 1a8017d17e upgrade to jackson 1.6.3 2010-12-07 09:14:13 +02:00
kimchy 22c27e4ff8 correct field name 2010-12-05 00:02:53 +02:00
kimchy d3cae103d5 wait for green status in test 2010-12-04 23:57:44 +02:00
kimchy d659bd0479 upgrade to jackson 1.6.2 2010-12-04 00:46:57 +02:00
kimchy a90684aaa5 Upgrade to Lucene 3.0.3, closes #549. 2010-12-03 20:43:51 +02:00
kimchy d9610ed0a1 Search API: Optimize single shard search to `QUERY_AND_FETCH` from any other search type, closes #547. 2010-12-01 03:59:03 +02:00
kimchy 3ea19a514b Index Setting: Add `index.refresh_interval` to simplify setting instead of "index.engine.robin.refresh_interval` (still works), closes #546. 2010-12-01 03:38:41 +02:00
kimchy 2b039bd0b0 change the default chunk size when recovering from the default 100kb to 500kb. 2010-11-29 14:33:49 +02:00
kimchy c0945831e8 Search Scroll API: Allow to provide the scroll id as the body of the scroll request, closes #545. 2010-11-29 13:59:30 +02:00
kimchy 103221e58a remove the timed out message, can be misleading 2010-11-29 02:55:23 +02:00
kimchy 84f97e96a5 Scrolling issues, fix releasing search context eagerly, they should not be released when scrolling, closes #136. 2010-11-29 02:05:45 +02:00
kimchy 6d9576c217 Reduce the number of concurrent recoveries per node to 2 from number_of_processors, closes #543. 2010-11-28 16:35:39 +02:00
kimchy a222de1dbf internal change to scope based collectors 2010-11-28 14:57:17 +02:00
kimchy 8285ffe221 encode scroll id with base64 in url safe manner 2010-11-28 02:23:38 +02:00
kimchy cfa8c9aa79 Index / Index Template: Allow to define `_default_` mapping, closes #542. 2010-11-27 23:30:18 +02:00
kimchy 526f28f479 Create Index API: Allow to provide mappings. closes #541. 2010-11-27 00:28:18 +02:00
kimchy 151715dc2f also merge lists 2010-11-27 00:05:11 +02:00
kimchy 577f06fd43 add indices API to groovy client 2010-11-26 22:19:57 +02:00
kimchy 73e5eb9e14 clean compile warnings 2010-11-26 16:03:25 +02:00
kimchy 6dab568a4b Index Templates, closes #540. 2010-11-26 15:53:04 +02:00
kimchy ebd6316db9 Index templates, closes #540. 2010-11-26 15:45:18 +02:00
kimchy d150ac2da4 Search API: Add how long the search took (in milliseconds), closes #536. 2010-11-24 13:27:32 +02:00
kimchy 51273587de Bulk API: Add refresh flag, closes #535. 2010-11-24 00:58:48 +02:00
kimchy 4a3e5b6348 Query Cache: Invalidate the query cache when mappings change, closes #532. 2010-11-23 15:26:19 +02:00
kimchy 9479ac636e Delete Mapping API: Wrongly deleting existing mapping information, closes #531. 2010-11-23 14:56:03 +02:00
kimchy 3b2b901db0 improve error handling, we can't always parse the source to a stirng 2010-11-23 00:41:53 +02:00
kimchy db1f7e09f3 Support date and ip types for `numeric_range` filter, closes #530. 2010-11-22 16:17:51 +02:00
kimchy b4113d57d3 Analyze API: An API to analyzer custom text based on an optional analyzer, closes #529. 2010-11-21 17:33:35 +02:00
kimchy 8689e5cf16 more cleaning of shards iterators 2010-11-21 14:49:57 +02:00
kimchy e183fbd6ad add shards iterator that can iterate over unrelated list of shards 2010-11-21 14:27:22 +02:00
kimchy 7db5e63ab7 rename shardsIt to shardIt 2010-11-21 13:54:44 +02:00
kimchy a74465000d rename single operation base support to single shard operation 2010-11-21 13:26:36 +02:00
kimchy c40eaaae38 serializing get result should use the same construct as search hit fields 2010-11-20 18:38:43 +02:00
kimchy 58ecc4f77f cleanup single operation action support 2010-11-20 18:23:13 +02:00
kimchy 03f66b0c45 log4j syslog appender don't load, closes #527. 2010-11-19 22:08:18 +02:00
kimchy 1560e05e01 upgrade to mvel 2.0.19 2010-11-19 21:40:12 +02:00
kimchy fdb98b1dcb Highlighting bug where fragments are broken when number_of_fragments is 0, closes #479. 2010-11-18 20:52:51 +02:00
kimchy d1ef445632 clean thread local vars eagerly 2010-11-18 20:22:42 +02:00
kimchy 16ed69daa3 add routing to delete by query rest endpoint 2010-11-18 13:46:45 +02:00
kimchy cf4f6decc4 add a test for overloaded method of builder and List 2010-11-18 02:25:22 +02:00
kimchy 282a7a5162 Add non inspection checks 2010-11-18 02:05:32 +02:00
kimchy 44775c2aa8 Routing: Allow to define `path` on the `_routing` mapping, to automatically extract the routing from it, closes #524. 2010-11-17 17:05:51 +02:00
kimchy 4e75f3de4a republish the cluster state if a node exists in the cluster 2010-11-17 11:33:33 +02:00
kimchy 0172eaea89 add broadcasting when no routing and its marked as required to bulk delete as well 2010-11-16 18:53:32 +02:00
kimchy 619efea940 Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522. 2010-11-16 18:31:43 +02:00
kimchy a04d8ec5ad Routing: When specify in the mapping _routing required, a delete without explicit routing value should automatically be broadcasted to all shards, closes #522. 2010-11-16 18:31:08 +02:00
kimchy 2483a37db5 fix comparator implementation in histogram facet 2010-11-16 15:30:27 +02:00
kimchy e7fdea8858 fix underscore casing to transform Name to name, and not _name 2010-11-16 15:16:54 +02:00
kimchy 02981f6101 Routing: Allow to specify on the `_routing` mapping that its required, and fail index operations that do not provide one, closes #520. 2010-11-16 15:10:41 +02:00
kimchy 8a8a6d5547 Mapping: Rename _attributes to _meta, closes #518. 2010-11-16 01:34:01 +02:00
kimchy b8b4cbbb46 add mapping metadata to cluster state metadata, will allow in the future to add specific mappings hints (since we don't have the parsed mapping on each node anymore) 2010-11-15 21:21:18 +02:00
kimchy 51c18cd9c1 refactor ip field mapper into its own package 2010-11-15 19:21:23 +02:00
kimchy 36183af22c automatically use match_all query when executing a _all:* query string 2010-11-15 17:15:24 +02:00
kimchy effdd52586 sync changes done on the indices cluster service with changes happening in an async manner during recovery 2010-11-15 16:54:29 +02:00
kimchy 4b06eeb75a better desc 2010-11-15 16:39:16 +02:00
kimchy a342029d36 Histogram Facet: Allow to define a key field and value script, closes #517. 2010-11-15 15:05:50 +02:00
kimchy 5c6c4bfb5a Histogram Facet: Allow to define a key field and value script, closes #517. 2010-11-15 15:02:35 +02:00
kimchy b1db5c43d6 Mapper: `date` type to also allow providing values in numeric (milliseconds since epoch), closes #516. 2010-11-15 14:12:54 +02:00
kimchy 6d214d69b9 Mapper: Store the routing (if provided) under a `_routing` field, closes #515. 2010-11-15 11:34:56 +02:00
kimchy 8ee038574d add _routing to documetn indexed when providing routing value 2010-11-14 21:23:52 +02:00
kimchy 9505cb14f1 bring back the retry on shard missing 2010-11-14 21:02:46 +02:00
kimchy fa1d8c7bcd only remove the shard (not clean it) when ignoring recovery 2010-11-14 20:09:27 +02:00
kimchy 37335bc6a9 also retry when there are no routing shards, might happen in case of recovery from gateway before shard routing initialization 2010-11-14 20:09:00 +02:00
kimchy d0ac9087b6 add bootstrap.mlockall setting to control if mlockall should be called or not 2010-11-14 15:54:40 +02:00
kimchy 30929c3d01 better logging, include index and shard id in log statement 2010-11-14 00:24:51 +02:00
kimchy 31986c4486 add a check to not allow to create an alias with a name of an existing index 2010-11-13 18:53:12 +02:00
kimchy 73bf371912 fix exception logging on failed index creation 2010-11-13 18:08:11 +02:00
kimchy 38d77f8cf3 Query DSL: Allow to provide pattern field names when using query_string query, closes #511. 2010-11-13 02:26:14 +02:00
kimchy 6839cc6965 clear memory after parsing a doc, and not on parsing of a new doc 2010-11-12 15:36:23 +02:00
kimchy d994a862dd add support for analyzer mapping when the mapping is not indexd nor stored 2010-11-12 14:54:28 +02:00
kimchy bba98cf1b7 cleanup traversing unneeded mappings 2010-11-12 14:50:05 +02:00
kimchy beb77c9b0a fix a bug in mapping serialization (introduced on 0.13), where properties gets underscore cased by mistake, and not retain their original naming 2010-11-11 15:38:20 +02:00
kimchy 17cba798e6 add double restart test for local gateway 2010-11-11 14:08:58 +02:00
kimchy 70a0e110d4 apping: add threshold to _source field compression, closes #506. 2010-11-10 21:03:54 +02:00
kimchy a2e674df49 add filteredQuery to QueryBuilders to conform with xxxQuery notation 2010-11-10 00:03:33 +02:00
kimchy 4c6af6afa5 Cluster health API should return RED status (on applicable levels) when an index has not recovered from the gateway, closes #507. 2010-11-09 21:25:22 +02:00
kimchy 4695f93276 add index routing table changed 2010-11-09 16:31:21 +02:00
kimchy d0e0b85178 add many indices stress test 2010-11-09 16:22:50 +02:00
kimchy 8ceba0dca1 don't overflow with cluster events if the index level block was removed already 2010-11-09 15:42:27 +02:00
kimchy 36bf5ee9fe add toString to cluster block 2010-11-09 15:41:47 +02:00
kimchy a0f4359ffa handle any exception when failing to snapshot 2010-11-09 15:34:43 +02:00
kimchy 8266315f51 handle any exception when failing to snapshot 2010-11-09 15:34:17 +02:00
kimchy f9fb67616d don't write checksum file for the segments file, we anyhow recover it and that way the index can be read by pure Lucene code 2010-11-09 14:27:28 +02:00
kimchy b5f1a1b49c Parsing a deeply nested json might fail 2010-11-09 10:26:15 +02:00
kimchy 33ff95af05 add more trove helpers 2010-11-09 09:35:35 +02:00
kimchy 8e2db2c68f rename field to path in _analyzer mapping 2010-11-09 09:16:47 +02:00
kimchy 6b5e884b93 have the default path value for analyzer mapper to be _analyzer. 2010-11-09 08:59:30 +02:00
kimchy 6567fcaf35 remove an index level block if its empty (make no sense to keep an empty set for it, also, shouldn't shot it back in APIs) 2010-11-09 00:08:30 +02:00
kimchy c69b94d769 rename field to path in _analyzer mapping 2010-11-08 11:07:34 +02:00
kimchy c9228ed26d Get Action: Allow to pass refresh forcing getting latest, closes #488. 2010-11-07 23:51:18 +02:00
kimchy c095d72439 Get Action: Allow to pass refresh forcing getting latest, closes #488. 2010-11-07 23:50:48 +02:00
kimchy e51523385d Analysis: Allow to alias analyzers, closes #486. 2010-11-07 20:10:53 +02:00
kimchy 171fa4a7e8 Mapper: An analyzer mapper allowing to control the index analyzer of a document based on a document field, closes #485. 2010-11-07 18:18:24 +02:00
kimchy b45ade467e send transport exception is a wrapper exception around the actual exception 2010-11-07 17:56:50 +02:00
kimchy c9e8a2ac68 no need to pass the id mapprt to serialization twice... 2010-11-07 16:00:27 +02:00
kimchy d77a0c41d0 make sure attributes are also serialized across restarts 2010-11-07 15:32:37 +02:00
kimchy 598225f833 document level analyzer (analyzer, index_analyzer, search_analyzer) are not serialized (and not maintained across restarts), closes #484. 2010-11-07 13:13:29 +02:00
kimchy 7340d6973d slim down the mapping serialization to xcontent (json), don't write default values 2010-11-07 12:33:44 +02:00
kimchy e44604b441 better transport exception handling, refactor out an action based transport exception, and don't fill stack trace only for remote ones 2010-11-07 04:08:05 +02:00
kimchy ef3e7fe62b renamve method 2010-11-07 00:02:58 +02:00
kimchy 6b952f6719 Fs Gateway: Add (native) file lock to ensure two nodes in a split brain are not updating same gateway, closes #481. 2010-11-06 23:27:46 +02:00
kimchy 998bde0820 Add an option to display max_open_files, by setting -Des.max-open-files to `true`, closes #483. 2010-11-06 22:47:09 +02:00
kimchy b568174bee add a comment on why we don't mark as relocated when relcoating primaries 2010-11-06 22:03:11 +02:00
kimchy 87efccf677 expose boolean and Object as values for TermQueryBuilder and FieldQueryBuilder 2010-11-06 01:04:14 +02:00
kimchy 129b9a3938 Query DSL: Allow to control (globally) the max clause count for `bool` query (defaults to 1024), closes #482. 2010-11-06 00:59:37 +02:00
kimchy 9385476340 fix expected setting, had an additional _ by mistake 2010-11-05 20:54:01 +02:00
kimchy 53a98275cf remove unused variable 2010-11-05 18:39:10 +02:00
kimchy 99a3e615ab Improve performance when searching across multiple types, closes #478. 2010-11-04 20:34:49 +02:00
kimchy bbd63f0ffe constant_score query might apply deletes wrongly, closes #477. 2010-11-04 20:18:05 +02:00
kimchy 770ccf421b don't write the local gateway state if there is no master, since we don't want to override the fact that they do exists on that node under the respective version 2010-11-04 12:17:17 +02:00
kimchy e2d6f82cd3 Mapper: Add `path_match` for full object navigation path matching, closes #476. 2010-11-04 10:55:19 +02:00
kimchy 805d43c77a properly clean index shard and index level data when deleting them 2010-11-03 15:34:30 +02:00
kimchy 6e0180db6a refactor node data location of index and shard into common code 2010-11-03 15:07:23 +02:00
kimchy 6804c02e97 Create specific `data` location for indices (move from work), closes #473. 2010-11-03 14:41:29 +02:00
kimchy 92b3ae3f73 Change single operation shard hashing to only use id, and not id and type, closes #472. 2010-11-03 12:47:34 +02:00
kimchy 8d454ba293 Query DSL: Add `field_masking_span` query, closes #471. 2010-11-02 23:50:28 +02:00
kimchy a62f1f3e0d API: Allow to control document shard routing, and search shard routing, closes #470. 2010-11-02 19:56:18 +02:00
kimchy 8e2e85f460 enhance bulk stress test 2010-11-02 14:01:22 +02:00
kimchy 3fe2851dae Index Merge: Change default `index.merge.scheduler.max_thread_count` from ` to be adaptive based on processor count, closes #469. 2010-11-02 14:00:58 +02:00
kimchy 2cdaf6357b Rivers: Add a _status doc for each river, closes #468. 2010-11-02 12:09:45 +02:00
kimchy ef4c44577a add toString to match_all docs 2010-11-02 10:23:05 +02:00
kimchy 4ff1b429f1 Possible (rare) shard index corruption / different doc count on recovery (gateway / shard), closes #466. 2010-11-01 23:00:16 +02:00
kimchy 49439a09e2 fix logging 2010-11-01 20:42:10 +02:00
kimchy f79719beaa fix parsing of bytes value 2010-10-31 15:47:19 +02:00
kimchy feb854b742 On full cluster restart, replicas transaction logs are not getting cleaned, closes #465. 2010-10-31 14:36:10 +02:00
kimchy b8fa68f97a check if the commit point has a size at all, if not, not flushed yet, its ok 2010-10-31 12:23:56 +02:00
kimchy c14783d3e2 remove jarjar'ed files that are not needed (notice, license) 2010-10-31 11:45:10 +02:00
kimchy e6b4a8b55c remove inclusion of config and logging file in jar 2010-10-31 10:50:35 +02:00
kimchy 96a1ad6335 When on linux, force it not to swap elasticsearch process (jvm), closes #464. 2010-10-30 19:40:24 +02:00
kimchy 1feb43a0af Index: Move compound format setting to `index.compound_format` (old setting still supported), closes #463. 2010-10-30 18:24:28 +02:00
kimchy db24148413 fix listAll when using switch dir to return unique list of files 2010-10-30 01:26:00 +02:00
kimchy b315c5f848 add getOffsetGap to field analyzer 2010-10-29 19:05:11 +02:00
kimchy 8f7a8dabc1 only flush if there is something to flush 2010-10-29 17:50:51 +02:00
kimchy 11c55185e8 add another test 2010-10-29 00:22:49 +02:00
kimchy c194fa67e9 default logger (when embedded in java) to log with org.elasticsearch prefix for simpler logging configruation 2010-10-28 23:39:37 +02:00
kimchy 7082593166 add term filter toString 2010-10-28 23:18:24 +02:00
kimchy e31cbb5267 fix NPE when enabling trace logging 2010-10-28 21:47:55 +02:00
kimchy 4579c04a9e Mapper: Ip Type Support (ipv4), auto detection with dynamic mapping, closes #461. 2010-10-28 12:02:20 +02:00
kimchy 6f8b859d90 better inet address serialization, also better handle ipv6 2010-10-28 01:48:54 +02:00
kimchy e7fdf16402 add number of data nodes to cluster health 2010-10-28 00:39:53 +02:00
kimchy d487d809ea Query DSL: Revert back and have range, terms, and prefix filter _cache set to true, closes #456. 2010-10-27 20:34:24 +02:00
kimchy 3a9dc8f452 change back to cached thread pool 2010-10-27 20:13:42 +02:00
kimchy 185f5a9e18 Search: Change default operation threading to `thread_per_shard` from `single_thread`, closes #455. 2010-10-27 19:51:49 +02:00
kimchy ca67c12de5 add and/not/or docid sets, not just docsets, and improve caching behavior 2010-10-27 18:16:15 +02:00
kimchy 8fef3df16f improve threading usage on discovery and fd 2010-10-26 23:49:09 +02:00
kimchy 73e6aa72cd for some reason the test only runs with @Test on the main class... 2010-10-26 20:20:58 +02:00
Adriano Ferreira c08ad0cad6 Fix parsing of "geo_distance" filter wrt "distance" / "unit" parameters
The problem was that when "unit" was given,
the conversion to miles was happening too early,
which caused wrong computations. This change
postpones this computation when one really knows
which unit should be used.
2010-10-26 20:13:29 +02:00
Adriano Ferreira 9b206146e3 Fix MILES.toKilometers() and KILOMETERS.toMiles()
This mistake should have been caught by DistanceUnitTests.
But the problem is that the tests in this file does not
run during the execution of the test suite, and I don't have
a clue why this is so.
2010-10-26 20:13:29 +02:00
Adriano Ferreira 2d15cd8009 Another test for parsing "geo_distance" filter: 12mi and km
If an explicit unit is provided with "distance",
the "unit" can be safely ignored, as it works
as a fallback unit.
2010-10-26 20:13:29 +02:00
Adriano Ferreira 8c8b7bee3a Three tests for parsing "geo_distance" filter: 12 miles in km
The added test files should be equivalent. Actually they
hit the same bug as change

    Two tests for parsing "geo_distance" filter: distance/unit parameters
2010-10-26 20:13:29 +02:00