Commit Graph

4101 Commits

Author SHA1 Message Date
Kenn Knowles e66bd4359a Fix reversed ShingleFilter constructor arguments 2012-08-31 22:25:07 +02:00
Martijn van Groningen 9b29950997 Added fields option to explain api. #2203 2012-08-31 22:19:09 +02:00
Martijn van Groningen cd0e1226e1 Added a global ignore_malformed index setting. #2220 Also extended the ignore_malformed support to TTL, Ip and timestamp field types. 2012-08-31 22:10:46 +02:00
Shay Banon 888b7cc48f only print failure to reconnect to node from other nodes after several retries 2012-08-31 17:14:04 +02:00
Martijn van Groningen dea2de3304 Add ignore_indices option for search, multisearch, count and other Broadcast request. #2209 2012-08-27 15:36:14 +03:00
Martijn van Groningen 1d4aee6086 - Explain api opens 2 engine searchers, but closes only 1 engine searcher. Closes #2206 2012-08-27 12:20:02 +03:00
Shay Banon da61ddee3c 0.19.9 no longer supports /_all/_status, closes #2205. 2012-08-25 14:18:48 +03:00
Shay Banon dfa67bf071 allow to register custom state associated with cluster state 2012-08-25 00:40:44 +03:00
Martijn van Groningen bbe735f2cc Fixed issue #2197 2012-08-25 00:38:26 +03:00
uboness b4b33bb205 Local node master listener
* Fixed an issue where dynamic update to minimum_master_nodes settings would not take immediate effect
* Added LocalNodeMasterListener support to the ClusterService. Enables listening to when the local node becomes/stopped being a master
2012-08-24 02:25:13 +02:00
Shay Banon 36ff6c9b8b add a lock not allowing connecting to nodes while shutting down 2012-08-24 02:23:43 +02:00
Shay Banon 333293babd ignore cancelled key exception as well 2012-08-23 23:35:48 +02:00
Shay Banon 072fcaa760 Bulk UDP, closes #2201
A Bulk UDP service is a service listening over UDP for bulk format requests. The idea is to provide a low latency UDP service that allows to easily index data that is not of critical nature.

The Bulk UDP service is disabled by default, but can be enabled by setting `bulk.udp.enabled` to `true`.

The bulk UDP service performs intenral bulk aggregation of the data and then flushes it based on several parametres:

* `bulk.udp.bulk_actions`: The number of actions to flush a bulk after, defaults to `1000`.
* `bulk.udp.bulk_size`: The size of the current bulk request to flush the request once exceeded, defaults to `5mb`.
* `bulk.udp.flush_interval`: An interval after which the current request is flushed, regarldess of the above limits. Defaults to `5s`.
* `bulk.udp.concurrent_requests`: The number on max in flight bulk requests allowed. Defaults to `4`.

The network settings allowed are:

* `bulk.udp.host`: The host to bind to, defualts to `network.host` which defaults to any.
* `bulk.udp.port`: The port to use, defaults to `9700-9800`.

Here is an example of how it can be used:

    > cat bulk.txt
    { "index" : { "_index" : "test", "_type" : "type1" } }
    { "field1" : "value1" }
    { "index" : { "_index" : "test", "_type" : "type1" } }
    { "field1" : "value1" }

    > cat bulk.txt | nc -w 0 -u localhost 9700
2012-08-23 22:17:37 +02:00
Shay Banon ba98b04081 fix wrong check on close 2012-08-23 20:58:40 +02:00
Shay Banon bb609f696f add 0.19.10 2012-08-23 13:52:57 +02:00
Shay Banon 1f3b0d4144 Reduce index.shard.recovery.concurrent_streams from 5 to 3 to reduce the load when doing recovery, closes #2199.
the index.shard.recovery.concurrent_streams controls how many streams are opened from a recovery source to a recovery target to transfer index files. Reduce it from 5 to 3 to reduce the load when doing recovery (for example, due to relocation).

Note, recent changes in network buffering will mean that recovery will progress considerably faster, so this change will not affect recovery times.
2012-08-23 13:20:54 +02:00
Shay Banon 37b33cf77d protect a bit more from bogus (not relevant) exceptions when closing a node 2012-08-23 01:31:11 +02:00
Shay Banon 377914bd07 Upgrade to netty 3.5.5, closes #2196. 2012-08-23 01:30:49 +02:00
Shay Banon 14c11a94fb MinimumNumberShouldMatch inconcistency, closes #2194
Streamline the use of minimum should match to all relevant queries to accept `minimum_should_match`, and allow all relevant queries to accept the advanced "string" based config
2012-08-22 14:15:08 +02:00
Shay Banon 177568a61f no need to optimize on the bool query parser, we already do that in the optimizeQuery method 2012-08-22 13:15:22 +02:00
uboness 3fdb9f0a27 Enabled the option of configuring plugin types in the settings. This will also help in tests when testing plugin related functionality 2012-08-21 23:00:24 +02:00
Shay Banon 2dd82675fb when using wildcard notation delete all indices might kick in even though its disabled 2012-08-21 21:49:16 +02:00
Shay Banon c33ca2921d small optimization for global facet with facet filter, by removing the double check on the facet filter 2012-08-21 19:32:55 +02:00
Shay Banon f03ff2976a reformat 2012-08-21 14:22:12 +02:00
Jörg Prante ef6ad6c966 mapping BigDecimal to double or string in XContentBuilder 2012-08-21 14:21:30 +02:00
Shay Banon b5d9d3dbee small renames here and there 2012-08-21 14:16:51 +02:00
Martijn van Groningen 8365e7ba0b - Added explain api. #2184 2012-08-21 13:26:17 +02:00
Shay Banon a8656c8a6f Incorrect application of boost in SpanNotQueryBuilder, closes #2192. 2012-08-21 13:08:23 +02:00
Shay Banon a80639abf5 exclude xerces from the deps for jts, we don't need it 2012-08-20 17:48:18 +02:00
Shay Banon dbe2f53a00 Support YAML as content type 2012-08-20 17:40:19 +02:00
Shay Banon 9aae62b4a6 All Field: Automatically detect when field level boosting is used, and optimize when its not, closes #2189. 2012-08-20 15:07:32 +02:00
Shay Banon e1fe89389c change mappersAdded flag to mappingsModified to better reflect any possible change in mappings, not just additions 2012-08-20 13:36:28 +02:00
Shay Banon 79cb0eafc4 better close logic for concurrent recovery streams 2012-08-20 02:05:54 +02:00
Shay Banon 08ecd9d772 refactor all Queue and BlockingQueue creations into a single factory method 2012-08-19 18:15:48 +02:00
Shay Banon e3a9271000 unify more count and search implementation 2012-08-19 16:54:53 +02:00
Shay Banon bc2887344e convert to optimized match all query also when executing "*" query 2012-08-18 18:15:54 +02:00
Shay Banon 341c53b580 Upgrade to Netty 3.5.4, closes #2180. 2012-08-16 12:15:24 -07:00
Simon Willnauer b0b5775c98 use term query instead of a specialized SpanTermQuery on _all field if positions are omitted 2012-08-16 10:42:14 -07:00
Shay Banon a4acb9a95b move debug level on failure to clean log files from warn to debug 2012-08-16 10:34:31 -07:00
Shay Banon f317399b46 allow to flush bulk processor based on time, and better listener api 2012-08-16 09:14:19 -07:00
Shay Banon ab49a8c2fc improve update test to wait for green cluster state 2012-08-14 01:47:18 +02:00
Shay Banon 70f212a4dc more improvements for handling of large / many mappings by batching the removal of mappings 2012-08-14 00:18:11 +02:00
Shay Banon 5715588b96 fix geo shape to use the new index options 2012-08-13 17:30:38 +02:00
Simon Willnauer 53f65d8ff2 Remove / deprecated omit_term_freq_and_positions in favor of IndexOptions exposed via mapping API 2012-08-13 17:19:08 +02:00
Shay Banon 980fc6ca34 add new spatial jars to deb package as well 2012-08-13 14:51:53 +02:00
Shay Banon eda3da2aea fix geo shape tests 2012-08-13 14:40:36 +02:00
Chris Male bea4346f3a Added GeoShape indexing and querying support 2012-08-13 13:44:29 +02:00
Shay Banon ad0e916fb7 don't allow an empty type in the mapper service 2012-08-13 12:42:11 +02:00
Shay Banon bdea0e2edd add a simple bulk processor to simplify using the bulk API 2012-08-13 11:24:48 +02:00
Martijn van Groningen b979dfa0be Add lenient option to match & multi_match queries. #2156 2012-08-09 21:56:50 +02:00