Commit Graph

5013 Commits

Author SHA1 Message Date
Igor Motov 9bc50ea609 Fix LeastUsedDistributor and ensure random distribution for multiple non-fs directories
If we cannot determine available space the fallback scenario is now to use random distribution instead of always using the last directory.

Fixes #2820
2013-03-28 11:08:54 -04:00
Shay Banon 1fc37e5954 Segments API: Add version & compound for each segment
closes #2823
2013-03-28 15:34:38 +01:00
Shay Banon 473473e867 remove the field settings for query parser cache, not really relevant 2013-03-27 20:39:36 +01:00
Shay Banon c18c609af1 Date math in query_string caches now()
fixes #2808
2013-03-27 20:32:38 +01:00
Igor Motov 5bb75f9da3 Move applying alias filter to ContextSearch#preProcess() 2013-03-27 09:23:54 -04:00
Simon Willnauer 17f83f33bb Terminate early when no terms left in the suggest string.
Closes #2817
2013-03-26 17:44:34 +01:00
Igor Motov 9ae421a8b2 Fix filtering aliases with non-empty sort options
Fixes #2816
2013-03-26 07:23:44 -04:00
Shay Banon d35a3b03c8 Warmers: Have an explicit warmer thread pool
add 1 in case there is 1 core...
closes #2815
2013-03-25 23:34:52 +01:00
Simon Willnauer aa97c031f2 Don't reset tokenstream before passing to the MemoryIndex, otherwise some tokenizer might swallow tokens.
Closes #2814
2013-03-25 22:46:11 +01:00
Shay Banon b7106622d8 Warmers: Have an explicit warmer thread pool
Have an explicit threadpool warmer that is dedicated to execute warmers. Currently, it uses the search threadpool, which does not work well since the number of concurrent searches should be separate from the number of concurrent warmers allows, also the characteristics of the search pool (for example, bounded queue_size) might not fit well with how warmers should be executed (they should not be "rejected").

closes #2815
2013-03-25 16:46:37 +01:00
Shay Banon 0e815ce11c add 0.20.7 2013-03-25 12:33:55 +01:00
adavis 6a93fbcf07 Adding parsing for zero terms query for multi match
Tests for multi-match zero_terms_query and making references to the ZeroTermsQuery enum consistent to others used in MultiMatchQueryBuilder
2013-03-23 08:59:39 +01:00
adavis 3f83904680 Fixes java6_u31 compile error w.r.t. type inference 2013-03-22 16:46:42 -07:00
Simon Willnauer 560d2c094e Fix issue where entire shards are lost due to too many open files exceptions and a but in Lucene's
IndexWriter / DirectoryReader where an existsing index was not detected and then deleted due to a wrong
creation mode. See LUCENE-4870

Closes #2812
2013-03-22 17:18:55 +01:00
Florian Schilling 1a67793a4b Added Script test for geo distance tests and modified GeoUtils.normalizePoint() 2013-03-22 13:34:18 +01:00
Simon Willnauer 075779a397 Call onMissing if doc has no value in the field.
Closes #2807
2013-03-21 22:45:17 +01:00
Simon Willnauer 064d272916 Respect offset and length when iterating over BytesRef in Uid. The length is starting at offset
Closes #2806
2013-03-21 19:29:05 +01:00
Simon Willnauer 5f05c2106f Use more efficient StemmerOverrideFilter from Lucene trunk
Closes #2800
2013-03-21 07:58:51 +01:00
Shay Banon ea698add72 move to 0.90.0.RC2 snap 2013-03-20 19:06:30 +01:00
Shay Banon a2f14b68e8 release 0.90.0.RC1 2013-03-20 19:05:08 +01:00
Florian Schilling f08d458545 # GeoShape Precision
The `geo_shape` precision could be only set via `tree_levels` so far. A new option `precision` now allows to set the levels of the underlying tree structures to be set by distances like `50m`. The def

## Example
```json
curl -XPUT 'http://127.0.0.1:9200/myindex/' -d '{
  "mappings" : {
      "type1": {
          "dynamic": "false",
          "properties": {
              "location" : {
                  "type" : "geo_shape",
                  "geohash" : "true",
                  "store" : "yes",
                  "precision":"50m"
              }
          }
      }
  }
}'
```

## Changes
- GeoUtils defines the [WGS84](http://en.wikipedia.org/wiki/WGS84) reference ellipsoid of earth
- DistanceUnits refer to a more precise definition of earth circumference
- DistanceUnits for inch, yard and meter have been defined
- Set default levels in GeoShapeFieldMapper to 50m precision

Closes #2803
2013-03-20 14:52:47 +01:00
Simon Willnauer 4705eb2959 Lazily initialize the delegate in BloomFilteredPostingsFormat to prevent unnecessary loading if bloomfilter terminates early 2013-03-20 12:43:17 +01:00
Simon Willnauer 747ce36915 Specialise the default codec to reuse Lucene41 files in the common case.
Closes #2799
2013-03-20 12:43:17 +01:00
Shay Banon 54e7e309a5 better comment... 2013-03-19 14:36:13 +01:00
Shay Banon d5beea4bba if multicast socket closes, try and restart it
also, throttle on socket failures, so it won't spin out of control...
relates to #2783
2013-03-19 11:20:47 +01:00
Shay Banon f4a212420b multicastSocket should be volatile as well... 2013-03-19 10:23:39 +01:00
Shay Banon c92207f483 broadcast API to by default ignore missing / illegal shard state
this happens for example because we list assigned shards, and they might not have been allocated on the relevant node yet, no need to list those as actual failures in some APIs
2013-03-19 10:22:43 +01:00
Shay Banon bea7bdde4c upgrade to guava 14.0.1 2013-03-18 23:10:14 +01:00
Shay Banon aca713d68e tar.gz distro by mistake include a windows lib 2013-03-18 22:46:04 +01:00
Shay Banon 566d1d13f7 fix javadoc 2013-03-18 22:04:31 +01:00
Clinton Gormley 2123ab591c Correct filter strategy opt: random_access_random to random_access_always 2013-03-18 20:17:26 +01:00
Shay Banon 7d9cef904b Field Data: optimize long type to use narrowest possible type automatically
closes #2795
2013-03-18 12:37:15 +01:00
Shay Banon 82072fc47f make ES compile with java 8
- that isAnnotationPresent bug is known, and probably will be fixed in later versions, but it costs us nothing to not use it now
- some tests fail, mainly due to consistent ordering expected from Map (within versions) which does not seem to be preserved, need to fix those tests to be agnostic to it
2013-03-18 01:33:09 +01:00
Shay Banon e347a626da use ImmutableList.Builder instead of ArrayList 2013-03-17 21:55:07 +01:00
Shay Banon 2ed6ea25cc fix logging message to include the index
also add the list of current indices
2013-03-16 22:58:45 +01:00
Shay Banon 111a13222e Mapping: dynamic flag is explicitly returned even when not set
fixes #2789
2013-03-16 01:29:22 +01:00
Simon Willnauer c25eb7defe Fix bug in RateLimiter.SimpleRateLimiter causing numeric overflow in StoreStats
Closes #2785
2013-03-15 23:36:31 +01:00
Shay Banon d5da8f22ff improve TODO comment 2013-03-15 21:46:02 +01:00
Simon Willnauer 0e3b88be35 add CamelCase support to Suggester where missing 2013-03-15 15:07:15 +01:00
Simon Willnauer e0eff7d9d3 Remove `sort_order` and `sort_mode` in favor of `order` and `mode`
Closes #2781
2013-03-15 13:57:39 +01:00
Simon Willnauer 33608c333f Add `sort_oder` and `sortOrder` as valid field names for defining the sort order in a Sort object.
Closes #2767
2013-03-15 08:42:19 +01:00
Simon Willnauer 5f20d81199 Make StupidBackoff the default smoothing model for phrase suggester
Closes #2780
2013-03-14 23:03:15 +01:00
Shay Banon 91c51ef05c minor cleanup suggest api
- make sure we close the parser
- fail when no content is provided in the rest request
- reuse the suggest parse element
2013-03-13 12:18:14 -07:00
Florian Schilling 25bd9cecd0 # REST Suggester API
The REST Suggester API binds the 'Suggest API' to the REST Layer directly. Hence there is no need to touch the query layer for requesting suggestions.
This API extracts the Phrase Suggester API and makes 'suggestion request' top-level objects in suggestion requests. The complete API can be found in the
underlying ["Suggest Feature API"](http://www.elasticsearch.org/guide/reference/api/search/suggest.html).

# API Example
The following examples show how Suggest Actions work on the REST layer. According to this a simple request and its response will be shown.

## Suggestion Request
```json
curl -XPOST 'localhost:9200/_suggest?pretty=true' -d '{
    "text" : "Xor the Got-Jewel",
    "simple_phrase" : {
        "phrase" : {
            "analyzer" : "bigram",
            "field" : "bigram",
            "size" : 1,
            "real_word_error_likelihood" : 0.95,
            "max_errors" : 0.5,
            "gram_size" : 2
        }
    }
}'
```
This example shows how to query a suggestion for the global text 'Xor the Got-Jewel'. A 'simple phrase' suggestion is requested and
a 'direct generator' is configured to generate the candidates.

## Suggestion Response
On success the request above will reply with a response like the following:
```json
{
    "simple_phrase" : [ {
        "text" : "Xor the Got-Jewel",
        "offset" : 0,
        "length" : 17,
        "options" : [ {
            "text" : "xorr the the got got jewel",
            "score" : 3.5283546E-4
        } ]
    } ]
}
```
The 'suggest'-response contains a single 'simple phrase' which contains an 'option' in turn. This option represents a suggestion of the
queried text. It contains the corrected text and a score indicating the probability of this option to be meant.

Closes #2774
2013-03-13 19:36:29 +01:00
Jörg Prante a127f2d2e8 avoiding NPE in Sigar FS 2013-03-13 10:05:59 -07:00
Alexander Reelsen 125b33d3dc GeoJSONShapeParser parses JSON correctly and extracts coordinates even if 'crs' field is included.
Fixes #2763
2013-03-13 15:17:21 +01:00
Simon Willnauer 365cde82d3 Use numOrds rather than numDocs as upperbound for sorting
Closes #2773
2013-03-13 15:13:56 +01:00
Clinton Gormley 93ca6e2c4b tieBreaker in MultiMatchQueryBuilder should be a float, not an integer
Closes #2772
2013-03-13 13:44:59 +01:00
Drew Raines bea18d9b25 Revert "Add s3-publishing script."
This reverts commit 98f06c9af6.
2013-03-13 07:24:17 -05:00
Drew Raines 98f06c9af6 Add s3-publishing script. 2013-03-12 19:09:25 -05:00