Commit Graph

8350 Commits

Author SHA1 Message Date
Adrien Grand cc9a7bd454 Recycling: change the default type of the page recycler to CONCURRENT instead of SOFT_CONCURRENT.
This default type has been inherited from its ancestor, the (non-paged) recycler whose memory
usage was unbounded and required soft references to make sure it could release memory eventually.
On the contrary, the page cache recycler memory usage is bounded so we could remove soft
references in order to remove load on the garbage collector.

Note: the cache type is already randomized in integration tests.

Close #6320
2014-05-28 15:23:18 +02:00
Simon Willnauer a5866e226e Mustache: Ensure internal scope extrators are always operating on a Map
Mustache extracts the key/value pairs for parameter substitution from
objects and maps but it's decided on the first execution. We need to
make sure if the params are null we pass an empty map to ensure we
bind the map based extractor

Closes #6318
2014-05-28 13:29:21 +02:00
Mathias Fussenegger 82e9a4e80a Serialization: Add support for Byte to the XContentBuilder.
Close #6127
2014-05-28 12:19:44 +02:00
Colin Goodheart-Smithe 3534ffcd1d Added plugins to .gitignore
Since plugins should never be committed to the core codebase and it is useful to be able to add plugins to the development environment adding plugins folder to the .gitignore file will stop it from appearing in the unstaged changes
2014-05-28 09:38:58 +01:00
Adrien Grand be29138962 [BUILD] Remember to use AtomicReader.addCoreClosedListener when upgrading to Lucene 4.9. 2014-05-28 09:35:00 +02:00
mateusz_kaczynski e97a381db2 Highlighting: Plain highlighter to use analyzer defined on a document level when available.
At the moment plain highligher only uses an analyzer defined for on the type
level. However, during the indexing stage it is possible to define analyzer on
per document level, for example mapping '_analyzer' to another field, containing
required name. This commit attempts to make sure that highlighting works
correctly in this scenario.

Closes #5497
2014-05-28 08:27:14 +02:00
Alexander Reelsen 5fdb35fc54 Startup: Reset locale to en_US.UTF-8 in bin/elasticsearch
Because the NetworkExceptionHelper class relies on the english language in
order to extract information and decide whether a certain exception is a
network problem, we need to set the english locale on startup in order
to prevent other locales to circumvent this check.
2014-05-27 17:31:09 +02:00
David Pilato 1dc186a595 [DOCS] fix typo 2014-05-27 15:57:39 +02:00
Itamar Syn-Hershko ac812f72b7 Docs: Adding Hebrew analyzer
Closes #6306
2014-05-27 13:40:53 +02:00
Shay Banon 13f49237df [Test] make sure to close the file at the end of the test 2014-05-27 11:08:29 +02:00
Shay Banon cd94af2c9e [Test] make sure we test writeTo(Channel) in BytesReference
also introduce proper randomization of content in the bytes
2014-05-26 13:32:52 +02:00
Alex Brasetvik 15ff3df243 Fix MatchQueryParser not parsing fuzzy_transpositions 2014-05-23 22:02:21 +02:00
Martijn van Groningen 3f2f1f088d Set the sortValues on SearchHit post aggregation instead of during the reduce. 2014-05-23 19:05:30 +02:00
Karel Minarik 0e920c17dd [SPEC] Added the `percolator_format` URL parameter to the "Percolate" API spec 2014-05-23 18:26:17 +02:00
Lee Hinman 65ce5acfb4 Explicitly clean up fielddata cache when clearing entire cache 2014-05-23 16:29:26 +02:00
Robert Muir 2cbe9371d2 Improve error when mlockall fails (closes #6288) 2014-05-23 10:16:26 -04:00
Martijn van Groningen 5fafd2451a Added `top_hits` aggregation that keeps track of the most relevant document being aggregated per bucket.
Closes #6124
2014-05-23 16:01:18 +02:00
Adrien Grand 2d417cf5b6 [TESTS] Left-over from 14420d7c4e. 2014-05-23 10:10:00 +02:00
Adrien Grand 14420d7c4e [TESTS] Fix test to use index-level doc IDs instead of segment-level doc IDs. 2014-05-23 01:20:41 +02:00
Adrien Grand 0d3410a837 [TESTS] Fix test bug in SimpleValidateQueryTests. 2014-05-23 00:52:56 +02:00
Nik Everett 0ff0985e01 Limit guava caches to 31.9GB
Guava's caches have overflow issues around 32GB with our default segment
count of 16 and weight of 1 unit per byte.  We give them 100MB of headroom
so 31.9GB.

This limits the sizes of both the field data and filter caches, the two
large guava caches.

Closes #6268
2014-05-23 00:20:12 +02:00
Adrien Grand a836496e57 [TESTS] Randomly disable the filter cache.
Close #6280
2014-05-22 23:13:29 +02:00
Adrien Grand 6e49256fa8 Nested: Make sure queries/filters/aggs get a FixedBitSet when they expect one.
Close #6279
2014-05-22 23:13:13 +02:00
Adrien Grand b3274bd770 Aggregations: Fix ReverseNestedAggregator to compute the parent document correctly.
Close #6278
2014-05-22 23:13:13 +02:00
Martijn van Groningen cbdd11777f [TEST] Just start two nodes 2014-05-22 21:13:52 +02:00
Martijn van Groningen 41bcb3e0d3 [TEST] Don't stop master node. 2014-05-22 19:17:54 +02:00
Nik Everett 3573822b7e Highlight fields in request order
Because json objects are unordered this also adds an explicit order syntax
that looks like
    "highlight": {
        "fields": [
            {"title":{ /*params*/ }},
            {"text":{ /*params*/ }}
        ]
    }

This is not useful for any of the builtin highlighters but will be useful
in plugins.

Closes #4649
2014-05-22 16:44:14 +02:00
Karel Minarik 81cddacffa [SPEC] Removed the URL parameter `indices_boost` from the "Search" API
Related: elasticsearch/elasticsearch-ruby#29
2014-05-22 15:29:46 +02:00
Simon Willnauer 9d5507047f Update Documentation Feature Flags [1.2.0] 2014-05-22 15:06:42 +02:00
Alex Ksikes 2546c06131 More Like This Query: allow for both 'like_text' and 'docs/ids' to be specified.
Closes #6246
2014-05-22 13:50:17 +02:00
Martijn van Groningen a717af505a [TEST] Use _uid sort field as tie, so that hits with the same score are sorted in the same way in both search responses. 2014-05-22 12:10:03 +02:00
Simon Willnauer 60ba9d1e69 [BUILD] pass java exe to plugin install command 2014-05-22 11:44:27 +02:00
Colin Goodheart-Smithe cabd2340dd Aggregations: Fixed conversion of date field values when using multiple date formats
When multiple date formats are specified using the || syntax in the field mappings the date_histogram aggregation breaks.  This is because we are getting a parser rather than a printer from the date formatter for the object we use to convert the DateTime values back into Strings.  Simple fix to get the printer from the date format and test to back it up

Closes #6239
2014-05-22 10:21:50 +01:00
javanna de9fca9cb2 [TEST] indices.open REST tests need 0 replicas
With replicas the search requests might go to shards that are not ready, since we have a wait for yellow. We can now switch to wait for green as well.
2014-05-22 11:04:28 +02:00
Martijn van Groningen e8e684c6c4 Add number of shards statistic to PercolateContext instead of throwing exception.
Certain features like significant_terms aggregation rely on this statistic for sizing heuristics.

Closes #6037
Closes #6123
2014-05-22 10:44:50 +02:00
Martijn van Groningen 16e5cdf8d0 Cut over to Lucene's TopDocs#merge for shard topdocs sorting.
Closes #6197
2014-05-22 10:40:56 +02:00
javanna 1b996defcf [TEST] cat.allocation/One index: allow leading spaces in unassigned shards lines 2014-05-22 10:10:50 +02:00
Martijn van Groningen 157d511061 [TEST] Use SuiteScopeTest annotation instead of ClusterScope(scope = ElasticsearchIntegrationTest.Scope.SUITE, numDataNodes = 1) 2014-05-21 22:08:59 +02:00
Clinton Gormley f950344546 [DOCS] Fixed title levels in context suggester 2014-05-21 20:47:25 +02:00
Alex Ksikes a29b4a800d More Like This Query: replaced 'exclude' with 'include' to avoid double negation when set.
Closes #6248
2014-05-21 18:45:03 +02:00
Britta Weber 8cca9b28df Percolator: Fix assertion in percolation with nested docs
Assertion was triggered for percolating documents with nested object
in mapping if the document did not actually contain a nested object.
Reason:
MultiDocumentPercolatorIndex checks if the number of documents is
actualu >1. Instead we can just use the SingleDocumentPercolatorIndex
in this case.

closes #6263
2014-05-21 18:17:36 +02:00
Simon Willnauer 17d34d5c97 Fix FieldDataWeighter generics to accept RamUsage instead of AtomicFieldData
The `FieldDataWeighter` allowed to use a concrete subclass of the caches
generic type to be used that causes ClassCastException and also trips the
CirciutBreaker to not be decremented appropriately.

This was tripped by settings randomization also part of this commit.

Closes #6260
2014-05-21 17:50:45 +02:00
Lee Hinman 03402c7ed8 [TEST] prevent dummy documents from being indexed in testSimpleQueryString() since scores are compared 2014-05-21 17:37:54 +02:00
Martijn van Groningen a6b0b80f3d [TEST] Added test for #6256 2014-05-21 16:17:03 +02:00
Adrien Grand 34f7bd1ca4 Fail queries that have two aggregations with the same name.
Close #6255
2014-05-21 15:11:23 +02:00
Simon Willnauer f29744cc2f XFilteredQuery default strategy prefers query first in the deleted docs case
Today we check if the DocIdSet we filter by is `fast` but the check fails
if the DocIdSet if wrapped in an `ApplyAcceptedDocsFilter` which is always
the case if the index has deleted documents. This commit unwraps
the original DocIdSet in the case of deleted documents.

Closes #6247
2014-05-21 13:04:41 +02:00
Adrien Grand fa3bd738ab Remove `DocIdSets.isFastIterator(DocIdSetIterator iterator)`.
This method was unused and its implementation wasn't correct since FixedBitSet
has its own iterator since Lucene 4.7.
2014-05-21 11:25:35 +02:00
Alexander Reelsen 814451f499 [BUILD] Fixed release notes script to work with github API again 2014-05-21 11:14:28 +02:00
Simon Willnauer ec3b1c57ac Move Benchmark release to 1.3 2014-05-21 10:17:59 +02:00
Simon Willnauer a60dabdf0c [TEST] skip benchmark tests for now 2014-05-20 22:21:37 +02:00