Commit Graph

6385 Commits

Author SHA1 Message Date
Simon Willnauer 71eb4532f8 Catch AlreadClosedException in RobinSearcher#release()
When we relocate a shard we might still have pending SearchContext
instances hanging around that will be used in "in-flight" searches
on the already relocated shard. This is a valid operation but if
we have already closed the underlying directory which happens during
cleanup concurrently the close call on the IndexReader can trigger
an AlreadyClosedException when the NRT reader tries to cleanup files
via the IndexWriter.

Closes #4273
2013-11-27 15:55:30 +01:00
Simon Willnauer ba3269dedc Fix assertions in testEquivalence and beef up the test 2013-11-27 15:21:09 +01:00
Adrien Grand 596d511466 Cleanup of IndexFieldDataService.getForField.
This method has 2 signatures and one of them is dangerous since it allows to
discard fielddata configuration of the field mapper. This commit changes the
percolator so that it uses fielddata configuration of the _id field mapper
instead of forcing the paged_bytes format.

Closes #4270
2013-11-27 14:56:09 +01:00
uboness fda6ca4869 Added support for shard_size in terms agg
Closes #4242
2013-11-27 14:16:58 +01:00
Simon Willnauer d18ce2733d Cleanup Rescorer Tests & add random indexing 2013-11-27 11:55:29 +01:00
Alexander Reelsen 4774439436 Fixed file-based template loading via config/templates
When parsing the json file, the first field is ignored as
parser.nextToken() seems to be called too often.

Closes #4235
2013-11-27 09:49:15 +01:00
Simon Willnauer e66c2793aa Add hole character to the reverved characters for completion suggester 2013-11-26 22:46:43 +01:00
Shay Banon f40959cc30 Cat API: Add h parameter to apis, allowing to return columns and descriptions for them
closes #4262
2013-11-26 22:14:18 +01:00
Alexander Reelsen 2a456e5716 Fixing CompletionFieldMapper.isReservedChar() to take all relevant chars in account 2013-11-26 20:42:37 +01:00
Boaz Leskes c63d8c4fb5 [Docs] Added _source filtering to documentation
Relates to #3301
2013-11-26 19:16:24 +01:00
Martijn van Groningen 3c4fc119ab Only print the warning about '.' in type, when it is not a percolator type. 2013-11-26 19:01:43 +01:00
Martijn van Groningen dafb90e62a Include facets in the rest response. 2013-11-26 18:59:21 +01:00
Britta Weber 1510cd6923 Fix issue 3989
Multi term vector request never returned if shards for all requested documents
were non existent.

closes #3989
2013-11-26 17:04:18 +01:00
Britta Weber dbef64009f [DOC] add doc for multi term vector api
closes #3998
2013-11-26 17:03:14 +01:00
Britta Weber 3be5f3345e Make parsing of uri and body parameters consistent with single term vector api
uri parameters were not all parsed for the multi term vector request. This commit
makes sure that all parameters are parsed and used when creating the requests for the
multi term vector request.

In order to simplify both code and json request, the request structure now allows
two ways to use multi term vectors:

1. Give all parameters for each document requested in the docs array like this:

```
{
   "docs": [
      {
         "_index": "testidx",
         "_type": "test",
         "_id": "2",
         "terms": [
            "fox"
         ],
         "term_statistics": true
      },
      {
         "_index": "testidx",
         "_type": "test",
         "_id": "1",
         "terms": [
            "quick",
            "brown"
         ],
         "term_statistics": false
      }
   ]
}
```

2. Define a list of ids and give parameters in a separate parameters object like this:

```
{
   "ids": [
      "1",
      "2"
   ],
   "parameters": {
      "_index": "testidx",
      "_type": "test",
      "terms": [
         "brown"
      ]
   }
}
```

uri parameters are global parameters that are set for both cases. They are overwritten
by parameter definitions in the body.

Also, this commit adds the missing setParent(..) and setPreference(..) to TermVectorRequestBuilder.
2013-11-26 17:02:56 +01:00
Alexander Reelsen 6e1a04b370 Added unit test for current completion postingsformat 2013-11-26 12:52:07 +01:00
Alexander Reelsen 4e836a3459 Randomized CompletionSuggestSearchTests 2013-11-26 12:52:07 +01:00
Alexander Reelsen bf74f49fdd Updated Analyzing/Fuzzysuggester from lucene trunk
* Minor alignments (like setter to ctor)
* FuzzySuggester has a unicode aware flag, which is not exposed in the fuzzy completion request parameters
* Made XAnalyzingSuggester flags (PAYLOAD_SEP, END_BYTE, SEP_LABEL) to be written into the postings format, so we can retain backwards compatibility
* The above change also implies, that these flags can be set per instantiated XAnalyzingSuggester
* CompletionPostingsFormatTest now uses a randomProvider for writing data to check for bwc
2013-11-26 12:52:06 +01:00
Martijn van Groningen 9f5d01ca4c Cut DiscoveryNodes over to ImmutableOpenMap. 2013-11-26 11:57:15 +01:00
Simon Willnauer 5f7146aab8 Run tests with reduced stack size as we run in production 2013-11-26 11:16:02 +01:00
Simon Willnauer cf3ba7c51c Only use -Dtests.jvm.argline instead of numbered options 2013-11-26 11:11:19 +01:00
Simon Willnauer 9b839ca79f Add more reporting to asserting index searcher 2013-11-26 10:54:37 +01:00
Shay Banon 6f90a3e39a allow to parse directly the compressed mapping 2013-11-26 09:48:33 +01:00
Shay Banon 0610fc3ad2 use the proper abstraction of ImmutableOpenMap
we already use the open map / clone trick, might as well use the ImmutableOpenMap here
2013-11-26 02:48:31 +01:00
Martijn van Groningen a03556daa0 Added execution option to `range` filter, with the `index` and `fielddata` as values.
Deprecated `numeric_range` filter in favor for the `range` filter with `fielddata` as execution.

Closes #4034
2013-11-25 23:43:40 +01:00
Martijn van Groningen ac03fba9d3 Small cleanup 2013-11-25 23:18:36 +01:00
Martijn van Groningen 036febe110 Cut the following classes over to ImmutableOpenMap:
* MetaData
* IndexMetaData
* ClusterState
* IndexTemplateMetaData
2013-11-25 21:59:06 +01:00
Simon Willnauer 46ab6a1533 Include JVM Arg line in reproduce line 2013-11-25 14:35:34 +01:00
Shay Banon 32d073bbf8 Bulk should support shard timeout like the index api
closes #4220
2013-11-25 11:48:22 +01:00
Shay Banon 2ba7c1d4a1 acquireSearcher should fail with state failure when not set/closed
also fixes #4232
2013-11-25 11:24:55 +01:00
Shay Banon 9648a53fd5 acquireSearcher should fail with state failure when not set/closed
also fixes #4232
2013-11-25 11:24:19 +01:00
Martijn van Groningen efba3a50dd iterator doesn't implement #remove() 2013-11-25 10:32:35 +01:00
Igor Motov e3d4d73242 Local primaries should be preferred to relocating primaries
To reproduce the bug use -Dtests.seed=5AB62524C9AB0489
Fixes #4237
2013-11-24 21:20:01 -05:00
Simon Willnauer 8e17d636ef Upgrade to Lucene 4.6
This commit upgrades to Lucene 4.6 and contains the following improvements:

 * Remove XIndexWriter in favor of the fixed IndexWriter
 * Removes patched XLuceneConstantScoreQuery
 * Now uses Lucene passage formatters contributed from Elasticsearch in PostingsHighlighter
 * Upgrades to Lucene46 Codec from Lucene45 Codec
 * Fixes problem in CommonTermsQueryParser where close was never called.

Closes #4241
2013-11-24 21:08:38 +01:00
uboness 28adbd475d added a waitForGreen condition for the unmapped tests on missing agg 2013-11-24 20:26:12 +01:00
Martijn van Groningen 8fda8aaabf force default codec
reduce p/c searches and num child docs being generated
2013-11-24 15:35:11 +01:00
uboness c7f6c5266d initial commit of the aggregations module
Closes #3300
2013-11-24 03:13:08 -08:00
Simon Willnauer 34d567a133 Don't use mock wrapper on relocate stress test for now since it could be the reason for intermediate/occational failures 2013-11-23 09:22:16 +01:00
Alexander Reelsen fdc4f72e8a Added mlockall setting to process info output 2013-11-23 07:40:59 +01:00
Martijn van Groningen 688a6bd29b Added random test for ParentQuery and ChildrenQuery. 2013-11-22 18:38:46 +01:00
Simon Willnauer eb55458e44 Upgrade RandomizedRunner Maven Plugin to 2.0.14 2013-11-22 15:00:12 +01:00
Martijn van Groningen c46fe4a0e8 Introduced EA#assertMatchCount() and make test used that. 2013-11-22 13:47:02 +01:00
Boaz Leskes 5e58c1b9e1 Added a bulk indexing while initializing test.
Relates to #4214
2013-11-22 13:23:42 +01:00
Simon Willnauer a949a8056b Upgrade to forbiddenapis 1.4 2013-11-22 08:01:30 +01:00
Igor Motov 4ffd8a663c Fix possible NPE in snapshot service if a shard doesn't have primary 2013-11-21 20:08:57 -05:00
Igor Motov 1d0bae0f50 Prevent modification or deletion of repositories while snapshots are running 2013-11-21 20:08:57 -05:00
Igor Motov 2f66bf0720 Fix typo in MockRamDirectoryService name 2013-11-21 20:08:57 -05:00
Luca Cavanna 22852d8040 AckTests: more assertAcked and added common method to retrieve local cluster state 2013-11-21 22:59:48 +01:00
mrsolo 5cd780846b jenkin scripts modification
1) client_tests_url, switch to JDK6
2) build_ranodmization, add jvm options randomization
2013-11-21 12:08:04 -08:00
mrsolo 0d1bebb32c add nightly es_node_mode radomization 2013-11-21 11:03:22 -08:00