Commit Graph

5397 Commits

Author SHA1 Message Date
Shay Banon 433f0cc86c process deleted index events on a node even if it has no local FS
this will not happen now, but in the future, if data nodes will only be in memory (including translog and such), then we need to fire the deleted events
2013-07-31 13:59:53 +02:00
Adrien Grand 420a3ed691 Forbid usage of StringReader in favor of FastStringReader.
StringReader is synchronized although input streams should always be consumed
by a single thread at a time. FastStringReader on the other hand is completely
thread unsafe.

Closes #3411
2013-07-31 09:34:18 +02:00
Shay Banon 813e3557ab don't call the refresh mapping listener callback twice
though not harmful, results in an annoying transport service log
2013-07-30 23:41:32 +02:00
Peter Moberg 95855c515b auto_expand_replicas causing very large amount of cluster state changes when a node joins or leaves the cluster
Closes #3399
2013-07-30 16:20:18 -04:00
Shay Banon 0e3c67cbf8 Delete API ack to wait also for actual deletion of shards from disk
closes #3413
2013-07-30 18:58:28 +02:00
Boaz Leskes 61036390e2 removed a left over assert made redundant by last commit 2013-07-30 17:39:38 +02:00
Boaz Leskes 925203b9c1 ElasticsearchAssertions.assertHitCount variants now report shard failure upon fail.
Cleaned up a UpdateNumberOfReplicasTests a bit.
2013-07-30 17:22:53 +02:00
Adrien Grand daf7e04caf Use Analyzer.tokenStream(fieldName, text) instead of Analyzer.tokenStream(fieldName, new StringReader(text)).
Lucene 4.4 introduced the tokenStream(String fieldName, String text) helper
method which nicely reuses the string reader. Whenever analyzing Strings, we
should use this method instead of using the Reader method with a
(Fast)StringReader.

Closes #3409
2013-07-30 17:18:08 +02:00
Martijn van Groningen a235a55943 Improved how aliases are handled in the cluster state.
The following changes improved alias creation:
* Moved away from ImmutableMap to JCF's UnmodifiableMap. The ImmutableMap always made a copy, whereas the UnmodifiableMap just wraps the target map.
* Reducing the number of maps being created during the creation of MetaData and IndexMetadata.
* Changed IndexAliasesService's aliases from a copy on write ImmutableMap to ConcurrentMap.

Closes #3410
2013-07-30 17:07:21 +02:00
Shay Banon 33d8571d1e make sure we wrap a potential failure in sending master state change in a catch 2013-07-30 16:44:30 +02:00
Boaz Leskes 668d55758b Added source fetching and filtering parameters to search, get, multi-get, get-source and explain requests
Closes #3301
2013-07-30 13:21:14 +02:00
Luca Cavanna bcbd67feab Solved test timing issue and removed meaningless test 2013-07-30 13:16:57 +02:00
Boaz Leskes 59a9a0d3ef Ported an 0.90 branch excplicit test for dynamic update of gc_delete setting for RobinEngine.
This issue is already solved in master.

See #3396
2013-07-30 12:55:14 +02:00
Shay Banon 07569b4808 warmer test to use 0 replicas
they are meaningless in the context of the test, should stabilize it
2013-07-30 10:47:16 +02:00
Martijn van Groningen 4724725681 Made a clear distinction in the rest api between percolating a provided document and percolating an existing document. The latter is now a separate api. 2013-07-30 10:25:42 +02:00
Martijn van Groningen ef847da2cd Lowered the default size of the percolate thread pool 2013-07-30 09:48:05 +02:00
Martijn van Groningen 7ccc968a9f Moved node level classes classes out of the index.percolator package into toplevel percolator package. 2013-07-29 17:40:07 +02:00
Martijn van Groningen 3f6877ec2b Rewrote the percolate existing doc api.
The percolate existing doc feature now reuses the get request instead of having a separate request body.
Relates to #3380
2013-07-29 17:32:26 +02:00
Martijn van Groningen a9dd3c9756 Added version support to mget and get apis, that only will perform the get operation if the version of the document to be fetched matches with the provided version.
Both get and mget apis now support the following additional parameters: `version` and `version_type`.

Closes #3404
2013-07-29 15:53:12 +02:00
Luca Cavanna 3b2a9fc86b completed renaming of MetaDataStateIndexService to MetaDataIndexStateService 2013-07-29 15:46:50 +02:00
Luca Cavanna 8eed6cdcae Renamed MetaDataStateIndexService to MetaDataIndexStateService for consistency 2013-07-29 15:12:09 +02:00
Luca Cavanna 105d4bab5f Updated test to reflect added acknowledgement from all nodes in open/close index api
If it's acknowledged all the other nodes already hold the latest cluster state, thus we can search on the closed index and be sure we get an error back
2013-07-29 15:12:08 +02:00
Luca Cavanna c23c5d2494 Added support for acknowledgement from other nodes in open/close index api
The open/close index api now waits for an acknowledgement from all the other nodes before returning its response, till the timeout (configurable, default 10 secs) expires. The returned acknowledged flag reflects whether the cluster state change was acknowledged by all the nodes or the timeout expired before.

Closes #3400
2013-07-29 15:12:08 +02:00
Boaz Leskes e0e6a58357 FuzzLikeThis*QueryBuilder and MoreLikeThis*QueryBuilder do not send failOnUnsupportedField if not explicitly specified.
Closes #3402 , a better solution to #3374
2013-07-29 15:02:42 +02:00
Shay Banon 7fd54acd66 remove our own version of highlighting boundary scanner
the bug that we fixed in it was already pushed to the lucene version
2013-07-29 13:36:21 +02:00
Shay Banon fadb0c8f32 cleanup unused classes (not needed with Lucene 4.4) 2013-07-29 12:58:09 +02:00
Shay Banon 2c2cc844dc cleanup deprecations / warnings 2013-07-29 01:55:41 +02:00
Shay Banon 4e66658aac cleanup
- remove Digest/Hex, only used in test, directly use MD5 there
- don't use Closeables and use IOUtils
- remove duplicate Classes usage and unused LongsLAB
2013-07-29 01:29:58 +02:00
Shay Banon a1197de6af remove unused class 2013-07-29 01:08:08 +02:00
Shay Banon 94c8834dd3 remove RandomStringGenerator, using random strings from randomized testing 2013-07-29 01:06:09 +02:00
Shay Banon d2842a936e use BigDoubleList on all cases of geo point field data
same with other field data implementations, prefer to use the paged list compared to single long array in all cases
2013-07-29 00:20:37 +02:00
Shay Banon e4ad92203f remove RamUsage and use Lucene one 2013-07-29 00:02:42 +02:00
Shay Banon 22085cab0b wait till connection callback have executed on setup 2013-07-28 22:50:46 +02:00
Shay Banon 7590f9f8a5 move char array caching to streams 2013-07-28 22:43:35 +02:00
Shay Banon da3b4a3bf0 don't use guava ordering sorted copy, since it does 2 copies (instead of 1)
simply use regular toArray and sort on it (we do need to copy it)
2013-07-28 20:09:14 +02:00
Shay Banon 69c9a2dca1 improve test to be more descriptive when it fails 2013-07-28 19:36:02 +02:00
Shay Banon 29cf346f13 improve test
the test checks that even though some shards might not be active, search will still work
2013-07-28 15:23:41 +02:00
Shay Banon c30fa15ddf randomize ports on specific transport and disco tests 2013-07-28 14:45:52 +02:00
Shay Banon 28a4ac01e4 fix transport support for versioning
when starting the request/response cycle, we should use the lowest version out of the current node version, and the target node version to serialize the request, and put it in the header. this will allow to support both backward and forward comp.
in addition, have Version as an injected value to different services, to make different versions more easily testable, compared to using Version#CURRENT
2013-07-27 22:14:04 +02:00
Nik Everett 6b8123d726 Don't allow unallocated indexes to be closed.
Closes #3313
2013-07-26 16:08:18 -04:00
Shay Banon 976152b23e enable sys out check + remove unused code 2013-07-26 18:57:21 +02:00
Shay Banon 8ac77b6119 cleanup signatures file 2013-07-26 18:32:51 +02:00
Martijn van Groningen ebad9e57d4 Added support for percolating an existing document.
The percolate an existing document feature executes an internal get operation to get the source of the document to percolate.

All options for percolating an existing document:
* `id` - The id of the document to percolate.
* `type` - The type of the document to percolate.
* `index` - The index to fetch the document to percolate from.
* `routing` - The routing value to use to retrieve the document to percolate.
* `preference` - Which shard to prefer (defaults to `_local`).
* `version` - Enables a version check. If the fetched document's version isn't equal to the specified version then the request fails with a version conflict and the percolation request is aborted.

All the option can be specified inside the `get` body part or via query string arguments.
Internally the percolate api will issue a get request for fetching the`_source` of the document to percolate.

For this feature to work the `_source` for documents to percolate need to be stored.

Closes #3380
2013-07-26 16:39:17 +02:00
Shay Banon cc5998bf6d pass the codec to fix index
its not used in Lucene fix index implementation, but just in case, pass it because we can (tm).
2013-07-26 15:36:30 +02:00
Martijn van Groningen 8fa54b59fb Only check if ttl purger has deleted the docs when the delete count in indexing stats has been increased. 2013-07-26 14:06:59 +02:00
Shay Banon 3d0382b562 better handling of failures in transport to catch assertions
move wrapping the stream into the try block, even though its unlikely they will throw a failure, better be safe...
2013-07-26 12:27:55 +02:00
Cédric HOURCADE 5022c4659c Add a "score_mode" parameter to rescoring query.
Default value is "total", possible values are: "max", "min", "avg",
"multiply" and "total".

- "total": the final score of a document is the sum of the original
  query score with the rescore query score.
- "max": only the highest score count.
- "min": only the lowest score is kept (if the document doesn't match
  the rescore query, the original query score is used).
- "avg": average of both scores
- "multiply": product of both scores

Closes #3258
2013-07-26 12:10:01 +02:00
Shay Banon 29d337c44b better handling of failures in transport to catch assertions
make sure we also catch assertions (well Throwable) in our transport layer and properly log or callback the exception handler in that case
2013-07-26 12:00:52 +02:00
Simon Willnauer 68ce3eff04 Fixed test that relied on internal document ordering.
Lucene might internally tie-break on low level doc-Ids which
can change depending on merges etc. and test timings. No test should
rely on the actual order if scores are identical.
2013-07-26 10:39:50 +02:00
Shay Banon 861e33ee3d fix test to use correct store setting 2013-07-25 20:31:16 +02:00