9504 Commits

Author SHA1 Message Date
Simon Willnauer
a0e9951e8a [STORE] Turn unexpected exception into CorruptedIndexException
Today if we run into exception like NumberFormatException or IAE
when we try to open a commit point to retrieve checksums and calculate
store metadata we just bubble them up. Yet, those are very likely index
corruptions. In such a case we should really mark the shard as
corrupted.
2014-09-11 21:15:02 +02:00
Britta Weber
9b5497f6ca [TEST] fix another rounding issue 2014-09-11 19:49:51 +02:00
Simon Willnauer
b0a377bae8 [TEST] Use a sorted set since sets are compared and compare is order specific 2014-09-11 17:42:37 +02:00
javanna
7e0481d906 More Like This API: remove unused search_query_hint parameter
Closes #7691
2014-09-11 17:34:54 +02:00
Martijn van Groningen
d0300b3f59 Aggregations top_hits: Fixed inconsistent sorting of the hits
In the reduce logic of the top_hits aggregation if the first shard result to process contained has no results then the merging of all the shard results can go wrong resulting in an incorrect sorted hits.
This bug can only manifest with a sort other than score.

Closes #7697
2014-09-11 17:26:22 +02:00
Simon Willnauer
3ef6860679 [STORE] Improve exception from Store.failIfCorrupted
If you have previously corrupted files, this method currently builds an
exception like:
```
    failed engine [corrupted preexisting index]
    failed to start shard
```

Followed by a CorruptIndexException. This commit writes the entire
stacktrace to provide additional information. It also changes the
failure message from `corrupted preexisting index` to `preexisting
corrupted index` to prevent confusion.

Closes #7596
2014-09-11 17:11:48 +02:00
Clinton Gormley
1455988d91 Changed dev-tools/es_release_notes to:
* remove markdown support
* prefer PRs over issues
* include related issues in the list
* always use section headers if there is a header
2014-09-11 16:46:41 +02:00
Clinton Gormley
269b91c688 Spec: Fixed the docs URL for indices.get and indices.exists 2014-09-11 16:39:46 +02:00
Simon Willnauer
595472014e [TEST] Use a real unique clustername for InternalTestClusterTests 2014-09-11 16:20:51 +02:00
Colin Goodheart-Smithe
8238388bad [DOCS] clarification of breaking changes to 1.4 due to GET index API 2014-09-11 15:04:04 +01:00
Martijn van Groningen
f8e93fa2aa Test: Let both types have a non_analyzed id field. 2014-09-11 15:20:28 +02:00
Honza Král
480b90cfd6 [API] Fix minor issues with indices.get definition and tests
mark index param as required
make body match json, not string containing json
2014-09-11 14:36:11 +02:00
javanna
fd6798df69 [TEST] parse response body as json depending on the content-type in our REST tests 2014-09-11 14:32:59 +02:00
javanna
4ab268bab2 Internal: refactor copy headers mechanism to not require a client factory
With #7594 we replaced the static `BaseRestHandler#addUsefulHeaders` by introducing the `RestClientFactory` that can be injected and used to register the relevant headers. To simplify things, we can now register relevant headers through the `RestController` and remove the `RestClientFactory` that was just introduced.

Closes #7675
2014-09-11 13:18:08 +02:00
Colin Goodheart-Smithe
8720a4dcd2 [TEST] added exception for GET index API to bwc tests 2014-09-11 11:59:17 +01:00
Lee Hinman
1dd26888f6 [DOCS] Additional documentation for _score accessing
Closes #7043
2014-09-11 12:53:25 +02:00
Colin Goodheart-Smithe
5fe782b784 Indices API: Added GET Index API
Returns information about settings, aliases, warmers, and mappings. Basically returns the IndexMetadata. This new endpoint replaces the /{index}/_alias|_aliases|_mapping|_mappings|_settings|_warmer|_warmers and /_alias|_aliases|_mapping|_mappings|_settings|_warmer|_warmers endpoints whilst maintaining the same response formats.  The only exception to this is on the /_alias|_aliases|_warmer|_warmers endpoint which will now return a section for 'aliases' or 'warmers' even if no aliases or warmers exist. This backwards compatibility change is documented in the reference docs.

Closes #4069
2014-09-11 11:19:21 +01:00
Boaz Leskes
a50934ea3e Resiliency: Master election should demotes nodes which try to join the cluster for the first time
With the change in #7493,  we introduced a pinging round when a master nodes goes down. That pinging round helps validating the current state of the cluster and takes, by default, 3 seconds. It may be that during that window, a new node tries to join the cluster and starts pinging (this is typical when you quickly restart the current master).  If this node gets elected as the new master it will force recovery from the gateway (it has no in memory cluster state), which in turn will cause a full cluster shard synchronisation. While this is not a problem on it's own, it's a shame. This commit demotes "new" nodes during master election so the will only be elected if really needed.

Closes #7558
2014-09-11 11:19:10 +02:00
Ulrich Reffle
4ed52073fa Docs: A simple typo.
Closes #7535
2014-09-11 11:17:49 +02:00
Clinton Gormley
d88577d097 Docs: Added recommended Java versions to the docs 2014-09-11 11:13:55 +02:00
Simon Willnauer
8618d3624a Add inline comment to prevent confusion 2014-09-11 11:07:23 +02:00
Nik Everett
2bc58d5f77 Docs: Fix misnamed setting
The settings is `index.merge.policy.reclaim_deletes_weight` not
`index.reclaim_deletes_weight`.

Closes #7676
2014-09-11 10:41:23 +02:00
Boaz Leskes
6849fd0378 Translog: remove unused stream
Closes #7683
2014-09-11 10:00:06 +02:00
Adrien Grand
ccb3d21781 Bulk UDP: Removal.
This feature is rarely used. Removing it will help reduce the moving parts
of Elasticsearch and focus on the core.

Close #7595
2014-09-11 09:52:09 +02:00
Adrien Grand
8bafb5fc8e Core: Use FixedBitSetFilterCache for delete-by-query.
Leftover from #7037.
Close #7581
2014-09-11 09:35:25 +02:00
Martijn van Groningen
144af9c910 Test: Fields in percolator query must exist before percolating 2014-09-10 19:01:55 +02:00
Colin Goodheart-Smithe
dc30bb0ea7 [TEST] Added logging of response to aid debugging 2014-09-10 17:24:22 +01:00
Colin Goodheart-Smithe
76082182aa [TEST] added more information to fail message for a test to debug test failure 2014-09-10 17:24:22 +01:00
Martijn van Groningen
dbfac659f9 Aggregation top_hits: Move sort resolution to the reduce method, so it is always guaranteed to be invoked. 2014-09-10 17:51:07 +02:00
Boaz Leskes
bb1dfbfa42 missing logging brackets 2014-09-10 16:07:15 +02:00
smayzak
65a0ca021d The description was incorrect
Looked like a copy and paste from another aggregation
2014-09-10 16:05:03 +02:00
smayzak
6416f5d3d0 Fixing some grammar 2014-09-10 16:05:03 +02:00
Boaz Leskes
7d80db7c2c Gateway: added trace logging to translog recovery logic
Enabled it in SimpleRecoveryLocalGatewayTests
2014-09-10 16:02:44 +02:00
David Pilato
7fdd3651fa [docs] Fix typo: resonable - reasonable 2014-09-10 15:57:57 +02:00
Boaz Leskes
4f8ddd97bf [Rest] reroute API response didn't filter metadata
By default the reroute API should return the new cluster state, excluding the metadata. It was however it was wrongly using an old parameter (filter_metadata) and thus failed to do so. This commits restores but wiring it to the correct `metric` parameter. We also add an enum representing the possible metrics, to avoid similar future mistakes.

Closes #7520
Closes #7523
2014-09-10 14:48:06 +02:00
Martijn van Groningen
ab555e0a33 Test: Added more assertions 2014-09-10 14:45:46 +02:00
Boaz Leskes
09db2e2a27 Tests: log when an ensure green/yellow comes back
Also added some trace logging to SimpleRecoveryLocalGatewayTests
2014-09-10 14:42:35 +02:00
Boaz Leskes
fc89316b1b Store: improved trace logging for shard active requests 2014-09-10 12:35:09 +02:00
Boaz Leskes
18f58682e7 Tests: add logging to LocalGatewayIndexStateTests 2014-09-10 12:29:00 +02:00
javanna
5bea31cb96 Internal: refactor copy headers mechanism
The functionality of copying headers in the REST layer (from REST requests to transport requests) remains the same. Made it a bit nicer by introducing a RestClientFactory component that is a singleton and allows to register useful headers without requiring static methods.

Plugins just have to inject the RestClientFactory now, and call its `addRelevantHeaders` method that is not static anymore.

Relates to #6513
Closes #7594
2014-09-10 12:05:53 +02:00
Martijn van Groningen
6f763bded9 Test: Enabled ChildrenTests#testParentWithMultipleBuckets with more logging 2014-09-10 11:19:30 +02:00
Simon Willnauer
cb839b56b2 [ThreadPool] Use DirectExecutor instead of deprecated API
Guava deprecated MoreExecutors#sameThreadExecutor in favour of
a more efficient implemenation. We should move over to the new impl.
2014-09-10 09:36:30 +02:00
Ryan Ernst
4638d23484 Tests: Re-enable BWC analysis test, skipping strings that could cause issue with LUCENE-5927. 2014-09-09 14:30:31 -07:00
Simon Willnauer
64dce61233 [BUILD] Randomly enable AggressiveOpts in builds 2014-09-09 21:58:37 +02:00
Simon Willnauer
38d88b2e2c [TEST] Added basic test for InternalTestCluster reproducibility 2014-09-09 21:48:42 +02:00
Britta Weber
1138a6ae60 [TEST] fix rounding issue 2014-09-09 19:44:47 +02:00
Simon Willnauer
b0cf929637 [TEST] use local random instance rather than thread local version
This influences reprocucibility dramatically since it modifies the
test random sequence while it should just use the private random
instance.
2014-09-09 18:31:41 +02:00
javanna
ee3cbce118 Internal: make sure that the request context is always copied from REST to transport layer
Also renamed HeadersCopyClientTests since it tests a class that was renamed and removed randomization around client wrapper, as it now needs to be weapped all the time to copy the context, doesn't depend on useful headers that have been registered anymore.

Relates to #7610
2014-09-09 18:06:46 +02:00
Colin Goodheart-Smithe
c8a3460f39 [TEST] more debugging for GeoBoundsTests 2014-09-09 16:49:06 +01:00
Lee Hinman
c328397eb6 [TEST] Disable translog flush in CorruptedTranslogTests 2014-09-09 17:48:37 +02:00