Commit Graph

9675 Commits

Author SHA1 Message Date
Boaz Leskes bb1dfbfa42 missing logging brackets 2014-09-10 16:07:15 +02:00
smayzak 65a0ca021d The description was incorrect
Looked like a copy and paste from another aggregation
2014-09-10 16:05:03 +02:00
smayzak 6416f5d3d0 Fixing some grammar 2014-09-10 16:05:03 +02:00
Boaz Leskes 7d80db7c2c Gateway: added trace logging to translog recovery logic
Enabled it in SimpleRecoveryLocalGatewayTests
2014-09-10 16:02:44 +02:00
David Pilato 7fdd3651fa [docs] Fix typo: resonable - reasonable 2014-09-10 15:57:57 +02:00
Boaz Leskes 4f8ddd97bf [Rest] reroute API response didn't filter metadata
By default the reroute API should return the new cluster state, excluding the metadata. It was however it was wrongly using an old parameter (filter_metadata) and thus failed to do so. This commits restores but wiring it to the correct `metric` parameter. We also add an enum representing the possible metrics, to avoid similar future mistakes.

Closes #7520
Closes #7523
2014-09-10 14:48:06 +02:00
Martijn van Groningen ab555e0a33 Test: Added more assertions 2014-09-10 14:45:46 +02:00
Boaz Leskes 09db2e2a27 Tests: log when an ensure green/yellow comes back
Also added some trace logging to SimpleRecoveryLocalGatewayTests
2014-09-10 14:42:35 +02:00
Boaz Leskes fc89316b1b Store: improved trace logging for shard active requests 2014-09-10 12:35:09 +02:00
Boaz Leskes 18f58682e7 Tests: add logging to LocalGatewayIndexStateTests 2014-09-10 12:29:00 +02:00
javanna 5bea31cb96 Internal: refactor copy headers mechanism
The functionality of copying headers in the REST layer (from REST requests to transport requests) remains the same. Made it a bit nicer by introducing a RestClientFactory component that is a singleton and allows to register useful headers without requiring static methods.

Plugins just have to inject the RestClientFactory now, and call its `addRelevantHeaders` method that is not static anymore.

Relates to #6513
Closes #7594
2014-09-10 12:05:53 +02:00
Martijn van Groningen 6f763bded9 Test: Enabled ChildrenTests#testParentWithMultipleBuckets with more logging 2014-09-10 11:19:30 +02:00
Simon Willnauer cb839b56b2 [ThreadPool] Use DirectExecutor instead of deprecated API
Guava deprecated MoreExecutors#sameThreadExecutor in favour of
a more efficient implemenation. We should move over to the new impl.
2014-09-10 09:36:30 +02:00
Ryan Ernst 4638d23484 Tests: Re-enable BWC analysis test, skipping strings that could cause issue with LUCENE-5927. 2014-09-09 14:30:31 -07:00
Simon Willnauer 64dce61233 [BUILD] Randomly enable AggressiveOpts in builds 2014-09-09 21:58:37 +02:00
Simon Willnauer 38d88b2e2c [TEST] Added basic test for InternalTestCluster reproducibility 2014-09-09 21:48:42 +02:00
Britta Weber 1138a6ae60 [TEST] fix rounding issue 2014-09-09 19:44:47 +02:00
Simon Willnauer b0cf929637 [TEST] use local random instance rather than thread local version
This influences reprocucibility dramatically since it modifies the
test random sequence while it should just use the private random
instance.
2014-09-09 18:31:41 +02:00
javanna ee3cbce118 Internal: make sure that the request context is always copied from REST to transport layer
Also renamed HeadersCopyClientTests since it tests a class that was renamed and removed randomization around client wrapper, as it now needs to be weapped all the time to copy the context, doesn't depend on useful headers that have been registered anymore.

Relates to #7610
2014-09-09 18:06:46 +02:00
Colin Goodheart-Smithe c8a3460f39 [TEST] more debugging for GeoBoundsTests 2014-09-09 16:49:06 +01:00
Lee Hinman c328397eb6 [TEST] Disable translog flush in CorruptedTranslogTests 2014-09-09 17:48:37 +02:00
Simon Willnauer 32201c762b [TEST] Ensure BWC test run even if node.mode=local is set
Today we throw an error if local transport is configured with BWC tests.
Yet, the BWC test need network to be enabled so test can just set the
required defaults.

Closes #7660
2014-09-09 17:30:43 +02:00
Lee Hinman fc0ee42c07 Fix ordering of Regex.simpleMatch() parameters
Previously we incorrectly sent them in the wrong order, which can cause
validators not to be run for dynamic settings that have been added
matching a particular wildcard.

Fixes #7651
2014-09-09 16:23:55 +02:00
Lee Hinman 57bcd65ca4 Simplify translog interface
get rid of readSource() entirely, it sucked, Operations should be able
to provide the source themselves.

No more TranslogStream headers, you are now required to pass an
StreamInput or StreamOutput for all operations, which means no extra
state is needed and no need to construct new versions when detecting the
version.

Read and write translog op sizes in TranslogStreams

Previously we handled these integers outside of the translog stream
itself, which was very unclean because other code had to know about
reading the size, or about writing the correct header sometimes.

There is some additional code in LocalIndexShardGateway to handle the
legacy case for older translogs, because we need to read and discard the
size in order to maintain the compatibility for the streaming
operations (they did not read or write the size for 1.3.x and earlier).

Additionally, we need to handle a case where the header is truncated
when recovering from disk

Use a NoopStreamOutput instead of byte arrays

Instead of writing translog operations to a temporary byte array and
then writing that byte array to the stream, we now write the operation
twice, once to a No-op stream to get the size, then again to the real
size.

This trades a little more CPU usage for less memory usage.
2014-09-09 15:26:13 +02:00
Martijn van Groningen 52f1ab6e16 Core: Added the `index.query.parse.allow_unmapped_fields` setting to fail queries if they refer to unmapped fields.
The percolator and filters in aliases by default enforce strict query parsing.

Closes #7335
2014-09-09 15:00:47 +02:00
ansj fee832df66 Docs: Update plugins.asciidoc
add search by sql

Closes #7525
2014-09-09 14:57:38 +02:00
Alexander Reelsen bd0eb32d9c CORS: Disable by default
In order to deliver a more secure out-of-the-box configuration this commit
disables cross-origin resource sharing by default.

Closes #7151
2014-09-09 11:09:03 +02:00
Ryan Ernst 789c0a9a1b Quiet BWC analysis test case for now.
See https://issues.apache.org/jira/browse/LUCENE-5927.
2014-09-08 14:23:11 -07:00
Simon Willnauer 2619911e17 [STORE] Write Snapshots directly to the blobstore stream
Today we serialize the snashot metadata to a byte array and then copy
the byte array to a stream. Instead this commit moves the serialization
directly to the target stream without the intermediate representation.

Closes #7637
2014-09-08 22:19:24 +02:00
Colin Goodheart-Smithe b127b52fd3 Revert "Aggregations: Adds ability to sort on multiple criteria"
This reverts commit bfedd11ffa.
2014-09-08 20:27:19 +01:00
Colin Goodheart-Smithe 13d01af940 Revert "[TEST] added @AwaitsFix to failing StringTermsTests while I work on a fix"
This reverts commit 18a713a2ae.
2014-09-08 20:27:16 +01:00
Britta Weber 59ce940d43 [TESTS]: create directory for heapdumps if not exists
Before the heapdump was either written in a file with the
directory name if the heapdump path ended without / or
not written at all if the path ended with /

closes #7645
2014-09-08 21:21:05 +02:00
Simon Willnauer ce2e65f6e7 [TEST] Don't print BWC test path - it's different on every machine 2014-09-08 21:10:09 +02:00
Boaz Leskes 9054ce5569 [Stats] update action returns before updating stats for `NONE` operations
We keep around a noop stats indicating how many update operations ended up not updating the document (typically because it didn't change). However, the TransportUpdateAction update that counter only after returning the result. This can throw off stats check which are done immediately after, potentially causing test failures.

Closes #7639
2014-09-08 20:46:07 +02:00
Simon Willnauer 72c4cb51cc [CORE] Unify search context cleanup
Today there are two different ways to cleanup search contexts which can
potentially lead to double releasing of a context. This commit unifies
the methods and prevents double closing.

Closes #7625
2014-09-08 20:36:19 +02:00
Andrew Selden 80a3038f83 Make .zip and .tar.gz release artifacts contain same files.
This commit changes the build to include .exe and sigar/.dll files in
both the zip and tar artifacts.

Closes #2793
2014-09-08 10:43:09 -07:00
Colin Goodheart-Smithe 18a713a2ae [TEST] added @AwaitsFix to failing StringTermsTests while I work on a fix 2014-09-08 16:28:12 +01:00
Britta Weber ee5221bd22 _timestamp: enable mapper properties merging
Updates on the _timestamp field were silently ignored.
Now _timestamp undergoes the same merge as regular
fields. This includes exceptions if a property cannot
be changed.
"path" and "default" cannot be changed.

closes #5772
closes #6958
closes #7614
partially fixes #777
2014-09-08 17:17:06 +02:00
Colin Goodheart-Smithe bfedd11ffa Aggregations: Adds ability to sort on multiple criteria
The terms aggregation can now support sorting on multiple criteria by replacing the sort object with an array or sort object whose order signifies the priority of the sort. The existing syntax for sorting on a single criteria also still works.

Contributes to #6917
2014-09-08 15:20:33 +01:00
Adrien Grand 11fe940ea9 [TESTS] Add explicit mappings to IndexAliasesTests.testSearchingFilteringAliasesSingleIndex
This makes sure that all shards know about the `_uid` field.
2014-09-08 16:11:50 +02:00
Colin Goodheart-Smithe 12ca36574e [TEST] added debug info to GeoBoundsTests to try to solve build issue 2014-09-08 10:50:25 +01:00
Simon Willnauer aadbfa44b4 [SEARCH] Execute search reduce phase on the search threadpool
Reduce Phases can be expensive and some of them like the aggregations
reduce phase might even execute a one-off call via an internal client
that might cause a deadlock due to execution on the network thread
that is needed to handle the one-off call. This commit dispatches
the reduce phase to the search threadpool to ensure we don't wait
for the current thread to be available.

Closes #7623
2014-09-08 11:32:55 +02:00
Joao Duarte a6e0f02220 Doc: Fixes node client section name on Java API Doc
Closes #7539
2014-09-08 11:20:49 +02:00
mikemccand 130fdef367 Core: remove built-in support for Lucene's experimental codecs
Lucene's experimental codecs (from the codecs module) do not provide
backwards compatibility and are free to change from release to
release.  When they do change, they typically cannot in general read
older indices and the resulting exceptions look like index corruption.
So, we are removing built-in support for them to prevent applications
from choosing one and then seeing strange exceptions on upgrade.

Closes #7566

Closes #7604
2014-09-08 04:55:15 -04:00
Tanvir Alam c7d0c3ea18 Docs: fixed typo
Closes #7544
2014-09-08 10:50:59 +02:00
Clinton Gormley e0684c4f6e Docs: Update regexp-syntax.asciidoc
Closes #7419
2014-09-07 11:42:33 +02:00
Clinton Gormley 46cda7db09 Docs: Clarify that refresh on update just refreshes the relevant shards 2014-09-07 11:41:05 +02:00
Clinton Gormley 3bda779336 Docs: Update scripting.asciidoc
Clarify that doc[...] does not return objects

Closes #7384
2014-09-07 11:39:33 +02:00
Clinton Gormley 51cec43d3c Docs: Clarify that refresh on get/update/delete just refreshes the relevant shards
Closes #7359
2014-09-07 11:36:52 +02:00
Clinton Gormley 0578a703df Docs: Update prefix-query.asciidoc
Typo (missing word)

Closes #7283
2014-09-07 11:32:05 +02:00