1806 Commits

Author SHA1 Message Date
Ryan Ernst
2539b779c8 Merge pull request #13137 from rjernst/empty_doc_again
Fix doc parser to still pre/post process metadata fields on disabled type
2015-08-30 12:14:18 -07:00
Ivannikov Kirill
38805f3cbd Fix 13202 2015-08-30 23:56:34 +05:00
Jason Tedor
aa26b66e96 Remove leftover debugging statement 2015-08-30 14:19:30 -04:00
Simon Willnauer
86a8a0a570 IndicesStatsAction is now a per node operation 2015-08-30 12:48:13 +02:00
David Pilato
03bb28514e Installing plugin without checksums ends up downloading from github
```sh
bin/plugin install lmenezes/elasticsearch-kopf/develop
-> Installing lmenezes/elasticsearch-kopf/develop...
Trying http://download.elastic.co/lmenezes/elasticsearch-kopf/elasticsearch-kopf-develop.zip ...
Trying http://search.maven.org/remotecontent?filepath=lmenezes/elasticsearch-kopf/develop/elasticsearch-kopf-develop.zip ...
Trying https://oss.sonatype.org/service/local/repositories/releases/content/lmenezes/elasticsearch-kopf/develop/elasticsearch-kopf-develop.zip ...
Trying https://github.com/lmenezes/elasticsearch-kopf/archive/develop.zip ...
Downloading .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DONE
Verifying https://github.com/lmenezes/elasticsearch-kopf/archive/develop.zip checksums if available ...
Trying https://github.com/lmenezes/elasticsearch-kopf/archive/master.zip ...
Downloading ....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................DONE
Verifying https://github.com/lmenezes/elasticsearch-kopf/archive/master.zip checksums if available ...
```

This happens because we don't have anymore ElasticsearchWrapperException here but standard java exceptions.

Closes #13196.
2015-08-29 23:00:45 +02:00
Jason Tedor
5cb86130ec Add mechanism for transporting shard-level actions by node
Currently, many shard-level operations are transported with a request
per shard via TransportBroadcastAction. These shard-level requests are
then submitted to unbounded execution queues for asynchronous execution
on the receiving node. This transport mechanism and stuffing of the
execution queues can be problematic on large clusters. A better
mechanism would be to aggregate the shard-level requests, transport
them via a single request per node, and execute the shard-level
operations serially on the receiving node.

This commit introduces TransportNodeBroadcastAction which is the
high-level mechanism for transporting the shard-level operations in a
single request per node. The shard-level operations are executed
serially on the receiving node and per-node shard-level results are
aggregated into a single response per node. These node-level results
are then aggregated into a single response to the initial request.

One item of note is a new mechanism for registering request handlers.
This mechanism enables registrants to provide a callback for
instantiating new instances of the request class. Doing this enables
the inner class to be instantiated with the context of its outer class.
This is done so that a single NodeRequest class can be defined rather
than defining a class per operation.

Closes #7990
2015-08-29 16:15:12 -04:00
Jim Hooker
05aa1d90b8 Extend AbstractComponent and remove logger 2015-08-29 07:43:17 +01:00
Jason Tedor
0fa8ee1edd Fix logging statement in o.e.a.s.m.TransportMasterNodeAction 2015-08-28 13:39:56 -04:00
Jason Tedor
532d100c22 Fix logging statement 2015-08-28 13:34:22 -04:00
Nik Everett
c180defb10 [CAT] Default verbose to false
Closes #13156
2015-08-28 11:15:44 -04:00
Simon Willnauer
0c71328186 Expand ClusterInfo to provide min / max disk usage forn allocation decider
Today we sum up the disk usage for the allocation decider which is broken since
we don't stripe across multiple data paths. Each shard has it's own private path
now but the allocation deciders still treat all paths as one big disk. This commit
adds allows allocation deciders to access the least used and most used path to make
better allocation decidsions upon canRemain and canAllocate calls.

Yet, this commit doesn't fix all the issues since we still can't tell which shard
can remain and which can't. This problem is out of scope in this commit and will be solved
in a followup commit.

Relates to #13106
2015-08-28 14:04:25 +02:00
Boaz Leskes
218979da1b remove committedOrFailed and use committedOrFailedLatch for state 2015-08-28 12:31:46 +02:00
Boaz Leskes
10e8c410ea more feedback 2015-08-28 12:31:46 +02:00
Boaz Leskes
0668e0d623 more feedback 2015-08-28 12:31:46 +02:00
Boaz Leskes
c9ee8dbd16 tighten up FailedToCommitClusterStateException semantics and other feedback 2015-08-28 12:31:45 +02:00
Boaz Leskes
98ed133dd7 reduce log chatter 2015-08-28 12:31:45 +02:00
Boaz Leskes
c7c65b626f commit timeout default should never be larger than publishing timeout 2015-08-28 12:31:45 +02:00
Boaz Leskes
6208248215 fix defaults in DiscoverySettings 2015-08-28 12:31:44 +02:00
Boaz Leskes
91dee8b311 reject older cluster state from the same master 2015-08-28 12:31:44 +02:00
Boaz Leskes
a56d67d8d7 force mock transport in testCanNotPublishWithoutMinMastNodes 2015-08-28 12:31:44 +02:00
Boaz Leskes
e3e0aa5049 Improved concurrency controls In SendingController to make sure that a CS is never committed after publishing is marked out as timed out 2015-08-28 12:31:44 +02:00
Boaz Leskes
234a3794e5 improved timeout handling 2015-08-28 12:31:44 +02:00
Boaz Leskes
4d31681057 added constructor to FailedToCommitException 2015-08-28 12:31:43 +02:00
Boaz Leskes
7d3a36b20f fix ZenDiscoveryUnitTest.testShouldIgnoreNewClusterState 2015-08-28 12:31:43 +02:00
Boaz Leskes
7390bcf833 add FailedToCommitException to registration 2015-08-28 12:31:43 +02:00
Boaz Leskes
b702843fe9 beefed up testing... 2015-08-28 12:31:43 +02:00
Boaz Leskes
81e07e81e0 simplified PublishClusterStateActionTests infra 2015-08-28 12:31:42 +02:00
Boaz Leskes
3815a41626 initial copy over from POC 2015-08-28 12:31:42 +02:00
Boaz Leskes
35f9ee7a62 Tests: better isolation of cluster ports
Previously multiple clusters in the same JVM reused the same port ranges, leading to potential big gaps in port selection, which in turns causes unicast based discovery to fail, missing to find another node in the default 5 port range.

Also the previous logic had http use a range that is assigned to another JVMs.
2015-08-28 11:39:30 +02:00
Michael McCandless
07b5d22d91 disable new test on windows 2015-08-28 05:06:35 -04:00
javanna
4ed198fef0 [TEST] fix compilation error in IndexShardTests 2015-08-28 10:54:14 +02:00
javanna
78d097de39 Merge branch 'master' into feature/query-refactoring
Conflicts:
	core/src/main/java/org/apache/lucene/queryparser/classic/MapperQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/AndQueryBuilder.java
	core/src/main/java/org/elasticsearch/index/query/AndQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/BoolQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/DisMaxQueryBuilder.java
	core/src/main/java/org/elasticsearch/index/query/DisMaxQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/GeoPolygonQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/HasChildQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/HasParentQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/MoreLikeThisQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/MultiMatchQueryBuilder.java
	core/src/main/java/org/elasticsearch/index/query/NestedQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/OrQueryBuilder.java
	core/src/main/java/org/elasticsearch/index/query/OrQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/PrefixQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/RegexpQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/SpanNearQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/SpanOrQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/TermQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/TermsQueryParser.java
	core/src/main/java/org/elasticsearch/index/query/support/InnerHitsQueryParserHelper.java
	core/src/test/java/org/elasticsearch/index/query/SimpleIndexQueryParserTests.java
2015-08-28 10:49:28 +02:00
Michael McCandless
fb703845dd Merge pull request #13158 from mikemccand/new_path_for_shard_test
Add unit test for ShardPath.selectNewPathForShard
2015-08-28 04:15:15 -04:00
javanna
084a6101fe [TEST] add serialization tests for QueryShardException 2015-08-28 10:13:41 +02:00
Michael McCandless
b646ed9cd8 try to work on Windows too 2015-08-28 04:13:21 -04:00
Michael McCandless
8dbc1fbdbd use ShardPath.getRootStatePath; allow forbidden API 2015-08-28 03:59:02 -04:00
javanna
6307738406 Internal: clean up named writeable registry handling in netty transport classes
There are some leftovers around usage of NamedWriteableRegistry in our branch compared to master, just because the registry was added first here, then backported to master, and something didn't go completely right during the final merge.
2015-08-28 09:57:39 +02:00
Boaz Leskes
db5e225a25 Discovery: fix discovery.zen.join_timeout default value logic
We default the value to be 20x the value of a ping timeout, however we only use the legacy ping timeout settings value for the calculation.

Closes #13162
2015-08-28 09:47:15 +02:00
javanna
9b2e77903d Internal: make ValidationException methods final and fix javadocs 2015-08-28 09:41:47 +02:00
javanna
37ec221df5 Internal: remove unused MapperQueryParser constructor 2015-08-28 09:38:29 +02:00
javanna
24e53b5f8f Internal: remove code duplication in QueryValidationException
The class can now simply extend ValidationException and rely on the base class.
2015-08-28 09:35:43 +02:00
Jason Tedor
90bc784194 Work around for JDK-8039214 on JDK 9 2015-08-27 23:29:22 -04:00
Jason Tedor
3067cacb66 Remove and forbid use of com.google.common.collect.Lists
This commit removes and now forbids all uses of
com.google.common.collect.Lists across the codebase. This is the first
of many steps in the eventual removal of Guava as a dependency.
2015-08-27 22:14:33 -04:00
Igor Motov
2b87d7d919 Add readonly option for repositories
Closes #7831
Closes #11753
2015-08-27 18:21:29 -04:00
Nik Everett
19a79c99f9 [test] Use proper comparison operator
lessThanOrEqualTo is more appropriate when comparing _ttl than lessThan
because in rare cases, when tests run very fast, the ttl you fetch will
still equal the one you sent.
2015-08-27 16:43:10 -04:00
Britta Weber
e6eeadd171 [test] make sure that the scripts in testScoreAccessWithinScript never compute log(0) 2015-08-27 22:02:51 +02:00
Ryan Ernst
448d3498b1 Merge branch 'master' into fix/bwc_creation 2015-08-27 10:16:45 -07:00
Michael McCandless
e2e1b7f76a reference original issue 2015-08-27 13:06:00 -04:00
Michael McCandless
30a3e431ec polish 2015-08-27 13:01:36 -04:00
Michael McCandless
11f09f0a68 add basic unit test 2015-08-27 12:33:04 -04:00