Commit Graph

12081 Commits

Author SHA1 Message Date
Ryan Ernst 7a7bd6086a Mappings: Remove ability to disable _source field
Current features (eg. update API) and future features (eg. reindex API)
depend on _source. This change locks down the field so that
it can no longer be disabled. It also removes legacy settings
compress/compress_threshold.

closes #8142
closes #10915
2015-05-05 22:04:18 -07:00
Robert Muir fe5af6f34d Tests: fix test bug (foo -> bar) 2015-05-06 01:03:03 -04:00
Robert Muir 5351fbd8a0 Merge pull request #10997 from rmuir/groovy_better
Load fielddata on behalf of scripts.
2015-05-05 21:26:29 -07:00
Robert Muir 020f7d7195 Load fielddata on behalf of scripts.
If we have to do the one-time loading of fieldata, it requires
more permissions than groovy scripts currently have (zero). This
is because of RamUsageEstimator reflection and so on in PagedBytes.

GroovySecurityTests only test a numeric field, so add a string field
to the test (so pagedbytes fielddata gets created etc).
2015-05-06 00:16:03 -04:00
Robert Muir f613413ce4 Merge pull request #10970 from rmuir/bad_idea
bail if ES is run as root
2015-05-05 17:09:00 -07:00
Robert Muir e4beda94f9 Merge pull request #10983 from rmuir/no_check_certificate
Let HTTPS work correctly
2015-05-05 14:47:37 -07:00
Jack Conradson 9fae152cf5 Scripting: Minor TimeZone Fix
Changed DateMethodFunctionValues to use UTC instead of GMT.  Should
not affect any existing code, but is correct and consistent.

closes #10994
2015-05-05 14:20:54 -07:00
Shay Banon b4b5603617 Merge pull request #10993 from kimchy/sync_interval_not_to_control_type
Use buffered tanslog type also when sync is set to 0
2015-05-05 23:06:11 +02:00
Clinton Gormley 603a0c193b Docs: More translog doc improvements 2015-05-05 22:01:58 +02:00
Clinton Gormley a60251068c Docs: Improved the translog docs 2015-05-05 21:32:52 +02:00
Nicholas Knize 0553001369 [GEO] Remove local lucene spatial package
LUCENE-6422 - PackedQuadTree enhancement - was committed in Lucene 5.2 which is now integrated w/ ES 2.0. This eliminates the need to carry our own local lucene.spatial package. This commit removes the now unnecessary files.
2015-05-05 14:24:31 -05:00
Simon Willnauer 0b256cc629 [TEST] also close wrapped readers 2015-05-05 20:46:07 +02:00
Robert Muir 11394983d9 Merge pull request #10969 from rmuir/grooooooovy
Run groovy scripts with no permissions
2015-05-05 11:36:12 -07:00
Shay Banon ebac29d8a2 Use buffered tanslog type also when sync is set to 0
When settings sync to 0, we benefit from using the buffered type, no need to change to simple, since we get a chance to fsync multiple operations (for that single operation) and not have to sync for the other ones before returning each one
2015-05-05 20:17:36 +02:00
Tanguy Leroux 3976724882 Add pid file to Environment
This commit adds the path of the PID file to the Environment. It also add it to the Security Manager since the PID file is deleted by a shutdown hook when the JVM is exited.
2015-05-05 18:39:19 +02:00
Zachary Tong 4f65130703 [TEST] Fix min/max accumulator in MovAvg tests
Double.MIN_VALUE does not follow the same semantics as Integer.MIN_VALUE.  Namely, it
represents the smallest positive, non-zero value a double can hold.  Since the test uses negative
doubles, this can incorrectly find the min/max metric for a set of values.

Instead, Double.NEGATIVE_INFINITY needs to be used, which represents the smallest value possible.

Not strictly necessary, but MAX_VALUE was switched to POSITIVE_INFINITY just to be 100% correct
2015-05-05 12:29:49 -04:00
Simon Willnauer d20202a963 Remove double exceptin handling that causes false replica failures
we already fail the shard in the `onFailure` method if the replica
operation barfs. This additional check has been added lately that
bypasses the clusterstate observer which causes replicas to fail
if the mappings are not yet present.
2015-05-05 18:04:27 +02:00
Robert Muir afdec4c84c Merge pull request #10989 from rmuir/jna_optional
ensure JNA is fully loaded when its avail, but don't fail its not
2015-05-05 09:03:16 -07:00
Robert Muir 15e6d3ec6c ensure JNA is fully loaded when its avail, but don't fail its not 2015-05-05 11:49:40 -04:00
Britta Weber dc2eed9681 fix after merge with master 2015-05-05 17:45:41 +02:00
Simon Willnauer 200174aa37 Remove Translog interface
We only have one implementation of this interface which makes not much
sense. This commit removes the abstraction.
2015-05-05 17:34:59 +02:00
Britta Weber e3d346d3b7 cleanup 2015-05-05 17:32:03 +02:00
Britta Weber 8349a3ee1e call sync flush when shard is marked as inactive 2015-05-05 17:19:09 +02:00
Robert Muir 9c0d379254 style cleanups (assume and suppressforbidden) 2015-05-05 10:59:39 -04:00
Simon Willnauer fafd67e1ae [TEST] Mute local tests with Java9EA
Relates to #10984
2015-05-05 16:50:57 +02:00
Britta Weber fbc26ca49b implement check for in flight now that we have the counter 2015-05-05 16:15:25 +02:00
Britta Weber 87af6491c9 Merge remote-tracking branch 'origin/master' into feature/synced_flush 2015-05-05 16:15:13 +02:00
Britta Weber 14e5880fea [TEST] don't fail if meta state cannot be loaded
Loading of meta state fails rarely if the state is deleted while we try to load it.
We should try again in this case instead of failing the test.
2015-05-05 15:20:57 +02:00
Robert Muir 13636dcfef Let HTTPS work correctly 2015-05-05 09:14:51 -04:00
Simon Willnauer 00d663f594 [TRANSLOG] Make translog file parsing more picky 2015-05-05 14:11:32 +02:00
Britta Weber 3cda9b2bd7 Write state also on data nodes if not master eligible
When a node was a data node only then the index state was not written.
In case this node connected to a master that did not have the index
in the cluster state, for example because a master was restarted and
the data folder was lost, then the indices were not imported as dangling
but instead deleted.
This commit makes sure that index state for data nodes is also written
if they have at least one shard of this index allocated.

closes #8823
closes #9952
2015-05-05 12:15:40 +02:00
Colin Goodheart-Smithe 12e39a0d5a Scripting: allow script language to be null when parsing
Closes #10926
2015-05-05 11:11:40 +01:00
Simon Willnauer fe5a35b68e Merge branch 'master' into pr-10624
Conflicts:
	src/main/java/org/elasticsearch/index/shard/IndexShard.java
2015-05-05 11:46:02 +02:00
Simon Willnauer 767309265b [ENGINE] Make translog fully private to the engine
This commit moves the translog creation into the InternalEngine
to ensure the transactino log is created after we acquired the write
lock on the index. This also prevents races when ShadowEngines are shutting
down due to node restarts where another node already takes over the not yet
fully synced transaction log.
2015-05-05 11:36:51 +02:00
Clinton Gormley e28ad853c7 Docs: Fixed bad asciidoc in migrate_2_0 2015-05-05 11:17:21 +02:00
Colin Goodheart-Smithe 123b0723fe Aggregations: Fixes Infinite values return from geo_bounds with non-zero bucket-ordinals
If the collect method was called with a bucketOrd of > 0 the arrays holding the state for the aggregation would be grown but the initial values for the bucketOrds > 0 were all set to Double.NEGATIVE_INFINITY meaning that for the bottom, posLeft and negLeft values no collected document would change the value since NEGATIVE_INFINITY is always less than every other value.

Closes #10804
2015-05-05 09:58:31 +01:00
Pascal Borreli af6d890ad5 Docs: Fixed typos
Closes #10973
2015-05-05 10:38:05 +02:00
Simon Willnauer 1bc159ebf7 mute test in favor of #10972 2015-05-05 10:04:52 +02:00
Robert Muir 6ec6567bad bail if ES is run as root 2015-05-05 01:29:57 -04:00
Robert Muir a7774f2d8b Run groovy scripts with no permissions 2015-05-05 00:33:29 -04:00
Robert Muir d62771ac5d Merge pull request #10965 from rmuir/lockdown4
make testing better mimic reality for securitymanager
2015-05-04 17:06:24 -07:00
Ryan Ernst b889b3b437 Use java sys prop override in tests instead of flag to createPermissions 2015-05-04 15:28:08 -07:00
aleph-zero 2b483cc806 Removed reference to search type 'count'
Removed reference to search type 'count' as this is now a deprecated
search type.
2015-05-04 14:48:40 -07:00
Shay Banon 187d79b6df Centralize admin implementations and action execution
This change removes the multiple implementations of different admin interfaces and centralizes it with AbstractClient. It also makes sure *all* executions of actions now go through a single AbstractClient#execute method, taking care of copying headers and wrapping listener.
This also has the side benefit of removing all the code around differnet possible clients, and removes quite a bit of code (most of the + code is actually removal of generics and such).

This change also changes how TransportClient is constructed, requiring a Builder to create it, its a breaking change and its noted in the migration guide.

Yea another step towards simplifying the action infra and making it simpler...
2015-05-04 23:40:17 +02:00
Robert Muir 072b90296a Use the special java.ext.dirs path instead of 4 tomcat heuristics 2015-05-04 17:16:08 -04:00
Igor Motov bd453db411 Docs: clarify cluster state handling 2015-05-04 17:00:36 -04:00
Robert Muir 8e8b95faeb fix wrong comment change 2015-05-04 16:30:42 -04:00
Robert Muir 2ed2c4f884 fix permissions bugs 2015-05-04 16:27:24 -04:00
Lee Hinman eabeae980b Merge remote-tracking branch 'dakrone/sharedfs-recovery-any-node' 2015-05-04 14:15:30 -06:00
Lee Hinman 18ab718693 Allow shards on shared filesystems to be recovered on any node
Currently, when all copies of a shard are lost, we reach out to all
other nodes to see whether they have a copy of the data. For a shared
filesystem, though, we can assume that each node has a copy of the data
available, so return a state version of at least 0 for each node.

This feature is set using the dynamic index setting
`index.shared_filesystem.recover_on_any_node`, which defaults to
`false`.

Fixes #10932
2015-05-04 14:03:31 -06:00