Commit Graph

6199 Commits

Author SHA1 Message Date
Igor Motov bb034f42b8 Add Upgrade API Index Upgrade Info action (elastic/x-pack-elasticsearch#1264)
Adds a new Upgrade API with the first action, index upgrade info, that returns that list of indices that require upgrade in the current cluster before the cluster can be upgraded to the next major version.

Relates to elastic/x-pack-elasticsearch#1214

Original commit: elastic/x-pack-elasticsearch@761e7d2128
2017-06-27 17:53:58 -04:00
Ryan Ernst 84574c0367 Another fix for security tribe tests when ssl is disabled
Original commit: elastic/x-pack-elasticsearch@db2eca3522
2017-06-27 14:53:12 -07:00
Suyog Rao e8472908c1 [Logstash] Change config management license to Gold (elastic/x-pack-elasticsearch#1843)
* [Logstash] Change management license to Gold

Previously the license type for LS config management was `BASIC`. In order to use the security features in Standard/Gold, we had to bump Logstash as well to Gold license.

relates elastic/x-pack-elasticsearch#1841

Original commit: elastic/x-pack-elasticsearch@29194b2417
2017-06-27 14:21:00 -07:00
Ryan Ernst ad9797393a Fix tribe tests with secure ssl settings
Original commit: elastic/x-pack-elasticsearch@a06ef174b0
2017-06-27 14:01:21 -07:00
Tal Levy 8145b100f1 Introduce the deprecation API (elastic/x-pack-elasticsearch#1833)
Adds REST endpoint and Transport Action for retrieving breaking-changes deprecations that exist in current version. This PR is just the framework for such an API, future checks will be added to the appropriate branches.

Original commit: elastic/x-pack-elasticsearch@990e3468e9
2017-06-27 13:51:45 -07:00
Lisa Cawley 6d4be0e5d3 [DOCS] Add multi-metric job creation to ML getting started tutorial (elastic/x-pack-elasticsearch#1451)
* [DOCS] Getting started with multi-metric jobs

* [DOCS] More work on ML getting started with multi-metric jobs

* [DOCS] Add ML getting started with multi-metric jobs screenshot

* [DOCS] Add ML getting started information about influencers

* [DOCS] Getting started with multi-metric jobs

* [DOCS] Fix ML getting started build error

* [DOCS] Add ML getting started multi-metric snapshots

* [DOCS] Add screenshots and next steps to ML Getting Started tutorial

* [DOCS] Clarified anomaly scores in ML Getting Started pages

* [DOCS] Addressed ML getting started feedback

* [DOCS] Fix ML getting started links

Original commit: elastic/x-pack-elasticsearch@a7e80cfabf
2017-06-27 13:31:35 -07:00
Jason Tedor b710f5906f Register primary context handoff as known handler
This commit registers the primary context handoff handler as known.

relates elastic/x-pack-elasticsearch#1856

Original commit: elastic/x-pack-elasticsearch@f91142a521
2017-06-27 15:18:44 -04:00
lcawley e8df087bde [DOCS] Add link to installation pages
Original commit: elastic/x-pack-elasticsearch@6884bbe1de
2017-06-27 11:31:33 -07:00
Ryan Ernst 9b3fb66394 Settings: Add secure versions of SSL passphrases (elastic/x-pack-elasticsearch#1852)
This commit adds new settings for the ssl keystore (not the ES keystore)
passphrase settings. New setting names are used, instead of trying to
support the existing names in both yml and the ES keystore, so that
there does not need to be complicated logic between the two. Note that
the old settings remain the only way to set the ssl passphrases for the
transport client, but the Settings object for transport clients are
created in memory by users, so they are already as "secure" as having a
loaded ES keystore. Also note that in the long term future (6.x
timeframe?) these settings should be deprecated and the keys/certs
themselves should be moved into the ES keystore, so there will be no
need for separate keystores/passphrases.

relates elastic/elasticsearch#22475

Original commit: elastic/x-pack-elasticsearch@be5275fa3d
2017-06-27 10:15:12 -07:00
Lisa Cawley 6d1f7bee10 [DOCS] Update links to use shared attributes (elastic/x-pack-elasticsearch#1855)
Original commit: elastic/x-pack-elasticsearch@b1553510b1
2017-06-27 09:46:56 -07:00
Lisa Cawley f2e20f86e4 [DOCS] Fix X-Pack settings for Elasticsearch (elastic/x-pack-elasticsearch#1863)
Original commit: elastic/x-pack-elasticsearch@8469db2909
2017-06-27 09:14:35 -07:00
Tal Levy 7c7bf475c1 reflect core change to method signature in sourceAsMap (elastic/x-pack-elasticsearch#1862)
x-pack change for https://github.com/elastic/elasticsearch/pull/25410

Original commit: elastic/x-pack-elasticsearch@908ddd3413
2017-06-27 08:59:29 -07:00
Alexander Reelsen 403cf8eba3 Watcher: Refactoring of TriggeredWatchStore (elastic/x-pack-elasticsearch#1848)
* The TriggeredWatchStore now only has one method to put triggered
  watches
* All code is async in TriggeredWatchStore, locking has been removed
* The dedicated WatchRecord.Fields interface has been removed
* TriggeredWatchTests integration test has been moved to a unit test

Original commit: elastic/x-pack-elasticsearch@bc4b5820fb
2017-06-27 17:47:00 +02:00
lcawley 84ec242636 [DOCS] Fixed typo in X-Pack settings
Original commit: elastic/x-pack-elasticsearch@3c9f548b75
2017-06-27 07:53:47 -07:00
David Roberts 46b9f6de3a [DOCS] Auto create required for ML indices (elastic/x-pack-elasticsearch#1858)
Original commit: elastic/x-pack-elasticsearch@5d309559ed
2017-06-27 15:27:28 +01:00
Simon Willnauer 9b0639d7f0 Remove usage of `mapper.single_type` from xpack tests (elastic/x-pack-elasticsearch#1853)
`index.mapper.single_type` will be removed in master. While there is still
one usage in the security template that we are working on, this change
will remove the remaining usage.

Original commit: elastic/x-pack-elasticsearch@6e7f63b9e0
2017-06-27 13:29:34 +02:00
Daniel Mitterdorfer 54345e6b8e Mute MlDistributedFailureIT#testFullClusterRestart()
Relates elastic/elasticsearch#25415

Original commit: elastic/x-pack-elasticsearch@01fa0e7601
2017-06-27 12:44:22 +02:00
Daniel Mitterdorfer 10a95c4268 Add AwaitsFix to KnownActionsTests#testAllTransportHandlersAreKnown
Relates elastic/x-pack-elasticsearch#1856

Original commit: elastic/x-pack-elasticsearch@ea16c49af0
2017-06-27 08:58:55 +02:00
Deb Adair b933214dcd [DOCS] Adding shared x-pack-settings file.
Original commit: elastic/x-pack-elasticsearch@2b74fab772
2017-06-26 21:09:55 -07:00
Deb Adair 5a9eb01c3f [DOCS] Fixed broken link to Monitoring Logstash.
Original commit: elastic/x-pack-elasticsearch@bb5dafbd40
2017-06-26 17:33:59 -07:00
Deb Adair fbcdd262b7 [DOCS] Fixed x-ref to security settings.
Original commit: elastic/x-pack-elasticsearch@4a77a45f00
2017-06-26 17:23:20 -07:00
Deb Adair 26dc6187fc [DOCS] Fixed cross doc links.
Original commit: elastic/x-pack-elasticsearch@c7b37c858a
2017-06-26 16:05:12 -07:00
Deb Adair ea9ce967ca [DOCS] Fixed broken links.
Original commit: elastic/x-pack-elasticsearch@7ddf574e38
2017-06-26 12:54:59 -07:00
Jason Tedor c22494bcb7 Remove path.conf setting
This commit is a response to a change in core removing path.conf as a
valid setting.

Relates elastic/x-pack-elasticsearch#1844

Original commit: elastic/x-pack-elasticsearch@477a7eab71
2017-06-26 15:18:49 -04:00
Deb Adair 0cf3d935eb [DOCS] Fixed xrefs to X-Pack content.
Original commit: elastic/x-pack-elasticsearch@c9ed85e910
2017-06-26 10:35:25 -07:00
Deb Adair cf096a0cac [DOCS] Fixed x-refs to Watcher content in X-Pack ref.
Original commit: elastic/x-pack-elasticsearch@fdb63d0809
2017-06-26 10:06:13 -07:00
Alexander Reelsen 0912a85778 Tests: Add test for templatable URLs, that are URL encoded
This is just a workaround at the moment, but allows to use
mustache if you only provide the `url` part of a request,
instead of scheme, port, path, host, etc.

Original commit: elastic/x-pack-elasticsearch@3a4aa26665
2017-06-26 18:24:53 +02:00
Deb Adair 806b0bc710 [DOCS] Removed UI and Logstash settings & updated links to that info.
Original commit: elastic/x-pack-elasticsearch@2434e503dd
2017-06-26 09:04:56 -07:00
Deb Adair f9f47d047d [DOCS] Wrapping up distribution of X-Pack settings reference info.
Original commit: elastic/x-pack-elasticsearch@0fd5d0d4d4
2017-06-26 09:04:56 -07:00
David Kyle 2ad9ce4840 [ML] Remove duplicated test classes (elastic/x-pack-elasticsearch#1850)
Original commit: elastic/x-pack-elasticsearch@cb5a1b544a
2017-06-26 16:20:59 +01:00
lcawley 0b51f7326d [DOCS] Fixed terms typo
Original commit: elastic/x-pack-elasticsearch@25d5e829d3
2017-06-26 07:46:47 -07:00
Dimitris Athanasiou bd06a7b9b4 [ML] Do not write JSON records when metric value is not finite (elastic/x-pack-elasticsearch#1849)
relates elastic/x-pack-elasticsearch#1847

Original commit: elastic/x-pack-elasticsearch@26a69b840f
2017-06-26 14:45:00 +01:00
Alexander Reelsen 3db3cd0f0b Watcher: Reduce logging noise if no local watcher shards exist (elastic/x-pack-elasticsearch#1846)
Every cluster state update resulted in a log message, that watcher
pauses execution. This has been fixed to only log, if there was an
actual state switch from executing to pausing, but do nothing if
there are no local shards anyway.

This will reduce the logging noise in tests a lot.

Original commit: elastic/x-pack-elasticsearch@32ab86610c
2017-06-26 12:49:08 +02:00
David Kyle 232d59b855 [ML] Give kill a chance to stop autodetect before closing input (elastic/x-pack-elasticsearch#1824)
* Give kill a chance to kill the process before closing input

* Remove variable that can be refactored out

Original commit: elastic/x-pack-elasticsearch@42f7a3cece
2017-06-26 10:17:44 +01:00
Colin Goodheart-Smithe 27aa3094f6 Adds GraphExploreRequest as a remote index request (elastic/x-pack-elasticsearch#1836)
The graph API needs to be able to search in remote indices. Although it uses the Search API to perform the search and so doesn’t need to deal with remote indexes directly, the security feature needs to know it can be used with remote indexes so it knows to include remote indices in the list of indices accessible from the API for index level security

Original commit: elastic/x-pack-elasticsearch@e3cd84963e
2017-06-26 09:59:00 +01:00
Tim Vernum a73be456ec [Security] Don't apply local restrictions on remote cluster search (elastic/x-pack-elasticsearch#1609)
This change removes all local security checks against remote cluster names.
Any user is allowed to attempt a cross-cluster search, and it is the responsibility of the remote cluster to authorise the search (or not).

This includes support for remote searches even if you have _no_ local search privileges.

Original commit: elastic/x-pack-elasticsearch@1620c3a8fa
2017-06-26 12:30:31 +10:00
Nik Everett 872badccb4 Fix docs build
We committed broken examples and I don't know how to fix them
so I'll disable them for now.

Original commit: elastic/x-pack-elasticsearch@5f127e3e8e
2017-06-23 17:48:13 -04:00
lcawley 29873a37e9 [DOCS] Add transforms to build.gradle
Original commit: elastic/x-pack-elasticsearch@f8fa32f444
2017-06-23 13:50:41 -07:00
lcawley 1ee5c32620 [DOCS] Remove datafeedresource from build.gradle
Original commit: elastic/x-pack-elasticsearch@4bb411f693
2017-06-23 12:07:30 -07:00
Lisa Cawley 2b1d5f2cf2 [DOCS] Add ML configuration details and examples for script fields (elastic/x-pack-elasticsearch#1593)
* [DOCS] Add ML info about script fields

* [DOCS] Add links to ML script fields page

* [DOCS] Add ML API examples to transforms.asciidoc

* [DOCS] Addressed feedback in ML script field examples

* [DOCS] Add preview to ML script fields example

* [DOCS] Expanded code snippets in ML transform examples

* [DOCS] Add output for ML scripted fields example

* [DOCS] Add output for more ML scripted field examples

* [DOCS] Add output for final ML scripted field examples

* [DOC] Add Kibana details for ML script fields

* [DOCS] Remove example from ML transforms

Original commit: elastic/x-pack-elasticsearch@51057b029f
2017-06-23 11:42:37 -07:00
lcawley 431118b123 [DOCS] Add links to population analysis
Original commit: elastic/x-pack-elasticsearch@52e1cd36e2
2017-06-23 11:24:47 -07:00
Lisa Cawley 527b789e6f [DOCS] Add configuration information for population analysis (elastic/x-pack-elasticsearch#1653)
* [DOCS] Add configuration information for population analysis

* [DOCS] Add ML population analysis examples

* [DOCS] Address feedback for population analysis

* [DOCS] More feedback on population analysis

Original commit: elastic/x-pack-elasticsearch@ffa2bfeed9
2017-06-23 10:53:16 -07:00
Lisa Cawley 00c40c8299 [DOCS] Remove ML validate APIs (elastic/x-pack-elasticsearch#1801)
Original commit: elastic/x-pack-elasticsearch@fb11c1ad49
2017-06-23 08:55:31 -07:00
Dimitris Athanasiou 701dc53c2a [ML] Refactor aggregation response handling to make more flexible (elastic/x-pack-elasticsearch#1795)
Currently, aggregated datafeeds construct JSON from the aggregation
response by traversing all nested aggregations. In order to
achieve this, multiple leaf aggregations are not supported. Also,
scenarios it makes it impossible to effectively use pipeline
aggregations as it will not ignore the intermediate bucket
aggregations.

This commit refactors AggregationToJsonProcessor in order to
support the above scenarios. This is achieved by only converting
the fields of interest, that is the job analysis fields.

Original commit: elastic/x-pack-elasticsearch@8b575956ca
2017-06-23 12:36:32 +01:00
Alexander Reelsen efc93c7246 Tests: Increase loglevel, deactivate ML/monitoring to unclutter logs
Relates elastic/x-pack-elasticsearch#1807

Original commit: elastic/x-pack-elasticsearch@a958f32a3c
2017-06-23 10:40:31 +02:00
Deb Adair 7e1d8d5750 [DOCS] Added Kibana CCS section from x-pack-kibana.
Original commit: elastic/x-pack-elasticsearch@1504efc452
2017-06-22 19:48:29 -07:00
Tim Vernum 5c157fcd7b [TESTS] Fix potential for negative sleep (elastic/x-pack-elasticsearch#1818)
Original commit: elastic/x-pack-elasticsearch@cb19908a61
2017-06-23 11:45:09 +10:00
Andy Bristol 855c63dbc7 User/role names can be longer with more characters (elastic/x-pack-elasticsearch#1745)
This changes the validation criteria we use for user and role
names in the file realm, native realm, and the
realm-agnostic code in x-pack security. The new criteria is:

A valid username's length must be at least 1 and no more than 1024
characters. It may not contain leading or trailing whitespace. All
characters in the name must be be alphanumeric (`a-z`, `A-Z`, `0-9`),
printable punctuation or symbols in the https://en.wikipedia.org/wiki/Basic_Latin_(Unicode_block)[Basic Latin (ASCII) block],
or the space character.

Original commit: elastic/x-pack-elasticsearch@f77640f269
2017-06-22 13:05:56 -07:00
Simon Willnauer 2fef2c72eb Simplify SSL server configuratin validation (elastic/x-pack-elasticsearch#1826)
Today we have some hidden complexity related to default configurations
might specify NO_KEY which is in some cases valid for server configuration.
This change removes the leniencey paramenters on the validation methods and removes
obsolet asserts.

Original commit: elastic/x-pack-elasticsearch@17ed4b1d20
2017-06-22 21:48:51 +02:00
David Kyle 12eec0e911 [ML] Wait for job to close in test (elastic/x-pack-elasticsearch#1825)
Original commit: elastic/x-pack-elasticsearch@3dbeed58f3
2017-06-22 17:21:16 +01:00