Commit Graph

110 Commits

Author SHA1 Message Date
David Kyle d9882be292 [ML] Use unique and predictable IDs for result docs (elastic/x-pack-elasticsearch#1521)
* Remove sequenceNum from anomaly records and influencers

* Generate unqiue IDs without sequence numbers

* Remove more instances of sequence_num

* Handle parsing sequnce_num from v5.4

Original commit: elastic/x-pack-elasticsearch@e60b206daf
2017-05-24 09:59:17 +01:00
Lisa Cawley 386ac7345c [DOCS] Add details about using aggregations with machine learning (elastic/x-pack-elasticsearch#1446)
* [DOCS] Add ML aggregations configuration scenario

* [DOCS] Refine ML configuration page

* [DOCS] Add ML aggregation details

* [DOCS] Add links to aggregations in Configuring ML

* [DOCS] Address feedback about ML aggregations

Original commit: elastic/x-pack-elasticsearch@8474144093
2017-05-23 14:34:21 -07:00
Clinton Gormley 844a97586e Updated docs for cross-cluster search (elastic/x-pack-elasticsearch#1478)
* Updated docs for cross-cluster search

Wildcards are now supported in both cluster alias and index name,
and the "view_index_metadata" privilege is automatically conferred
by the "read_cross_cluster" role.

* For now, best to allow users permissions to query all indices on all remote clusters

Original commit: elastic/x-pack-elasticsearch@31959f78f4
2017-05-23 19:18:03 +02:00
Alexander Reelsen 521b7a1940 Watcher: Support setting of markdown in attachments (elastic/x-pack-elasticsearch#1492)
Watcher: Support setting of markdown in attachments

This allows to set the `mrkdwn_in` array in slack attachments to specify which fields should contain markdown.
See https://api.slack.com/docs/message-formatting#message_formatting

This is mainly useful for the text and pretext fields in an attachment.

relates elastic/x-pack-elasticsearch#403

Original commit: elastic/x-pack-elasticsearch@ee4180e4bf
2017-05-23 13:33:00 +02:00
Lisa Cawley d18c48f820 [DOCS] Add info about configuring ML (elastic/x-pack-elasticsearch#1497)
Original commit: elastic/x-pack-elasticsearch@a9dfc239cc
2017-05-19 13:40:50 -07:00
Lisa Cawley d72a8f8026 [DOCS] Add ML geographic functions (elastic/x-pack-elasticsearch#1357)
* [DOCS] Add ML geographic functions

* [DOCS] Add script_fields info to ML geo functions

* [DOCS] Remove summary count from ML geographic functions

* [DOCS] Added example title to geographic functions

* [DOCS] Remove list from ML geographic functions

Original commit: elastic/x-pack-elasticsearch@a8e495657f
2017-05-19 11:09:39 -07:00
Lisa Cawley 27b0af7eae [DOCS] Modify ML analytical functions (elastic/x-pack-elasticsearch#1467)
* [DOCS] Modify ML analytical functions

* [DOCS] Fix ML function section titles

Original commit: elastic/x-pack-elasticsearch@f95ae012bb
2017-05-19 10:48:15 -07:00
debadair 5353c35420 [DOCS] Removed references to file-based scripts.
Original commit: elastic/x-pack-elasticsearch@f0462e2f69
2017-05-18 11:18:11 -07:00
David Kyle f3c94915b0 [ML] Add sort parameter for get buckets (elastic/x-pack-elasticsearch#1464)
* Add sort parameter for get buckets

* Add secondary sort by time

* Use default values from actions in rest requests

Original commit: elastic/x-pack-elasticsearch@a530c0bed6
2017-05-18 16:40:54 +01:00
Alexander Reelsen 27af24de6f Docs: Fix link to current smtp java documentation
relates elastic/x-pack-elasticsearch#1468

Original commit: elastic/x-pack-elasticsearch@768d699f8a
2017-05-18 16:51:28 +02:00
Clinton Gormley aba877e6a2 Removed reference to file-based scripts
Relates to https://github.com/elastic/elasticsearch/pull/24627

Original commit: elastic/x-pack-elasticsearch@7a59422e5d
2017-05-18 09:17:46 +02:00
Lisa Cawley f44302740d [DOCS] Fix build error related to bad link (elastic/x-pack-elasticsearch#1470)
Original commit: elastic/x-pack-elasticsearch@d56fe65df6
2017-05-17 17:16:34 -07:00
Ryan Ernst f7705eac86 Remove file scripts (elastic/x-pack-elasticsearch#1399)
This is the xpack side of elastic/elasticsearch#24627


Original commit: elastic/x-pack-elasticsearch@4d1c745d74
2017-05-17 14:42:46 -07:00
Honza Král d65dfcf2d9 Fix path to graph.explore in docs to match specs (elastic/x-pack-elasticsearch#1089)
Merging, will push an update to re-enable testing separately

Original commit: elastic/x-pack-elasticsearch@3adf3c41d4
2017-05-17 13:13:10 -07:00
Lisa Cawley 6d6c776cd4 [DOCS] Add ML rare functions (elastic/x-pack-elasticsearch#1351)
* [DOCS] Add ML rare functions

* [DOCS] Address feedback in ML rare functions

Original commit: elastic/x-pack-elasticsearch@388274557c
2017-05-17 09:34:30 -07:00
Lisa Cawley cf5f8e4bad [DOCS] Clarify model snapshots (elastic/x-pack-elasticsearch#1447)
Original commit: elastic/x-pack-elasticsearch@55f307cf89
2017-05-17 09:02:52 -07:00
Lisa Cawley ea2214e5ce [DOCS] Require job to have explicit data_description (elastic/x-pack-elasticsearch#1445)
* [DOCS] Require job to have explicit data_description

* [DOCS] Fix typo in put-job.asciidoc

Original commit: elastic/x-pack-elasticsearch@e7fbbff7eb
2017-05-17 08:53:43 -07:00
Lisa Cawley 446a08b391 [DOCS] Add ML cross cluster search limitation (elastic/x-pack-elasticsearch#1314)
* [DOCS] Add ML cross cluster search limitation

* [DOCS] Clarify node.ml setting

Original commit: elastic/x-pack-elasticsearch@19a0c5d822
2017-05-16 08:19:25 -07:00
Lisa Cawley f8531004a8 [DOCS] Add info about ML sum functions (elastic/x-pack-elasticsearch#1347)
* [DOCS] Add info about ML sum functions

* [DOCS] Fix ML sum functions

Original commit: elastic/x-pack-elasticsearch@6e2fb79cea
2017-05-16 07:59:53 -07:00
Lisa Cawley 4e8c7ad094 [DOCS] Add script_fields to ML data feed documentation (elastic/x-pack-elasticsearch#1372)
* [DOCS] Add script_fields to ML datafeed APIs

* [DOCS] Add datafeedresource.asciidoc to build.gradle

* [DOCS] Addressed feedback in PR 1372

Original commit: elastic/x-pack-elasticsearch@3404ca7850
2017-05-15 09:30:30 -07:00
Tim Vernum 9f7f8ffb4d Outstanding docs for 5.4 changes (elastic/x-pack-elasticsearch#1280)
Docs for security features in 5.4

- `has_privileges` API
-  ldap metadata.

Original commit: elastic/x-pack-elasticsearch@22c733c814
2017-05-12 16:51:47 +10:00
Tim Vernum 441589e21f [DOCS] Clarify built-in and internal uses/roles (elastic/x-pack-elasticsearch#1269)
- Describe internal users (_system, _xpack)
- Explain that built-in users are not the same as native users
- More clarification around logstash_system role and kibana_system role.

Closes: elastic/x-pack-elasticsearch#734
Closes: elastic/x-pack-elasticsearch#268
Closes: elastic/x-pack-elasticsearch#1116

Original commit: elastic/x-pack-elasticsearch@2ecbd3419f
2017-05-12 15:41:44 +10:00
Lee Hinman 8fe2ba02f2 [TEST] Use non-deprecated _key instead of _term for aggregation ordering
Otherwise the console doc tests fail due to the unexpected warning header

Original commit: elastic/x-pack-elasticsearch@598a191784
2017-05-11 12:26:31 -06:00
Lisa Cawley 711ee1e8d4 [DOCS] Add FAQ for ML rolling upgrade issue (elastic/x-pack-elasticsearch#1390)
* [DOCS] Add FAQ for ML rolling upgrade issue

* [DOCS] More info for ML rolling upgrade issue

Original commit: elastic/x-pack-elasticsearch@be195477b0
2017-05-11 09:24:59 -07:00
Lisa Cawley 4e321cc409 [DOCS] Add ML high_median and low_median functions (elastic/x-pack-elasticsearch#1370)
Original commit: elastic/x-pack-elasticsearch@561f233f20
2017-05-10 08:46:14 -07:00
Lisa Cawley 2d8eb8fbf7 [DOCS] Add ML metric functions (elastic/x-pack-elasticsearch#1349)
* [DOCS] Add ML metric functions

* [DOCS] Remove beta note from ML metrics function

Original commit: elastic/x-pack-elasticsearch@0bd2e359ac
2017-05-09 08:58:42 -07:00
Lisa Cawley b415d7b17e [DOCS] Add ML time functions (elastic/x-pack-elasticsearch#1355)
Original commit: elastic/x-pack-elasticsearch@fead652966
2017-05-09 08:23:08 -07:00
Lisa Cawley 0f3f22deb2 [DOCS] Add ML info_content functions (elastic/x-pack-elasticsearch#1354)
Original commit: elastic/x-pack-elasticsearch@5cfa9618b5
2017-05-09 08:12:59 -07:00
Lisa Cawley 0c4a7e1930 [DOCS] More minor fixes (elastic/x-pack-elasticsearch#1343)
Original commit: elastic/x-pack-elasticsearch@351e4ea643
2017-05-08 07:12:03 -07:00
Lisa Cawley 0542d730c9 [DOCS] Fix minor ML documentation problems (elastic/x-pack-elasticsearch#1336)
Original commit: elastic/x-pack-elasticsearch@53e65b90fc
2017-05-08 06:53:04 -07:00
Lisa Cawley 30c616a232 [DOCS] More fixes for build.gradle errors (elastic/x-pack-elasticsearch#1334)
Original commit: elastic/x-pack-elasticsearch@578f727494
2017-05-05 11:57:20 -07:00
Lisa Cawley 45cfc17ea1 [DOCS] Add ML analytical functions (elastic/x-pack-elasticsearch#1319)
* [DOCS] Add ML analytical functions

* [DOCS] Add pages for ML analytical functions

* [DOCS] Add links to ML functions from API definitions

Original commit: elastic/x-pack-elasticsearch@ae50b431d3
2017-05-05 10:41:53 -07:00
Dimitris Athanasiou 7f2c7dbe17 [ML] Rename datafeed indexes to indices (elastic/x-pack-elasticsearch#1297)
Renames datafeed indexes to indices but keeps indexes
as a synonym while parsing.

relates elastic/x-pack-elasticsearch#1292

Original commit: elastic/x-pack-elasticsearch@1fcdd97f88
2017-05-04 11:37:12 +01:00
Alexander Reelsen 4078b2f1b2 Watcher: Replace _status field with status (elastic/x-pack-elasticsearch#1285)
As fields with underscores will be disallowed in master, and we have to
prepare the upgrade, this commit renames the _status field to status.

When the 5.x upgrade logic is in place in the 5.x we can remove all the
old style _status handling from the master branch.

Note: All the BWC compatibility tests, that load 5.x indices are now
faking a finished upgrade by adding the `status` field to the mapping
of the watches index.

Original commit: elastic/x-pack-elasticsearch@9d5cc9aaec
2017-05-04 10:08:34 +02:00
Lisa Cawley cf27cb479a [DOCS] Clarify wildcard usage in ML datafeed APIs (elastic/x-pack-elasticsearch#1296)
Original commit: elastic/x-pack-elasticsearch@c18fca323b
2017-05-03 09:07:44 -07:00
Dimitris Athanasiou eae7d19d2f [DOCS] Improvements on datafeed related docs (elastic/x-pack-elasticsearch#1293)
Original commit: elastic/x-pack-elasticsearch@4bb1932f0e
2017-05-03 08:38:31 -07:00
Dimitris Athanasiou 3e9c36838d [ML] Remove get model snapshot by description functionality (elastic/x-pack-elasticsearch#1288)
relates elastic/x-pack-elasticsearch#1284

Original commit: elastic/x-pack-elasticsearch@780feea5c1
2017-05-03 13:20:52 +01:00
Chee Wee 1e0caee90d Corrected a mistake on disabling a user (elastic/x-pack-elasticsearch#1135)
Corrected a mistake on disabling a user, when it should be enabling.

Please review the changes.

Original commit: elastic/x-pack-elasticsearch@352997e427
2017-05-03 10:55:26 +08:00
Lisa Cawley 33c50f1201 [DOCS] Add property table for ML Update Jobs API (elastic/x-pack-elasticsearch#1268)
* [DOCS] Add property table for ML Update Jobs API

* [DOCS] Updates based on feedback for ML Update Jobs API

* [DOCS] Removed detector properties from ML Update Jobs API

* [DOCS] Fixes typos

Original commit: elastic/x-pack-elasticsearch@68d1b5598c
2017-05-02 15:38:41 -07:00
Lisa Cawley 9b2fb6ac16 [DOCS] Change "data feed" to "datafeed" in Machine Learning documentation (elastic/x-pack-elasticsearch#1277)
* [DOCS] Add xpackml attribute to XPack Reference

* [DOCS] Use attribute for datafeed terms

Original commit: elastic/x-pack-elasticsearch@f37bf48ee4
2017-05-02 12:45:42 -07:00
Alexander Reelsen c62f6f8177 Watcher: Distributed watch execution (elastic/x-pack-elasticsearch#544)
The distribution of watches now happens on the node which holds the
watches index, instead of on the master node. This requires several
changes to the current implementation.

1. Running on shards and replicas
   In order to run watches on the nodes with the watches index on its
   primaries and replicas. To ensure that watches do not run twice, there is
   a logic which checks the local shards, runs a murmurhash on the id and
   runs modulo against the number of shards and replicas, this is the way to
   find out, if a watch should run local. Reloading happens
2. Several master node actions moved to a HandledTransportAction, as they
   are basically just aliases for indexing actions, among them the
   put/delete/get watch actions, the acknowledgement action, the de/activate
   actions
3. Stats action moved to a broadcast node action, because we potentially
   have to query every node to get watcher statistics
4. Starting/Stopping watcher now is a master node action, which updates
   the cluster state and then listeners acts on those. Because of this watches
   can be running on two systems, if you those have different cluster state
   versions, until the new watcher state is propagated
5. Watcher is started on all nodes now. With the exception of the ticker
   schedule engine most classes do not need a lot of resources while running.
   However they have to run, because of the execute watch API, which can hit
   any node - it does not make sense to find the right shard for this watch
   and only then execute (as this also has to work with a watch, that has not
   been stored before)
6. By using a indexing operation listener, each storing of a watch now
   parses the watch first and only stores on successful parsing
7. Execute watch API now uses the watcher threadpool for execution
8. Getting the number of watches for the stats now simply queries the
   different execution engines, how many watches are scheduled, so this is
   not doing a search anymore

There will be follow up commits on this one, mainly to ensure BWC compatibility.

Original commit: elastic/x-pack-elasticsearch@0adb46e658
2017-05-02 10:12:46 +02:00
debadair dae762913d [DOCS] Added xpack.monitoring.ui.enabled to monitoring settings.
Original commit: elastic/x-pack-elasticsearch@3dd136ed57
2017-05-01 17:18:51 -07:00
Lisa Cawley a615532866 [DOCS] ML 5.4 docs final tuning (elastic/x-pack-elasticsearch#1265)
Original commit: elastic/x-pack-elasticsearch@91e4af140d
2017-05-01 11:30:19 -07:00
Lisa Cawley 600aa8fc5d [DOCS] Add role=screenshot to format graphics (elastic/x-pack-elasticsearch#1259)
* [DOCS] Added role attribute to ML screenshots

* [DOCS] Fixing screenshot role in ML tutorial

Original commit: elastic/x-pack-elasticsearch@232a0632a0
2017-04-28 21:27:04 -07:00
Lisa Cawley d77f20b14e [DOCS] Update ML tutorial with latest sample data (elastic/x-pack-elasticsearch#1258)
* [DOCS] Updated mappings in ML sample data

* [DOCS] Update ML tutorial with latest sample data

Original commit: elastic/x-pack-elasticsearch@37fd75aed5
2017-04-28 12:31:24 -07:00
Lisa Cawley c4be95ae31 [DOCS] Remove unnecessary ML release notes file (elastic/x-pack-elasticsearch#1257)
Original commit: elastic/x-pack-elasticsearch@e3d2c66090
2017-04-28 11:48:08 -07:00
Lisa Cawley 4669a823cc [DOCS] Added ML sample data URLs (elastic/x-pack-elasticsearch#1256)
Original commit: elastic/x-pack-elasticsearch@528a32f26f
2017-04-28 10:28:37 -07:00
Lisa Cawley 435338e6b9 [DOCS] Fix ML API example for elastic/x-pack-elasticsearch#1180 (elastic/x-pack-elasticsearch#1252)
Original commit: elastic/x-pack-elasticsearch@5290dd0a89
2017-04-28 09:14:53 -07:00
Lisa Cawley 68c3a94c35 [DOCS] Add ML limitations (elastic/x-pack-elasticsearch#1229)
* [DOCS] Add ML limitations

* [DOCS] Address feedback about ML limitations

* [DOCS] Change ML limitations capitalization

Original commit: elastic/x-pack-elasticsearch@41682d8d93
2017-04-28 08:13:47 -07:00
Clinton Gormley e61224778f Fixed bad link
Original commit: elastic/x-pack-elasticsearch@f7ab965eba
2017-04-28 12:35:07 +02:00