2017-06-19 21:23:58 -04:00
|
|
|
[role="xpack"]
|
2018-08-31 19:49:24 -04:00
|
|
|
[testenv="platinum"]
|
2017-04-04 18:26:39 -04:00
|
|
|
[[ml-put-job]]
|
2019-07-08 14:43:18 -04:00
|
|
|
=== Create {anomaly-jobs} API
|
2017-12-14 13:52:49 -05:00
|
|
|
++++
|
2019-07-25 11:58:16 -04:00
|
|
|
<titleabbrev>Create jobs</titleabbrev>
|
2017-12-14 13:52:49 -05:00
|
|
|
++++
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-07-08 14:43:18 -04:00
|
|
|
Instantiates an {anomaly-job}.
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-06-27 12:42:47 -04:00
|
|
|
[[ml-put-job-request]]
|
|
|
|
==== {api-request-title}
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2018-12-07 15:34:11 -05:00
|
|
|
`PUT _ml/anomaly_detectors/<job_id>`
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-06-27 16:58:42 -04:00
|
|
|
[[ml-put-job-prereqs]]
|
|
|
|
==== {api-prereq-title}
|
|
|
|
|
|
|
|
* If the {es} {security-features} are enabled, you must have `manage_ml` or
|
|
|
|
`manage` cluster privileges to use this API. See
|
|
|
|
{stack-ov}/security-privileges.html[Security privileges].
|
|
|
|
|
2019-06-27 12:42:47 -04:00
|
|
|
[[ml-put-job-desc]]
|
|
|
|
==== {api-description-title}
|
2019-02-08 06:35:37 -05:00
|
|
|
|
2019-07-08 14:43:18 -04:00
|
|
|
IMPORTANT: You must use {kib} or this API to create an {anomaly-job}. Do not put
|
|
|
|
a job directly to the `.ml-config` index using the {es} index API. If {es}
|
|
|
|
{security-features} are enabled, do not give users `write` privileges on the
|
|
|
|
`.ml-config` index.
|
2019-02-08 06:35:37 -05:00
|
|
|
|
2019-06-27 12:42:47 -04:00
|
|
|
[[ml-put-job-path-parms]]
|
|
|
|
==== {api-path-parms-title}
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-07-12 11:26:31 -04:00
|
|
|
`<job_id>`::
|
|
|
|
(Required, string) Identifier for the job. This identifier can contain
|
|
|
|
lowercase alphanumeric characters (a-z and 0-9), hyphens, and underscores. It
|
|
|
|
must start and end with alphanumeric characters.
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-06-27 12:42:47 -04:00
|
|
|
[[ml-put-job-request-body]]
|
|
|
|
==== {api-request-body-title}
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-07-12 11:26:31 -04:00
|
|
|
`analysis_config`::
|
|
|
|
(Required, object) The analysis configuration, which specifies how to analyze
|
|
|
|
the data. See <<ml-analysisconfig, analysis configuration objects>>.
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-07-12 11:26:31 -04:00
|
|
|
`analysis_limits`::
|
|
|
|
(Optional, object) Specifies runtime limits for the job. See
|
2017-08-17 15:52:29 -04:00
|
|
|
<<ml-apilimits,analysis limits>>.
|
2017-04-11 21:52:47 -04:00
|
|
|
|
2019-07-12 11:26:31 -04:00
|
|
|
`background_persist_interval`::
|
2019-08-08 07:43:55 -04:00
|
|
|
(Optional, <<time-units, time units>>) Advanced configuration option. The time
|
|
|
|
between each periodic persistence of the model. See <<ml-job-resource>>.
|
2019-07-12 11:26:31 -04:00
|
|
|
|
|
|
|
`custom_settings`::
|
|
|
|
(Optional, object) Advanced configuration option. Contains custom meta data
|
|
|
|
about the job. See <<ml-job-resource>>.
|
|
|
|
|
|
|
|
`data_description`::
|
|
|
|
(Required, object) Describes the format of the input data. This object is
|
|
|
|
required, but it can be empty (`{}`). See
|
|
|
|
<<ml-datadescription,data description objects>>.
|
|
|
|
|
|
|
|
`description`::
|
|
|
|
(Optional, string) A description of the job.
|
|
|
|
|
|
|
|
`groups`::
|
|
|
|
(Optional, array of strings) A list of job groups. See <<ml-job-resource>>.
|
|
|
|
|
|
|
|
`model_plot_config`::
|
|
|
|
(Optional, object) Advanced configuration option. Specifies to store model
|
|
|
|
information along with the results. This adds overhead to the performance of
|
|
|
|
the system and is not feasible for jobs with many entities, see
|
|
|
|
<<ml-apimodelplotconfig>>.
|
|
|
|
|
|
|
|
`model_snapshot_retention_days`::
|
|
|
|
(Optional, long) The time in days that model snapshots are retained for the
|
|
|
|
job. Older snapshots are deleted. The default value is `1`, which means
|
|
|
|
snapshots are retained for one day (twenty-four hours).
|
|
|
|
|
|
|
|
`renormalization_window_days`::
|
|
|
|
(Optional, long) Advanced configuration option. The period over which
|
|
|
|
adjustments to the score are applied, as new data is seen. See
|
|
|
|
<<ml-job-resource>>.
|
|
|
|
|
|
|
|
`results_index_name`::
|
|
|
|
(Optional, string) A text string that affects the name of the {ml} results
|
|
|
|
index. The default value is `shared`, which generates an index named
|
|
|
|
`.ml-anomalies-shared`.
|
|
|
|
|
|
|
|
`results_retention_days`::
|
|
|
|
(Optional, long) Advanced configuration option. The number of days for which
|
|
|
|
job results are retained. See <<ml-job-resource>>.
|
2017-04-25 17:08:29 -04:00
|
|
|
|
2019-06-27 12:42:47 -04:00
|
|
|
[[ml-put-job-example]]
|
|
|
|
==== {api-examples-title}
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2018-02-09 12:16:24 -05:00
|
|
|
The following example creates the `total-requests` job:
|
2017-04-04 18:26:39 -04:00
|
|
|
|
2019-09-06 11:31:13 -04:00
|
|
|
[source,console]
|
2017-04-04 18:26:39 -04:00
|
|
|
--------------------------------------------------
|
2018-12-07 15:34:11 -05:00
|
|
|
PUT _ml/anomaly_detectors/total-requests
|
2017-04-04 18:26:39 -04:00
|
|
|
{
|
2018-02-09 12:16:24 -05:00
|
|
|
"description" : "Total sum of requests",
|
|
|
|
"analysis_config" : {
|
|
|
|
"bucket_span":"10m",
|
|
|
|
"detectors": [
|
|
|
|
{
|
|
|
|
"detector_description": "Sum of total",
|
|
|
|
"function": "sum",
|
|
|
|
"field_name": "total"
|
|
|
|
}
|
|
|
|
]
|
|
|
|
},
|
|
|
|
"data_description" : {
|
|
|
|
"time_field":"timestamp",
|
|
|
|
"time_format": "epoch_ms"
|
|
|
|
}
|
2017-04-04 18:26:39 -04:00
|
|
|
}
|
|
|
|
--------------------------------------------------
|
|
|
|
|
|
|
|
When the job is created, you receive the following results:
|
2017-04-21 11:23:27 -04:00
|
|
|
[source,js]
|
2017-04-04 18:26:39 -04:00
|
|
|
----
|
|
|
|
{
|
2019-07-08 14:43:18 -04:00
|
|
|
"job_id" : "total-requests",
|
|
|
|
"job_type" : "anomaly_detector",
|
|
|
|
"job_version" : "7.4.0",
|
|
|
|
"description" : "Total sum of requests",
|
|
|
|
"create_time" : 1562352500629,
|
|
|
|
"analysis_config" : {
|
|
|
|
"bucket_span" : "10m",
|
|
|
|
"detectors" : [
|
2017-04-04 18:26:39 -04:00
|
|
|
{
|
2019-07-08 14:43:18 -04:00
|
|
|
"detector_description" : "Sum of total",
|
|
|
|
"function" : "sum",
|
|
|
|
"field_name" : "total",
|
|
|
|
"detector_index" : 0
|
2017-04-04 18:26:39 -04:00
|
|
|
}
|
|
|
|
],
|
2019-07-08 14:43:18 -04:00
|
|
|
"influencers" : [ ]
|
2017-04-04 18:26:39 -04:00
|
|
|
},
|
2019-07-08 14:43:18 -04:00
|
|
|
"analysis_limits" : {
|
|
|
|
"model_memory_limit" : "1024mb",
|
|
|
|
"categorization_examples_limit" : 4
|
2017-08-18 14:29:08 -04:00
|
|
|
},
|
2019-07-08 14:43:18 -04:00
|
|
|
"data_description" : {
|
|
|
|
"time_field" : "timestamp",
|
|
|
|
"time_format" : "epoch_ms"
|
2017-04-04 18:26:39 -04:00
|
|
|
},
|
2019-07-08 14:43:18 -04:00
|
|
|
"model_snapshot_retention_days" : 1,
|
|
|
|
"results_index_name" : "shared"
|
2017-04-04 18:26:39 -04:00
|
|
|
}
|
|
|
|
----
|
2019-07-08 14:43:18 -04:00
|
|
|
// TESTRESPONSE[s/"job_version" : "7.4.0"/"job_version" : $body.job_version/]
|
|
|
|
// TESTRESPONSE[s/1562352500629/$body.$_path/]
|