2019-08-07 11:37:35 -04:00
|
|
|
|
[role="xpack"]
|
|
|
|
|
[testenv="basic"]
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform]]
|
2019-12-17 12:01:31 -05:00
|
|
|
|
=== Update {transform} API
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
|
|
|
|
[subs="attributes"]
|
|
|
|
|
++++
|
2019-12-17 12:01:31 -05:00
|
|
|
|
<titleabbrev>Update {transform}</titleabbrev>
|
2019-08-07 11:37:35 -04:00
|
|
|
|
++++
|
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
Updates certain properties of a {transform}.
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform-request]]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
==== {api-request-title}
|
|
|
|
|
|
2019-10-08 02:59:01 -04:00
|
|
|
|
`POST _transform/<transform_id>/_update`
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform-prereqs]]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
==== {api-prereq-title}
|
|
|
|
|
|
2019-10-17 04:22:38 -04:00
|
|
|
|
* If the {es} {security-features} are enabled, you must have `manage_transform`
|
|
|
|
|
cluster privileges to use this API. The built-in `transform_admin` role has
|
|
|
|
|
these privileges. You must also have `read` and `view_index_metadata`
|
|
|
|
|
privileges on the source index and `read`, `create_index`, and `index`
|
|
|
|
|
privileges on the destination index. For more information, see
|
|
|
|
|
<<security-privileges>> and <<built-in-roles>>.
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform-desc]]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
==== {api-description-title}
|
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
This API updates an existing {transform}. The list of properties that you can
|
|
|
|
|
update is a subset of the list that you can define when you create a {transform}.
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
When the {transform} is updated, a series of validations occur to ensure its
|
|
|
|
|
success. You can use the `defer_validation` parameter to skip these checks.
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
All updated properties except description do not take effect until after the
|
|
|
|
|
{transform} starts the next checkpoint. This is so there is consistency with the
|
|
|
|
|
pivoted data in each checkpoint.
|
|
|
|
|
|
|
|
|
|
[IMPORTANT]
|
|
|
|
|
====
|
|
|
|
|
|
|
|
|
|
* When {es} {security-features} are enabled, your {transform} remembers which
|
|
|
|
|
roles the user who updated it had at the time of update and runs with those
|
|
|
|
|
privileges.
|
|
|
|
|
* You must use {kib} or this API to update a {transform}. Do not update a
|
|
|
|
|
{transform} directly via `.transform-internal*` indices using the {es} index API.
|
|
|
|
|
If {es} {security-features} are enabled, do not give users any privileges on
|
|
|
|
|
`.transform-internal*` indices. If you used {transforms} prior 7.5, also do not
|
|
|
|
|
give users any privileges on `.data-frame-internal*` indices.
|
|
|
|
|
|
|
|
|
|
====
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform-path-parms]]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
==== {api-path-parms-title}
|
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
`<transform_id>`::
|
2019-12-17 12:01:31 -05:00
|
|
|
|
(Required, string)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=transform-id]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform-query-parms]]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
==== {api-query-parms-title}
|
|
|
|
|
|
|
|
|
|
`defer_validation`::
|
|
|
|
|
(Optional, boolean) When `true`, deferrable validations are not run. This
|
|
|
|
|
behavior may be desired if the source index does not exist until after the
|
2019-09-16 11:28:19 -04:00
|
|
|
|
{transform} is updated.
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform-request-body]]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
==== {api-request-body-title}
|
|
|
|
|
|
|
|
|
|
`description`::
|
2019-09-16 11:28:19 -04:00
|
|
|
|
(Optional, string) Free text description of the {transform}.
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
|
|
|
|
`dest`::
|
2019-12-17 12:01:31 -05:00
|
|
|
|
(Optional, object)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=dest]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
`dest`.`index`:::
|
|
|
|
|
(Required, string)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=dest-index]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
`dest`.`pipeline`:::
|
|
|
|
|
(Optional, string)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=dest-pipeline]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
|
|
|
|
`frequency`::
|
2019-12-17 12:01:31 -05:00
|
|
|
|
(Optional, <<time-units, time units>>)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=frequency]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
|
|
|
|
`source`::
|
2019-12-17 12:01:31 -05:00
|
|
|
|
(Optional, object)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=source-transforms]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
`source`.`index`:::
|
|
|
|
|
(Required, string or array)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=source-index-transforms]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
2019-12-17 12:01:31 -05:00
|
|
|
|
`source`.`query`:::
|
|
|
|
|
(Optional, object)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=source-query-transforms]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
|
|
|
|
|
`sync`::
|
2019-12-17 12:01:31 -05:00
|
|
|
|
(Optional, object)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=sync]
|
|
|
|
|
|
|
|
|
|
`sync`.`time`:::
|
|
|
|
|
(Required, object)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=sync-time]
|
|
|
|
|
|
|
|
|
|
`sync`.`time`.`delay`::::
|
|
|
|
|
(Optional, <<time-units, time units>>)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=sync-time-delay]
|
|
|
|
|
|
|
|
|
|
`sync`.`time`.`field`::::
|
|
|
|
|
(Required, string)
|
|
|
|
|
include::{docdir}/rest-api/common-parms.asciidoc[tag=sync-time-field]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
+
|
|
|
|
|
--
|
|
|
|
|
TIP: In general, it’s a good idea to use a field that contains the
|
|
|
|
|
<<accessing-ingest-metadata,ingest timestamp>>. If you use a different field,
|
|
|
|
|
you might need to set the `delay` such that it accounts for data transmission
|
|
|
|
|
delays.
|
|
|
|
|
|
|
|
|
|
--
|
|
|
|
|
|
2019-09-20 18:57:43 -04:00
|
|
|
|
[[update-transform-example]]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
==== {api-examples-title}
|
|
|
|
|
|
2019-09-09 13:38:14 -04:00
|
|
|
|
[source,console]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
--------------------------------------------------
|
2019-10-08 02:59:01 -04:00
|
|
|
|
POST _transform/simple-kibana-ecomm-pivot/_update
|
2019-08-07 11:37:35 -04:00
|
|
|
|
{
|
|
|
|
|
"source": {
|
|
|
|
|
"index": "kibana_sample_data_ecommerce",
|
|
|
|
|
"query": {
|
|
|
|
|
"term": {
|
|
|
|
|
"geoip.continent_name": {
|
|
|
|
|
"value": "Asia"
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
},
|
|
|
|
|
"description": "Maximum priced ecommerce data by customer_id in Asia",
|
|
|
|
|
"dest": {
|
|
|
|
|
"index": "kibana_sample_data_ecommerce_transform_v2",
|
|
|
|
|
"pipeline": "add_timestamp_pipeline"
|
|
|
|
|
},
|
|
|
|
|
"frequency": "15m",
|
|
|
|
|
"sync": {
|
|
|
|
|
"time": {
|
|
|
|
|
"field": "order_date",
|
|
|
|
|
"delay": "120s"
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
--------------------------------------------------
|
|
|
|
|
// TEST[setup:simple_kibana_continuous_pivot]
|
|
|
|
|
|
2019-09-16 11:28:19 -04:00
|
|
|
|
When the {transform} is updated, you receive the updated configuration:
|
2019-09-06 16:09:09 -04:00
|
|
|
|
|
|
|
|
|
[source,console-result]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
----
|
|
|
|
|
{
|
|
|
|
|
"id": "simple-kibana-ecomm-pivot",
|
|
|
|
|
"source": {
|
|
|
|
|
"index": ["kibana_sample_data_ecommerce"],
|
|
|
|
|
"query": {
|
|
|
|
|
"term": {
|
|
|
|
|
"geoip.continent_name": {
|
|
|
|
|
"value": "Asia"
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
},
|
|
|
|
|
"pivot": {
|
|
|
|
|
"group_by": {
|
|
|
|
|
"customer_id": {
|
|
|
|
|
"terms": {
|
|
|
|
|
"field": "customer_id"
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
},
|
|
|
|
|
"aggregations": {
|
|
|
|
|
"max_price": {
|
|
|
|
|
"max": {
|
|
|
|
|
"field": "taxful_total_price"
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
}
|
|
|
|
|
},
|
|
|
|
|
"description": "Maximum priced ecommerce data by customer_id in Asia",
|
|
|
|
|
"dest": {
|
|
|
|
|
"index": "kibana_sample_data_ecommerce_transform_v2",
|
|
|
|
|
"pipeline": "add_timestamp_pipeline"
|
|
|
|
|
},
|
|
|
|
|
"frequency": "15m",
|
|
|
|
|
"sync": {
|
|
|
|
|
"time": {
|
|
|
|
|
"field": "order_date",
|
|
|
|
|
"delay": "120s"
|
|
|
|
|
}
|
|
|
|
|
},
|
2019-12-17 12:01:31 -05:00
|
|
|
|
"version": "7.5.0",
|
2019-08-07 11:37:35 -04:00
|
|
|
|
"create_time": 1518808660505
|
|
|
|
|
}
|
|
|
|
|
----
|
2019-12-17 12:01:31 -05:00
|
|
|
|
// TESTRESPONSE[s/"version": "7.5.0"/"version": $body.version/]
|
2019-08-07 11:37:35 -04:00
|
|
|
|
// TESTRESPONSE[s/"create_time": 1518808660505/"create_time": $body.create_time/]
|