OpenSearch/docs/reference/indices/create-data-stream.asciidoc

88 lines
2.7 KiB
Plaintext
Raw Normal View History

2020-05-15 10:37:45 -04:00
[[indices-create-data-stream]]
=== Create data stream API
++++
<titleabbrev>Create data stream</titleabbrev>
++++
Creates a new data stream.
Data streams provide a convenient way to ingest, search, and manage time series
data. Documents containing time series data may be indexed directly into a data
stream and searched through the data stream. Behind the scenes, data streams
contain one or more hidden backing indices and a generation attribute that
indicates which of the backing indices is the write index, the index into which
documents will be ingested.
Backing indices are generated with the naming convention
`<data-stream-name>-zzzzzz` where `zzzzzz` is the six-digit, zero-padded
generation of the data stream. For example, a data stream named
`web-server-logs` with a generation of 34 would have a write index named
`web-server-logs-000034`. While nothing prevents backing indices from being
addressed directly, data streams are integrated with the
<<indices-rollover-index, rollover index API>> and
<<index-lifecycle-management, index lifecycle management (ILM)>> to facilitate
the management of the time series data contained in their backing indices.
A data stream can only be created if the namespace it targets has a component
template exists with a `data_stream` definition.
2020-05-15 10:37:45 -04:00
[source,console]
-----------------------------------
PUT _index_template/template
2020-05-15 10:37:45 -04:00
{
"index_patterns": ["my-data-stream*"],
"data_stream": {
"timestamp_field": "@timestamp"
}
2020-05-15 10:37:45 -04:00
}
-----------------------------------
// TEST
[source,console]
--------------------------------------------------
PUT _data_stream/my-data-stream
2020-05-15 10:37:45 -04:00
--------------------------------------------------
// TEST[continued]
2020-05-15 10:37:45 -04:00
////
[source,console]
-----------------------------------
DELETE /_data_stream/my-data-stream
DELETE /_index_template/template
2020-05-15 10:37:45 -04:00
-----------------------------------
// TEST[continued]
////
[[indices-create-data-stream-request]]
==== {api-request-title}
`PUT _data_stream/<data-stream>`
[[indices-create-data-stream-desc]]
==== {api-description-title}
You can use the create data stream API to add a new data stream to an {es}
cluster. When creating a data stream, you must specify the following:
* The name of the data stream
* The name of the timestamp field.
[[indices-create-data-stream-api-path-params]]
==== {api-path-parms-title}
`<data-stream>`::
+
--
(Required, string) Name of the data stream to create.
Data stream names must meet the following criteria:
- Lowercase only
- Cannot include `\`, `/`, `*`, `?`, `"`, `<`, `>`, `|`, ` ` (space character),
`,`, `#`, `:`
- Cannot start with `-`, `_`, `+`, `.`
- Cannot be `.` or `..`
- Cannot be longer than 255 bytes (note it is bytes, so multi-byte characters
will count towards the 255 limit faster)
--