OpenSearch/docs/reference/ingest.asciidoc

43 lines
1.5 KiB
Plaintext
Raw Normal View History

2016-02-11 17:16:56 -05:00
[[ingest]]
= Ingest node
2016-02-11 17:16:56 -05:00
[partintro]
--
Use an ingest node to pre-process documents before the actual document indexing happens.
The ingest node intercepts bulk and index requests, it applies transformations, and it then
passes the documents back to the index or bulk APIs.
2016-02-11 17:16:56 -05:00
All nodes enable ingest by default, so any node can handle ingest tasks. You can also create
dedicated ingest nodes. To disable ingest for a node, configure the following setting in the
elasticsearch.yml file:
2016-02-11 17:16:56 -05:00
[source,yaml]
--------------------------------------------------
node.ingest: false
--------------------------------------------------
To pre-process documents before indexing, <<pipeline,define a pipeline>> that specifies a series of
<<ingest-processors,processors>>. Each processor transforms the document in some specific way. For example, a
pipeline might have one processor that removes a field from the document, followed by
another processor that renames a field. The <<cluster-state,cluster state>> then stores
the configured pipelines.
2016-02-11 17:16:56 -05:00
To use a pipeline, simply specify the `pipeline` parameter on an index or bulk request. This
way, the ingest node knows which pipeline to use. For example:
2016-02-11 17:16:56 -05:00
[source,js]
--------------------------------------------------
PUT my-index/_doc/my-id?pipeline=my_pipeline_id
2016-02-11 17:16:56 -05:00
{
"foo": "bar"
2016-02-11 17:16:56 -05:00
}
--------------------------------------------------
// CONSOLE
// TEST[catch:bad_request]
2016-02-11 17:16:56 -05:00
See <<ingest-apis,Ingest APIs>> for more information about creating, adding, and deleting pipelines.
2016-03-04 01:00:07 -05:00
2016-02-11 17:16:56 -05:00
--
include::ingest/ingest-node.asciidoc[]