diff --git a/docs/trace/data-prepper-reference.md b/docs/trace/data-prepper-reference.md index 59a6dd5c..aff2d29d 100644 --- a/docs/trace/data-prepper-reference.md +++ b/docs/trace/data-prepper-reference.md @@ -1,6 +1,6 @@ --- layout: default -title: Configuration Reference +title: Configuration reference parent: Trace analytics nav_order: 25 --- @@ -90,14 +90,24 @@ Preppers perform some action on your data: filter, transform, enrich, etc. ### otel_trace_raw_prepper -Converts OpenTelemetry data to OpenSearch-compatible JSON documents. No options. +Converts OpenTelemetry data to OpenSearch-compatible JSON documents. + +Option | Required | Description +:--- | :--- | :--- +root_span_flush_delay | No | Integer, representing the time interval in seconds to flush all the root spans in the prepper together with their descendants. Defaults to 30. +trace_flush_interval | No | Integer, representing the time interval in seconds to flush all the descendant spans without any root span. Defaults to 180. ### service_map_stateful -Uses OpenTelemetry data to create a distributed service map for visualization in OpenSearch Dashboards. No options. +Uses OpenTelemetry data to create a distributed service map for visualization in OpenSearch Dashboards. + +Option | Required | Description +:--- | :--- | :--- +window_duration | No | Integer, representing the fixed time window in seconds to evaluate service-map relationships. Defaults to 180. ### peer_forwarder + Forwards ExportTraceServiceRequests via gRPC to other Data Prepper instances. Required for operating Data Prepper in a clustered deployment. Option | Required | Description @@ -134,12 +144,12 @@ hosts | Yes | List of OpenSearch hosts to write to (e.g. `["https://localhost:92 cert | No | String, path to the security certificate (e.g. `"config/root-ca.pem"`) if the cluster uses the OpenSearch security plugin. username | No | String, username for HTTP basic authentication. password | No | String, password for HTTP basic authentication. -aws_sigv4 | No | Boolean, whether to use IAM signing to connect to an Amazon OpenSearch Service cluster. For your access key, secret key, and optional session token, Data Prepper uses the default credential chain (environment variables, Java system properties, `~/.aws/credential`, etc.). -aws_region | No | String, AWS region for the cluster (e.g. `"us-east-1"`) if you are connecting to Amazon OpenSearch Service. +aws_sigv4 | No | Boolean, whether to use IAM signing to connect to an Amazon ES cluster. For your access key, secret key, and optional session token, Data Prepper uses the default credential chain (environment variables, Java system properties, `~/.aws/credential`, etc.). +aws_region | No | String, AWS region for the cluster (e.g. `"us-east-1"`) if you are connecting to Amazon ES. trace_analytics_raw | No | Boolean, default false. Whether to export as trace data to the `otel-v1-apm-span-*` index pattern (alias `otel-v1-apm-span`) for use with the Trace Analytics OpenSearch Dashboards plugin. trace_analytics_service_map | No | Boolean, default false. Whether to export as trace data to the `otel-v1-apm-service-map` index for use with the service map component of the Trace Analytics OpenSearch Dashboards plugin. index | No | String, name of the index to export to. Only required if you don't use the `trace_analytics_raw` or `trace_analytics_service_map` presets. -template_file | No | String, the path to a JSON [index template](https://opensearch.github.io/for-opensearch-docs/docs/opensearch/index-templates/) file (e.g. `/your/local/template-file.json` if you do not use the `trace_analytics_raw` or `trace_analytics_service_map`. See [otel-v1-apm-span-index-template.json](https://github.com/opensearch-project/data-prepper/blob/main/data-prepper-plugins/opensearch/src/main/resources/otel-v1-apm-span-index-template.json) for an example. +template_file | No | String, the path to a JSON [index template](../../opensearch/index-templates/) file (e.g. `/your/local/template-file.json` if you do not use the `trace_analytics_raw` or `trace_analytics_service_map`. See [otel-v1-apm-span-index-template.json](https://github.com/opensearch-project/data-prepper/blob/main/data-prepper-plugins/opensearch/src/main/resources/otel-v1-apm-span-index-template.json) for an example. document_id_field | No | String, the field from the source data to use for the OpenSearch document ID (e.g. `"my-field"`) if you don't use the `trace_analytics_raw` or `trace_analytics_service_map` presets. dlq_file | No | String, the path to your preferred dead letter queue file (e.g. `/your/local/dlq-file`). Data Prepper writes to this file when it fails to index a document on the OpenSearch cluster. bulk_size | No | Integer (long), default 5. The maximum size (in MiB) of bulk requests to the OpenSearch cluster. Values below 0 indicate an unlimited size. If a single document exceeds the maximum bulk request size, Data Prepper sends it individually. diff --git a/version-history.md b/version-history.md index a89d8447..7a10e76d 100644 --- a/version-history.md +++ b/version-history.md @@ -9,7 +9,7 @@ permalink: /version-history/ OpenSearch version | Release highlights | Release date :--- | :--- | :--- | :--- -[1.0.0-beta1](https://github.com/opensearch-project/) | Initial beta release. | 10 May 2021 +[1.0.0-beta1](https://github.com/opensearch-project/) | Initial beta release. | 12 May 2021 For detailed release notes, see these GitHub repositories: