Merge pull request #133 from opensearch-project/logstash-fixes

minor fixes for Logstash
This commit is contained in:
Ashwin Kumar 2021-08-10 11:25:08 -07:00 committed by GitHub
commit bd944e8448
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 25 additions and 29 deletions

View File

@ -27,14 +27,12 @@ PUT _cluster/settings
} }
``` ```
For a longer term solution, we plan to create an OpenSearch output plugin for Logstash. This plugin *does not exist yet*, but we've included it in the compatibility matrices below based on its expected behavior.
## Downloads ## Downloads
These versions of Logstash and Beats offer the best compatibility with OpenSearch. For more information, see the [compatibility matrices](#compatibility-matrices). You can download the OpenSearch output plugin for Logstash from [OpenSearch downloads](https://opensearch.org/downloads.html). The Logstash output plugin is compatible with OpenSearch and Elasticsearch OSS (7.10.2 or lower).
These versions of Beats offer the best compatibility with OpenSearch. For more information, see the [compatibility matrices](#compatibility-matrices).
- [Logstash OSS 7.12.1](https://www.elastic.co/downloads/past-releases/logstash-oss-7-12-1)
- [Filebeat OSS 7.12.1](https://www.elastic.co/downloads/past-releases/filebeat-oss-7-12-1) - [Filebeat OSS 7.12.1](https://www.elastic.co/downloads/past-releases/filebeat-oss-7-12-1)
- [Metricbeat OSS 7.12.1](https://www.elastic.co/downloads/past-releases/metricbeat-oss-7-12-1) - [Metricbeat OSS 7.12.1](https://www.elastic.co/downloads/past-releases/metricbeat-oss-7-12-1)
- [Packetbeat OSS 7.12.1](https://www.elastic.co/downloads/past-releases/packetbeat-oss-7-12-1) - [Packetbeat OSS 7.12.1](https://www.elastic.co/downloads/past-releases/packetbeat-oss-7-12-1)
@ -50,7 +48,7 @@ These versions of Logstash and Beats offer the best compatibility with OpenSearc
### Compatibility Matrix for Logstash ### Compatibility Matrix for Logstash
| | Logstash OSS 7.x to 7.11.x | Logstash OSS 7.12.x\* | Logstash 7.13.x without OpenSearch output plugin | Logstash 7.13.x with OpenSearch output plugin\*\* | | | Logstash OSS 7.x to 7.11.x | Logstash OSS 7.12.x\* | Logstash 7.13.x without OpenSearch output plugin | Logstash 7.13.x with OpenSearch output plugin |
| :---| :--- | :--- | :--- | :--- | | :---| :--- | :--- | :--- | :--- |
| Elasticsearch OSS v7.x to v7.9.x | *Yes* | *Yes* | *No* | *Yes* | | Elasticsearch OSS v7.x to v7.9.x | *Yes* | *Yes* | *No* | *Yes* |
| Elasticsearch OSS v7.10.2 | *Yes* | *Yes* | *No* | *Yes* | | Elasticsearch OSS v7.10.2 | *Yes* | *Yes* | *No* | *Yes* |
@ -60,8 +58,6 @@ These versions of Logstash and Beats offer the best compatibility with OpenSearc
\* Most current compatible version with Elasticsearch OSS. \* Most current compatible version with Elasticsearch OSS.
\*\* Planning to build.
### Compatibility Matrix for Beats ### Compatibility Matrix for Beats

View File

@ -72,26 +72,26 @@ Make sure you have [Java Development Kit (JDK)](https://www.oracle.com/java/tech
1. Pull the Logstash oss package with the OpenSearch output plugin image: 1. Pull the Logstash oss package with the OpenSearch output plugin image:
``` ```
docker pull opensearchproject/logstash-oss-with-opensearch-output-plugin:7.13.2 docker pull opensearchproject/logstash-oss-with-opensearch-output-plugin:7.13.2
``` ```
1. Create a Docker network: 1. Create a Docker network:
``` ```
docker network create test docker network create test
``` ```
1. Start OpenSearch with this network: 1. Start OpenSearch with this network:
``` ```
docker run -p 9200:9200 -p 9600:9600 --name opensearch --net test -e "discovery.type=single-node" opensearchproject/opensearch:1.0.0 docker run -p 9200:9200 -p 9600:9600 --name opensearch --net test -e "discovery.type=single-node" opensearchproject/opensearch:1.0.0
``` ```
1. Start Logstash: 1. Start Logstash:
``` ```
docker run -it --rm --name logstash --net test openserachproject/logstash-oss-with-opensearch-output-plugin:7.13.2 -e 'input { stdin { } } output { docker run -it --rm --name logstash --net test opensearchproject/logstash-oss-with-opensearch-output-plugin:7.13.2 -e 'input { stdin { } } output {
opensearch { opensearch {
hosts => ["https://opensearch:9200"] hosts => ["https://opensearch:9200"]
index => "opensearch-logstash-docker-%{+YYYY.MM.dd}" index => "opensearch-logstash-docker-%{+YYYY.MM.dd}"
@ -100,8 +100,8 @@ docker run -it --rm --name logstash --net test openserachproject/logstash-oss-wi
ssl => true ssl => true
ssl_certificate_verification => false ssl_certificate_verification => false
} }
}' }'
``` ```
## Process text from the terminal ## Process text from the terminal