Commit Graph

166 Commits

Author SHA1 Message Date
Naarcha-AWS 15697d9bcf
Fix typo in Data Prepper doc (#1550) 2022-10-13 14:53:45 -05:00
Naarcha-AWS 2492a54d88
Make sure that Main picks up all change from Data Prepper 2.0 branch (#1517)
* Change Data Prepper intro

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add next steps section

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add David's feedback

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix optional tags

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Address small typo

* [Data Prepper 2.0]MAINT: documentation change regarding record type (#1306)

* MAINT: documentation change regarding record type

Signed-off-by: Chen <qchea@amazon.com>

* MAINT: documentation on trace group fields

Signed-off-by: Chen <qchea@amazon.com>

Signed-off-by: Chen <qchea@amazon.com>

* Update docs for Data Prepper 2.0 (#1404)

* Update get-started

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update pipelines.md

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add peer forwarder options to references

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add csv processor options to refereces

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for conditional routing

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for json processor

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Remove docs for peer forwarder plugin

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review feedback - revise sentences, fix inaccurate info and typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add missing options for http source and peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update ssl options on peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* More updates for Data Prepper 2.0 (#1469)

* Update http source and opensearch sink options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update docker run command

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add more missing options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add metadata_root_key for s3 source

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments - tweak sentences and fix typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Fix broken link

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add reworked Getting Started page

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Undo change for getting started

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add edited Data Prepper overview

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add edited Data Prepper file

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Chen <qchea@amazon.com>
Signed-off-by: Hai Yan <oeyh@amazon.com>
Co-authored-by: Qi Chen <qchea@amazon.com>
Co-authored-by: Hai Yan <8153134+oeyh@users.noreply.github.com>
2022-10-11 16:31:41 -05:00
David Venable a1add5db6c
Data Prepper 2.0 documentation (#1510)
* Change Data Prepper intro

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add next steps section

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add David's feedback

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix optional tags

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Address small typo

* [Data Prepper 2.0]MAINT: documentation change regarding record type (#1306)

* MAINT: documentation change regarding record type

Signed-off-by: Chen <qchea@amazon.com>

* MAINT: documentation on trace group fields

Signed-off-by: Chen <qchea@amazon.com>

Signed-off-by: Chen <qchea@amazon.com>

* Update docs for Data Prepper 2.0 (#1404)

* Update get-started

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update pipelines.md

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add peer forwarder options to references

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add csv processor options to refereces

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for conditional routing

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for json processor

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Remove docs for peer forwarder plugin

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review feedback - revise sentences, fix inaccurate info and typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add missing options for http source and peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update ssl options on peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* More updates for Data Prepper 2.0 (#1469)

* Update http source and opensearch sink options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update docker run command

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add more missing options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add metadata_root_key for s3 source

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments - tweak sentences and fix typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Fix broken link

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Chen <qchea@amazon.com>
Signed-off-by: Hai Yan <oeyh@amazon.com>
Co-authored-by: Naarcha-AWS <naarcha@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Qi Chen <qchea@amazon.com>
Co-authored-by: Hai Yan <8153134+oeyh@users.noreply.github.com>
2022-10-11 11:36:37 -05:00
kolchfa-aws 89f966a0f1
Refactors JS client helper documentation (#1358)
* Fix Circuit Breaker section in JS client docs

Fix #823

Signed-off-by: Robert Da Silva <mail@robdasilva.com>

* Add documentation for JS client bulk helper

Signed-off-by: Robert Da Silva <mail@robdasilva.com>

* Refactors js client helper documentation

* Incorporated tech review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Incorporated doc review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Update _clients/javascript/helpers.md

Co-authored-by: Alice Williams <88908598+alicejw-aws@users.noreply.github.com>

* Update _clients/javascript/helpers.md

Co-authored-by: Alice Williams <88908598+alicejw-aws@users.noreply.github.com>

* Update helpers.md

* Incorporated tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

Signed-off-by: Robert Da Silva <mail@robdasilva.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: Robert Da Silva <mail@robdasilva.com>
Co-authored-by: Alice Williams <88908598+alicejw-aws@users.noreply.github.com>
2022-10-11 12:08:28 -04:00
Jeff Huss 6583bfeeff
Fixes broken links in docs page main branch (#1501)
* Fixed broken link in RPM guide

Signed-off-by: JeffH-AWS <jeffhuss@amazon.com>

* More fixes

Signed-off-by: JeffH-AWS <jeffhuss@amazon.com>

* All done

Signed-off-by: JeffH-AWS <jeffhuss@amazon.com>

Signed-off-by: JeffH-AWS <jeffhuss@amazon.com>
2022-10-10 09:11:08 -07:00
Deep Datta e338f77cce
Documentation for new parameters in logstash-output-opensearch 2.0.0 (#1263)
* Add documentation for 3 new parameters added in logstash-output-opensearch 2.0.0

Signed-off-by: Deep Datta <deedatta@amazon.com>

* Update _clients/logstash/ship-to-opensearch.md

Signed-off-by: Deep Datta <deedatta@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Fix typo

Signed-off-by: Deep Datta <deedatta@amazon.com>

Signed-off-by: Deep Datta <deedatta@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2022-09-27 13:25:15 -05:00
Naarcha-AWS a6e47e02f5
Add the Kubernetes Operator install instructions (#1017)
* Add the Kubernetes Operator install instructions

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Copy edits

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add doc review

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add editorial

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-09-21 12:10:05 -07:00
Hai Yan 594715c04c
Rename prepper to processor in yaml sample (#1056)
Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>
2022-09-14 15:54:16 -05:00
David Venable e08b786d52
Fixes the metrics-pipeline to use otel_metrics_source which is the correct source plugin here. (#1155)
Signed-off-by: David Venable <dlv@amazon.com>

Signed-off-by: David Venable <dlv@amazon.com>
2022-09-10 10:32:07 -05:00
kolchfa-aws 60a3722042
Adds Ruby client documentation (#1018)
* Adds Ruby client documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Incorporates doc review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Incorporated editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2022-09-08 09:38:26 -04:00
kolchfa-aws 441df4c216
Adds bulk operations to Go client. Refactors Go client. (#1038)
* Adds bulk operations to Go client. Refactors Go client.

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Incorporated editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2022-09-06 10:58:15 -04:00
Hai Yan 2dcdf12bd7
Replace deprecated opensearch sink configuration fields in examples (#1029)
Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>
2022-08-30 13:06:45 -05:00
David Venable 56b650e3a0
Use "processor" instead of "prepper" for Data Prepper, which is the correct terminology now. (#889)
Signed-off-by: David Venable <dlv@amazon.com>

Signed-off-by: David Venable <dlv@amazon.com>
2022-08-16 11:54:22 -05:00
kolchfa-aws 6d6c6ae2ce
Fixed typo (#883)
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2022-08-12 12:19:33 -04:00
kolchfa-aws d8b383b53e
Added .net clients (#833)
* Added .net clients

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Changed OSC to OpenSearch.Client, updated links

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Incorporated tech review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Formatting and typo fix

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented docs review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2022-08-11 16:07:19 -04:00
Jeff Huss 7a4fb5a4da
Added reference to OS 2.x and fixed version ranges in the existing tables (#784)
* Added reference to OS 2.x and fixed version ranges in the existing tables

Signed-off-by: jeffhuss <jeffhuss@amazon.com>

* Adjusted formatting for Beats compatibility guidance and fixed a typo

Signed-off-by: jeffhuss <jeffhuss@amazon.com>
2022-07-08 09:30:46 -07:00
Jeff Huss ff4a818965
Reverted the changes from PR #558 (#747)
Signed-off-by: jeffhuss <jeffhuss@amazon.com>
2022-07-01 10:24:39 -07:00
Keith Chan 407658e942
Fixed hyperlinks in Data Prepper reference (#717)
* Changed headings back to sentence

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

* Minor tweak

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

* Forgot to fix hyperlinks

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

Co-authored-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-06-24 11:24:00 -07:00
Keith Chan 4ec55fef3f
Changed headings back to sentence (#715)
* Changed headings back to sentence

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

* Minor tweak

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

Co-authored-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-06-24 11:20:30 -05:00
David Venable ab020c308d
Data Prepper 1.5.0 documentation (#701)
* Added documentation for Data Prepper 1.5.0.

Signed-off-by: David Venable <dlv@amazon.com>

* Responding to PR feedback for the Data Prepper documentation.

Signed-off-by: David Venable <dlv@amazon.com>

* Responding to additional PR feedback for the Data Prepper documentation.

Signed-off-by: David Venable <dlv@amazon.com>

* Added links to S3 and SQS

Signed-off-by: David Venable <dlv@amazon.com>
2022-06-23 19:01:09 -07:00
Naarcha-AWS 1067dad114
Correct branch names for security and logstash repos (#702)
* Add back Data Prepper 1.4 docs (#698)

* Add back Data Prepper 1.4 docs

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix Data Prepper Docker image

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Update GitHub links to `main` branches rather than `master` where it has been changed

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

Co-authored-by: Aaron Carson <aaron@aaroncarson.co.uk>
2022-06-23 10:14:39 -05:00
Naarcha-AWS 89fc690cf7
Add back Data Prepper 1.4 docs (#698)
* Add back Data Prepper 1.4 docs

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix Data Prepper Docker image

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-06-22 14:10:40 -05:00
jzonthemtn faae3208f0 #682: Fixing docker image name.
Signed-off-by: jzonthemtn <jeff.zemerick@mtnfog.com>
2022-06-16 15:15:34 -04:00
Vacha Shah 251c9cfffd Update the Java client version
Signed-off-by: Vacha Shah <vachshah@amazon.com>
2022-06-08 10:55:49 -07:00
Naarcha-AWS ed48f70dfb Add editorial review
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-05-26 13:40:33 -05:00
Naarcha-AWS 42e18c6997 Add review feedback
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-05-26 12:05:46 -05:00
Naarcha-AWS 9ef6de5c71 Fix typo
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-05-26 11:19:31 -05:00
Naarcha-AWS 59415dbd8d Add Circuit Breaker to JS options
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-05-26 11:15:35 -05:00
alicejw 90a5a61452 for editor's feedback updates
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-23 11:52:14 -07:00
alicejw bd5e27ab68 for small fix to move note syntax into commented-out section
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-17 17:36:29 -07:00
alicejw 997bd489d2 for requester's PR review and updates for accuracy
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-17 17:30:46 -07:00
alicejw 7dbe65fd18 for clarity about setting deprecated in 1.x and removed in 2.0.
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-16 11:16:16 -07:00
alicejw da027fb960 for issue 517 override setting not supported for legacy clients in OpenSearch version 2.0
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-16 10:27:41 -07:00
alicejw 776c6fe1d3 update note for 2.0 incompatible with legacy clients
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-05 14:32:03 -07:00
alicejw 31decfa7e4 add note to legacy clients matrix
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-05 14:28:37 -07:00
alicejw fff42db564 remove instances of setting that is no longer available in OS2.0
Signed-off-by: alicejw <alicejw@amazon.com>
2022-05-05 13:52:35 -07:00
Keith Chan ca838fa8c0
Merge pull request #489 from naveentatikonda/logstash_input_opensearch_documentation
Add documentation for logstash-input-opensearch plugin
2022-05-02 16:57:12 -07:00
Naveen Tatikonda 8bd566ad00 Add documentation for logstash-input-opensearch plugin
Signed-off-by: Naveen Tatikonda <navtat@amazon.com>
2022-05-02 18:37:25 -05:00
Oded Shafran 8251952f34 Update index.md
Signed-off-by: Oded Shafran <oded@shafranet.com>
2022-04-25 20:42:03 +03:00
Naarcha-AWS 56611db9a2 Remove link to ECS compatibility docs
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-04-04 13:15:47 -05:00
Naarcha-AWS 645b7ae69d Add LogStash 8.0 updates
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-03-31 14:52:51 -05:00
keithhc2 4033cfc320 Monospacing
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-03-23 09:29:49 -07:00
keithhc2 67ab805204 Language tweaks
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-03-21 18:59:52 -07:00
Asif Sohail Mohammed 61367f5927 Fixed language consistency
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-20 20:43:35 -05:00
Asif Sohail Mohammed 9126f5e7f5 Fixed key-value documentation
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-18 13:02:56 -05:00
Asif Sohail Mohammed aba8d2df10 Added doc for drop, mutate processors action
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-17 13:56:57 -05:00
Asif Sohail Mohammed fcefce24da Added doc for custom aggregate action
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-13 18:50:00 -05:00
Asif Sohail Mohammed 8d7dba3fcf Add note for processors and remove drop_events.
Processors include aggregate, date, drop_events, key_value.

Signed-off-by: Asif Sohail <nsifmoh@amazon.com>
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-04 14:36:41 -06:00
Asif Sohail Mohammed 22f8fd5563 Add documentation for Data Prepper processors
Processors include aggregate, date, drop_events, key_value.

Signed-off-by: Asif Sohail <nsifmoh@amazon.com>
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-03 23:11:45 -06:00
keithhc2 be6f1ee6c8 More code tweaks
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-02-15 13:15:11 -08:00