Commit Graph

22 Commits

Author SHA1 Message Date
Naarcha-AWS 15697d9bcf
Fix typo in Data Prepper doc (#1550) 2022-10-13 14:53:45 -05:00
Naarcha-AWS 2492a54d88
Make sure that Main picks up all change from Data Prepper 2.0 branch (#1517)
* Change Data Prepper intro

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add next steps section

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add David's feedback

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix optional tags

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Address small typo

* [Data Prepper 2.0]MAINT: documentation change regarding record type (#1306)

* MAINT: documentation change regarding record type

Signed-off-by: Chen <qchea@amazon.com>

* MAINT: documentation on trace group fields

Signed-off-by: Chen <qchea@amazon.com>

Signed-off-by: Chen <qchea@amazon.com>

* Update docs for Data Prepper 2.0 (#1404)

* Update get-started

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update pipelines.md

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add peer forwarder options to references

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add csv processor options to refereces

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for conditional routing

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for json processor

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Remove docs for peer forwarder plugin

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review feedback - revise sentences, fix inaccurate info and typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add missing options for http source and peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update ssl options on peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* More updates for Data Prepper 2.0 (#1469)

* Update http source and opensearch sink options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update docker run command

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add more missing options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add metadata_root_key for s3 source

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments - tweak sentences and fix typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Fix broken link

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add reworked Getting Started page

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Undo change for getting started

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add edited Data Prepper overview

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add edited Data Prepper file

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Chen <qchea@amazon.com>
Signed-off-by: Hai Yan <oeyh@amazon.com>
Co-authored-by: Qi Chen <qchea@amazon.com>
Co-authored-by: Hai Yan <8153134+oeyh@users.noreply.github.com>
2022-10-11 16:31:41 -05:00
David Venable a1add5db6c
Data Prepper 2.0 documentation (#1510)
* Change Data Prepper intro

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add next steps section

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add David's feedback

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix optional tags

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Address small typo

* [Data Prepper 2.0]MAINT: documentation change regarding record type (#1306)

* MAINT: documentation change regarding record type

Signed-off-by: Chen <qchea@amazon.com>

* MAINT: documentation on trace group fields

Signed-off-by: Chen <qchea@amazon.com>

Signed-off-by: Chen <qchea@amazon.com>

* Update docs for Data Prepper 2.0 (#1404)

* Update get-started

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update pipelines.md

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add peer forwarder options to references

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add csv processor options to refereces

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for conditional routing

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add docs for json processor

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Remove docs for peer forwarder plugin

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review feedback - revise sentences, fix inaccurate info and typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add missing options for http source and peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update ssl options on peer forwarder

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* More updates for Data Prepper 2.0 (#1469)

* Update http source and opensearch sink options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Update docker run command

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add more missing options

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Add metadata_root_key for s3 source

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments - tweak sentences and fix typos

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Address review comments

Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>

* Fix broken link

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Chen <qchea@amazon.com>
Signed-off-by: Hai Yan <oeyh@amazon.com>
Co-authored-by: Naarcha-AWS <naarcha@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Qi Chen <qchea@amazon.com>
Co-authored-by: Hai Yan <8153134+oeyh@users.noreply.github.com>
2022-10-11 11:36:37 -05:00
Hai Yan 594715c04c
Rename prepper to processor in yaml sample (#1056)
Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>
2022-09-14 15:54:16 -05:00
David Venable e08b786d52
Fixes the metrics-pipeline to use otel_metrics_source which is the correct source plugin here. (#1155)
Signed-off-by: David Venable <dlv@amazon.com>

Signed-off-by: David Venable <dlv@amazon.com>
2022-09-10 10:32:07 -05:00
Hai Yan 2dcdf12bd7
Replace deprecated opensearch sink configuration fields in examples (#1029)
Signed-off-by: Hai Yan <oeyh@amazon.com>

Signed-off-by: Hai Yan <oeyh@amazon.com>
2022-08-30 13:06:45 -05:00
David Venable 56b650e3a0
Use "processor" instead of "prepper" for Data Prepper, which is the correct terminology now. (#889)
Signed-off-by: David Venable <dlv@amazon.com>

Signed-off-by: David Venable <dlv@amazon.com>
2022-08-16 11:54:22 -05:00
Keith Chan 407658e942
Fixed hyperlinks in Data Prepper reference (#717)
* Changed headings back to sentence

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

* Minor tweak

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

* Forgot to fix hyperlinks

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

Co-authored-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-06-24 11:24:00 -07:00
Keith Chan 4ec55fef3f
Changed headings back to sentence (#715)
* Changed headings back to sentence

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

* Minor tweak

Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>

Co-authored-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-06-24 11:20:30 -05:00
David Venable ab020c308d
Data Prepper 1.5.0 documentation (#701)
* Added documentation for Data Prepper 1.5.0.

Signed-off-by: David Venable <dlv@amazon.com>

* Responding to PR feedback for the Data Prepper documentation.

Signed-off-by: David Venable <dlv@amazon.com>

* Responding to additional PR feedback for the Data Prepper documentation.

Signed-off-by: David Venable <dlv@amazon.com>

* Added links to S3 and SQS

Signed-off-by: David Venable <dlv@amazon.com>
2022-06-23 19:01:09 -07:00
Naarcha-AWS 89fc690cf7
Add back Data Prepper 1.4 docs (#698)
* Add back Data Prepper 1.4 docs

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix Data Prepper Docker image

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
2022-06-22 14:10:40 -05:00
jzonthemtn faae3208f0 #682: Fixing docker image name.
Signed-off-by: jzonthemtn <jeff.zemerick@mtnfog.com>
2022-06-16 15:15:34 -04:00
keithhc2 4033cfc320 Monospacing
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-03-23 09:29:49 -07:00
keithhc2 67ab805204 Language tweaks
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-03-21 18:59:52 -07:00
Asif Sohail Mohammed 61367f5927 Fixed language consistency
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-20 20:43:35 -05:00
Asif Sohail Mohammed 9126f5e7f5 Fixed key-value documentation
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-18 13:02:56 -05:00
Asif Sohail Mohammed aba8d2df10 Added doc for drop, mutate processors action
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-17 13:56:57 -05:00
Asif Sohail Mohammed fcefce24da Added doc for custom aggregate action
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-13 18:50:00 -05:00
Asif Sohail Mohammed 8d7dba3fcf Add note for processors and remove drop_events.
Processors include aggregate, date, drop_events, key_value.

Signed-off-by: Asif Sohail <nsifmoh@amazon.com>
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-04 14:36:41 -06:00
Asif Sohail Mohammed 22f8fd5563 Add documentation for Data Prepper processors
Processors include aggregate, date, drop_events, key_value.

Signed-off-by: Asif Sohail <nsifmoh@amazon.com>
Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
2022-03-03 23:11:45 -06:00
keithhc2 4f78620d48 More renaming stuff
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-02-08 15:05:16 -08:00
keithhc2 a5f26f8d67 Moved data prepper
Signed-off-by: keithhc2 <keithhc2@users.noreply.github.com>
2022-02-08 13:54:39 -08:00