Since data-prepper version 2.0.0 there are new default values for buffer_size & batch_size.
The default buffer_size (previously: 512) and default batch_size (previously: 8) were increased by the factor 25.
The new default values are: buffer_size: 12800 and batch_size: 200.
Issue: https://github.com/opensearch-project/data-prepper/issues/1983
Signed-off-by: Jannik Brand <jannik.brand@sap.com>
* add files back from lost local files
Signed-off-by: Alice Williams <alicejw@amazon.com>
* nest reporting CLI under main Reporting page
Signed-off-by: Alice Williams <alicejw@amazon.com>
* rough draft examples for AWS Lambda and Cron
Signed-off-by: Alice Williams <alicejw@amazon.com>
* better title for cron job report example
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for more details from tech reviewer
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for better cron job usage description
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for more details
Signed-off-by: Alice Williams <alicejw@amazon.com>
* remove needs info markers and add links to events doc
Signed-off-by: Alice Williams <alicejw@amazon.com>
* more info
Signed-off-by: Alice Williams <alicejw@amazon.com>
* more details from demonstration
Signed-off-by: Alice Williams <alicejw@amazon.com>
* remove reporting directory to keep both parallel in left nav
Signed-off-by: Alice Williams <alicejw@amazon.com>
* small addition
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for two configuration settings in the function
Signed-off-by: Alice Williams <alicejw@amazon.com>
* more details from eng meeting adding to the steps
Signed-off-by: Alice Williams <alicejw@amazon.com>
* more details from eng meeting adding to the steps
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for more details
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for additional steps to create and test the lambda function
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for scheduling reports with lambda
Signed-off-by: Alice Williams <alicejw@amazon.com>
* merge redundant set of steps together
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for tech review comments
Signed-off-by: Alice Williams <alicejw@amazon.com>
* to add download correct title and link
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for reporting directory to nest new cli page
Signed-off-by: Alice Williams <alicejw@amazon.com>
* un-nest reporting directory
Signed-off-by: Alice Williams <alicejw@amazon.com>
* to remove reporting directory - will nest with other page in separate PR
Signed-off-by: Alice Williams <alicejw@amazon.com>
* tech review comments and some reorg
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for tech review comments
Signed-off-by: Alice Williams <alicejw@amazon.com>
* to minor changes
Signed-off-by: Alice Williams <alicejw@amazon.com>
* more info about crontab sequence
Signed-off-by: Alice Williams <alicejw@amazon.com>
* cron updates
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for cron syntax
Signed-off-by: Alice Williams <alicejw@amazon.com>
* small updates to lambda proc
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for final writer checklist
Signed-off-by: Alice Williams <alicejw@amazon.com>
* cron link update
Signed-off-by: Alice Williams <alicejw@amazon.com>
* format fix
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for doc review cron & lambda sections
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for cron reference to man page
Signed-off-by: Alice Williams <alicejw@amazon.com>
* add internal link to cron ref
Signed-off-by: Alice Williams <alicejw@amazon.com>
* reorg single topic into 7 pages
Signed-off-by: Alice Williams <alicejw@amazon.com>
* minor update
Signed-off-by: Alice Williams <alicejw@amazon.com>
* link to set ses permissions
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for tech review meeting updates
Signed-off-by: Alice Williams <alicejw@amazon.com>
* small update
Signed-off-by: Alice Williams <alicejw@amazon.com>
* npm download command name changed to remove opensearch prepended name
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for new download via artifacts hub
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for new download instructions
Signed-off-by: Alice Williams <alicejw@amazon.com>
* small fix signature file
Signed-off-by: Alice Williams <alicejw@amazon.com>
* typo
Signed-off-by: Alice Williams <alicejw@amazon.com>
* for cleaner image
Signed-off-by: Alice Williams <alicejw@amazon.com>
* remove image for push commands we won't use
Signed-off-by: Alice Williams <alicejw@amazon.com>
---------
Signed-off-by: Alice Williams <alicejw@amazon.com>
Please double-check that this is correct. I'm using `org.opensearch.client:opensearch-java:2.2.0` and `org.opensearch.client:opensearch-rest-client:2.5.0` to try to create a client as per the docs. I noticed that the call to `IndexRequest.Builder.value()` does not work. I believe the correct method name is ``IndexRequest.Builder.document()`
* Creating PR with first file.
Signed-off-by: carolxob <carolxob@amazon.com>
* Adding newly created files to PR.
Signed-off-by: carolxob <carolxob@amazon.com>
* Reorganized files and added appropriate metadata to map ToC correctly.
Signed-off-by: carolxob <carolxob@amazon.com>
* Moved Authoring pipelines page.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor ToC updates.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor ToC updates to Sources section for Data Prepper.
Signed-off-by: carolxob <carolxob@amazon.com>
* Updated Buffers section under Data Prepper.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor update to otelmetricssource.
Signed-off-by: carolxob <carolxob@amazon.com>
* Restructured ToC in Processors section for Data Prepper.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor filename change.
Signed-off-by: carolxob <carolxob@amazon.com>
* Adjustments to metadata in ToC.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor edit.
Signed-off-by: carolxob <carolxob@amazon.com>
* Fixed nav order in metadata.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor edit.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor update top metadata for ToC.
Signed-off-by: carolxob <carolxob@amazon.com>
* Adjustmenets to Toc order.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor adjustments to ToC metadata.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor adjustments to Sinks section.
Signed-off-by: carolxob <carolxob@amazon.com>
* Adjustements to high level ToC.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor adjustement to Pipelines.md
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor update.
Signed-off-by: carolxob <carolxob@amazon.com>
* Slight reorganization. Removed two placeholder pages for now.
Signed-off-by: carolxob <carolxob@amazon.com>
* Removed a page and replaced with pipelines content.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor changes/additions to content for placeholder pages.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor update to page link.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor adjustments to ToC metadata.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor edits.
Signed-off-by: carolxob <carolxob@amazon.com>
* Removed /clients from redirects to correct nav order.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor edits.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor adjustments to ToC metadata.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor adjustments.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor adjustment ot metadata.
Signed-off-by: carolxob <carolxob@amazon.com>
* TOC link fixes
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
* Changed page name.
Signed-off-by: carolxob <carolxob@amazon.com>
* Corrected references to Peer Forwarder.
Signed-off-by: carolxob <carolxob@amazon.com>
* Renamed Data Prepper folder.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor updates to phrasing and capitalization.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor phrasing update.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor phrasing update.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor change.
Signed-off-by: carolxob <carolxob@amazon.com>
* Minor change to change S3 Source to S3Source.
Signed-off-by: carolxob <carolxob@amazon.com>
* Updated references to peer forwarder and changed capitalization.
Signed-off-by: carolxob <carolxob@amazon.com>
* Updated capitalization for peer forwarder.
Signed-off-by: carolxob <carolxob@amazon.com>
* Made edits based on doc review feedback.
Signed-off-by: carolxob <carolxob@amazon.com>
* Update to one word.
Signed-off-by: carolxob <carolxob@amazon.com>
---------
Signed-off-by: carolxob <carolxob@amazon.com>
Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Co-authored-by: Naarcha-AWS <naarcha@amazon.com>
* Makes version selector sticky
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Adds min width to site nav to accommodate version selector
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Makes site nav 100% vh
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Scroll to top when last visit was more than 24 hours ago
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
* Changed localStorage to sessionStorage
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Melissa Vagi
JannikBrand
Alice Williams
kolchfa-aws
Naarcha-AWS
Caroline
Nick Baughman
Chris Moore
Nathan Bower
Aria Marble
Hyobin (Justin) You