Commit Graph

2596 Commits

Author SHA1 Message Date
Chris Moore dde7c02b8d
Add documentation that supports custom log types (#4969)
* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4741 custom logtype updates

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
2023-09-19 14:36:56 -07:00
Melissa Vagi 8d08819a0e
[DOC] Add new UI theme image to intro section (#5048)
* Add new UI theme image to intro section

---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
2023-09-19 13:07:42 -06:00
Melissa Vagi 0fcc7d7060
[DOC] Add new documentation for IP2Geo (#4998)
* Approved through tech, doc, and editorial

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Publish documentation

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
2023-09-19 12:05:54 -06:00
Melissa Vagi 8e44362c62
[DOC] Update Discover index page (#4951)
Update UI screenshots and make copy edits to content
---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-15 10:26:23 -06:00
Melissa Vagi b983d92094
[DOC] Update Dev Tools for navigation changes (#4874)
Update UI screenshots and make copy edits to content

---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-15 09:40:04 -06:00
Naarcha-AWS d261e69252
Add new remote store options to Snapshot API (#4977)
* Add new remote store options to snapshots API

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _api-reference/snapshots/create-snapshot.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-14 13:12:14 -05:00
Poojita Raj fa35a828ab
Add cluster setting for shard movement strategy (#4955)
* Add cluster setting for shard movement strategy

Signed-off-by: Poojita Raj <poojiraj@amazon.com>

* changes to doc

Signed-off-by: Poojita Raj <poojiraj@amazon.com>

* added suggestion

Signed-off-by: Poojita Raj <poojiraj@amazon.com>

* changes to en-dash

Signed-off-by: Poojita Raj <poojiraj@amazon.com>

---------

Signed-off-by: Poojita Raj <poojiraj@amazon.com>
2023-09-14 08:58:25 -07:00
kolchfa-aws d946416169
Fix time zone for range query (#5020)
* Fix time zone for range query

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Update _query-dsl/term/range.md

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Changed link to formats

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
2023-09-14 11:57:14 -04:00
kolchfa-aws b9adb58f0c
Changed format in wildcard query request (#5015)
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-09-13 15:22:56 -04:00
Brian Presley 6046c0524b
Remove steps for migrating cluster, targeted for later release (#5012)
Signed-off-by: Brian Presley <bjpres@amazon.com>
Co-authored-by: Brian Presley <bjpres@amazon.com>
2023-09-13 13:39:16 -05:00
Bhumika Saini 58789e75d2
Update docs for Remote Segment and Remote Translog store stats surfaced via nodes/indices/cluster stats APIs (#4995)
* Update docs for remote_store.moving_average_window_size

Signed-off-by: Bhumika Saini <sabhumik@amazon.com>

* Update docs for Remote Segment and Remote Translog store stats surfaced via nodes/indices/cluster stats APIs

Signed-off-by: Bhumika Saini <sabhumik@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _api-reference/nodes-apis/nodes-stats.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update nodes-stats.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update cluster-stats.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Bhumika Saini <sabhumik@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-13 12:54:39 -05:00
Melissa Vagi 60ee1fad77
[DOC] Update segment replication to include alerting plugin limitation (#4976)
* Update documentation to include alerting and secutiry analytics plugin limitations
---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-13 09:53:14 -06:00
kolchfa-aws 99a6a2b127
Add words to dictionary and modify rules (#5010)
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-09-13 10:33:09 -04:00
Brian Presley b024b6ccc2
Add Migrations - Capture and Replay release documentation (#4991)
* Add Migrations - Capture and Replay release documentation

Signed-off-by: Brian Presley <bjpres@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Brian Presley <bjpres@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Brian Presley <bjpres@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-12 14:17:32 -05:00
Chris Moore 3ec2b9c83b
Adds documentation for permission that provides access to system indexes (#4849)
* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* Fixes some wordings around system index permission access and usage (#4948)

* Fixes some wordings around system index permission access and usage

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* Addresses PR feedback

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* Addresses more PR feedback

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

---------

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* Changes the feature flag key and updates some text (#4953)

* Changes the feature flag key and updates description of a consideration

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* Addresses source PR feedback

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

---------

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
2023-09-11 12:02:25 -07:00
Vlad Babak 0e2a5888a9
Typo in convert_entry_type.md (#4994)
Replaced "convert_entry_type_type" with "convert_entry_type".

Signed-off-by: Vlad Babak <129367331+vlad-voxalyze@users.noreply.github.com>
2023-09-08 14:03:14 -05:00
Nathan Bower 07268c9d18
Remove terms as inoffensive (#4983)
Signed-off-by: natebower <102320899+natebower@users.noreply.github.com>
2023-09-07 12:58:11 -04:00
kolchfa-aws 75b1c94060
Add script score query (#4970)
* Add script score query

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add copy buttons

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add note about expensive queries

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rewording

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rewording

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/specialized/script-score.md

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* More editorial comments and field name change

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-07 10:21:04 -04:00
Naarcha-AWS ea886a4763
Fix S3 bug (#4974)
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2023-09-06 16:01:03 -05:00
Andrew Ross f807c3326e
Update the index codec documentation (#4958)
This is a restructuring of the index codec documentation to clarify
the consequences of changing an index codec and to encourage testing
before making a change.

Signed-off-by: Andrew Ross <andrross@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-09-05 19:33:32 -04:00
toyozaki 5d69b132b0
Fixed converted date with time_zone (#4956)
Signed-off-by: toyozaki <61676668+toyozaki@users.noreply.github.com>
2023-09-05 14:18:10 -05:00
astephanus 516e616f24
Adds latest top navigation menu items from project site to 2.x version of docs site (#4960)
Signed-off-by: Aaron Stephanus <taoist.futility@pm.me>
2023-09-05 11:23:12 -07:00
Melissa Vagi 2e62d9e8c8
Fix code example format and typos (#4949)
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
2023-08-31 17:26:10 -06:00
Melissa Vagi 71935cff99
[DOC] Add ingest processors documentation (#4299)
Created new documentation to close content gaps

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
2023-08-29 14:07:34 -06:00
kolchfa-aws de5f5ae073
Add quantization techniques and links to byte vector (#4893)
* Add quantization techniquest and links to byte vector

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Added cosine similarity space type quantization

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rewording

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Remove redundant line

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Update _field-types/supported-field-types/knn-vector.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _field-types/supported-field-types/knn-vector.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Editorial feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-08-29 13:45:19 -04:00
David Venable 64d59b9bb2
Behavioral changes for Data Prepper S3 sink (#4897)
* Updates the Data Prepper documentation for S3 sinks based on recent behavior changes.

Signed-off-by: David Venable <dlv@amazon.com>

* Updates from the PR feedback.

Signed-off-by: David Venable <dlv@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: David Venable <dlv@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2023-08-29 10:01:24 -05:00
Naarcha-AWS dc21de0f80
Add additional technical feedback to workloads (#4879)
* Add additional technical feedback to workloads

TO DO: Add Running Tasks in Parallel section.

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Fix indices table.

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Fix corpora page

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _benchmark/workloads/corpora.md

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
2023-08-28 18:09:04 -05:00
sheltie f04a887a60
add "patients" before "smoker" (#4921)
Signed-off-by: sheltie <sheltie.fusafusa@gmail.com>
2023-08-28 18:11:08 -04:00
kolchfa-aws c88019e597
Reformat wildcard query request (#4920)
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-08-28 17:35:35 -04:00
kolchfa-aws 63059ce9e2
Case insensitive parameter for wildcard query (#4914)
* added missing documentation about case_insensitive param in wildcard query

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* Update _query-dsl/query-dsl/term.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/query-dsl/term.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/query-dsl/term.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/term/wildcard.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/term/wildcard.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: Mark Cohen <markcoh@amazon.com>
2023-08-28 16:29:32 -04:00
kolchfa-aws 871f8abcfa
Add Index Stats API (#4892)
* Add Index Stats API

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Reword for clarity

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _api-reference/index-apis/stats.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implement editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-08-28 15:57:44 -04:00
David Venable 27cbf9d03a
Removes the acknowledgements_timeout configuration from the Data Prepper Kafka source. (#4898)
Signed-off-by: David Venable <dlv@amazon.com>
2023-08-28 11:47:36 -05:00
kolchfa-aws 87ed0af851
Refactor search pipeline documentation (#4908)
* Refactor search pipeline documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-08-28 11:56:11 -04:00
David Venable 000aecc1a3
Moves the generic sink options into the Sinks documentation rather than PIpeline Configuration options. (#4907)
Signed-off-by: David Venable <dlv@amazon.com>
2023-08-28 10:43:26 -05:00
Chris Moore 834a829b62
Add documentation topic to authentication backends section for HTTP basic authentication (#4638)
* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
2023-08-25 16:26:21 -07:00
Naarcha-AWS 7f9a06120d
Add new Cohere connector blueprint (#4894)
* Update connectors.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Fix local connector example

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2023-08-25 09:27:11 -05:00
Heather Halter e907d90fcc
Update java-rest-high-level.md (#4880)
Updated text as per #4844

Signed-off-by: Heather Halter <HDHALTER@AMAZON.COM>
2023-08-24 16:43:14 -07:00
Naarcha-AWS 18702840c6
Add workload section to Benchmarks (#4705)
* Add Benchmark workload section.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add workload reference intro. Add indices and corpora reference.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add technical feedback

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix typo

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Apply suggestions from code review

Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* indices consistency.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add final piece of feedback.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* One last comment.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-08-24 13:03:56 -05:00
kolchfa-aws 0ca5c0ce81
Add Profile API (#4851)
* Add profile API

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add profile API documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Formatting

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Change time_in_nanos to long

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Update _api-reference/profile.md

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Doc review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-08-23 20:45:50 -04:00
Chris Moore b2d258d513
Add breaking changes documentation for ES 6.8 to OS 1.x migration issues (#4856)
* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
2023-08-23 13:24:00 -07:00
David Venable 5306134c41
Updated the intro text for the s3 sink. (#4854)
Signed-off-by: David Venable <dlv@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2023-08-23 13:33:46 -05:00
Naarcha-AWS 1250649984
Fix typos on S3 sink documentation (#4862)
* Fix typos on S3 sink documentation

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _data-prepper/pipelines/configuration/sinks/s3.md

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
2023-08-23 12:49:46 -05:00
David Venable ed21ec74cf
Removes the Data Prepper csv sink codec. This is not ready for use and should not be documented. (#4859)
Signed-off-by: David Venable <dlv@amazon.com>
2023-08-23 09:19:04 -05:00
Asif Sohail Mohammed cc21df7ee8
S3 scan doc update (#4848)
* Updated s3 scan docs

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2023-08-22 15:28:13 -05:00
David Venable 0b5011409a
Data Prepper documentation updates for the s3 sink in 2.4.0 (#4847)
* Data Prepper documentation updates for the s3 sink in 2.4.0. Includes other corrections.

* Updated the Parquet/Avro codecs to include auto_schema as well as some clarifications on the restrictions of the auto-generated schema.

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2023-08-22 15:18:40 -05:00
kolchfa-aws 6bece563ea
Add k-NN vector field type (#4850)
* Add k-NN vector field type

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rename topic

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
2023-08-22 13:27:31 -04:00
Melissa Vagi fc14355c1f
[DOC} Reconcile Alerting Monitors 2.9 Documentation Changes (#4710)
* Reconcile PR changes that weren't published due to files being edited simultaneously

---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
2023-08-21 12:22:25 -06:00
Asif Sohail Mohammed 8e9d0ed4de
S3 scan docs (#4756)
* Add notification_source option for S3

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Added S3 scan configuration

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Addressed some failing style checks

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Edit S3 additions.

* Fix links.

* Fix style flaw

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update s3.md

---------

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-08-21 11:02:07 -05:00
David Venable ac3f60d5ca
Documentation for bucket ownership features in Data Prepper 2.4 (#4679)
* Adds documentation for new features in Data Prepper 2.4 related to bucket ownership. Includes a section explaining how the bucket ownership works and can be configured for cross-account access. Resolves #4678

Signed-off-by: David Venable <dlv@amazon.com>

* Updates from PR feedback.

Signed-off-by: David Venable <dlv@amazon.com>

* Remove redundant header

Add a name to primary H2 header to section to prevent links from breaking.

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: David Venable <dlv@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
2023-08-21 10:46:04 -05:00
Qi Chen 7d077786bc
MAINT: update distribution_version in opensearch sink (#4742)
* MAINT: update distribution_version in opensearch sink

Signed-off-by: George Chen <qchea@amazon.com>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Qi Chen <chenqi0805@gmail.com>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Qi Chen <chenqi0805@gmail.com>

* Fix typo

* ADD: request compression flag

Signed-off-by: George Chen <qchea@amazon.com>

* Update opensearch.md

---------

Signed-off-by: George Chen <qchea@amazon.com>
Signed-off-by: Qi Chen <chenqi0805@gmail.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
2023-08-21 10:45:40 -05:00