iSharkFly-Docs
/
opensearch-docs-cn
mirror of https://github.com/iSharkFly-Docs/opensearch-docs-cn
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,335 Commits 41 Branches 2 Tags 195 MiB
Commit Graph

2335 Commits

Author SHA1 Message Date
Melissa Vagi 60ee1fad77
[DOC] Update segment replication to include alerting plugin limitation (#4976) 
* Update documentation to include alerting and secutiry analytics plugin limitations
---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-09-13 09:53:14 -06:00
kolchfa-aws 99a6a2b127
Add words to dictionary and modify rules (#5010) 
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
 2023-09-13 10:33:09 -04:00
Brian Presley b024b6ccc2
Add Migrations - Capture and Replay release documentation (#4991) 
* Add Migrations - Capture and Replay release documentation

Signed-off-by: Brian Presley <bjpres@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Brian Presley <bjpres@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Brian Presley <bjpres@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-09-12 14:17:32 -05:00
Chris Moore 3ec2b9c83b
Adds documentation for permission that provides access to system indexes (#4849) 
* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* Fixes some wordings around system index permission access and usage (#4948)

* Fixes some wordings around system index permission access and usage

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* Addresses PR feedback

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* Addresses more PR feedback

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

---------

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* Changes the feature flag key and updates some text (#4953)

* Changes the feature flag key and updates description of a consideration

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* Addresses source PR feedback

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

---------

Signed-off-by: Darshit Chanpura <dchanp@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4736 system index permission

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
Signed-off-by: Darshit Chanpura <dchanp@amazon.com>
Co-authored-by: Darshit Chanpura <35282393+DarshitChanpura@users.noreply.github.com>
 2023-09-11 12:02:25 -07:00
Vlad Babak 0e2a5888a9
Typo in convert_entry_type.md (#4994) 
Replaced "convert_entry_type_type" with "convert_entry_type".

Signed-off-by: Vlad Babak <129367331+vlad-voxalyze@users.noreply.github.com>
 2023-09-08 14:03:14 -05:00
Nathan Bower 07268c9d18
Remove terms as inoffensive (#4983) 
Signed-off-by: natebower <102320899+natebower@users.noreply.github.com>
 2023-09-07 12:58:11 -04:00
kolchfa-aws 75b1c94060
Add script score query (#4970) 
* Add script score query

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add copy buttons

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add note about expensive queries

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rewording

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rewording

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/specialized/script-score.md

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* More editorial comments and field name change

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-09-07 10:21:04 -04:00
Naarcha-AWS ea886a4763
Fix S3 bug (#4974) 
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-09-06 16:01:03 -05:00
Andrew Ross f807c3326e
Update the index codec documentation (#4958) 
This is a restructuring of the index codec documentation to clarify
the consequences of changing an index codec and to encourage testing
before making a change.

Signed-off-by: Andrew Ross <andrross@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-09-05 19:33:32 -04:00
toyozaki 5d69b132b0
Fixed converted date with time_zone (#4956) 
Signed-off-by: toyozaki <61676668+toyozaki@users.noreply.github.com>
 2023-09-05 14:18:10 -05:00
astephanus 516e616f24
Adds latest top navigation menu items from project site to 2.x version of docs site (#4960) 
Signed-off-by: Aaron Stephanus <taoist.futility@pm.me>
 2023-09-05 11:23:12 -07:00
Melissa Vagi 2e62d9e8c8
Fix code example format and typos (#4949) 
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
 2023-08-31 17:26:10 -06:00
Melissa Vagi 71935cff99
[DOC] Add ingest processors documentation (#4299) 
Created new documentation to close content gaps

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
 2023-08-29 14:07:34 -06:00
kolchfa-aws de5f5ae073
Add quantization techniques and links to byte vector (#4893) 
* Add quantization techniquest and links to byte vector

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Added cosine similarity space type quantization

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rewording

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Remove redundant line

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Update _field-types/supported-field-types/knn-vector.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _field-types/supported-field-types/knn-vector.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Editorial feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-29 13:45:19 -04:00
David Venable 64d59b9bb2
Behavioral changes for Data Prepper S3 sink (#4897) 
* Updates the Data Prepper documentation for S3 sinks based on recent behavior changes.

Signed-off-by: David Venable <dlv@amazon.com>

* Updates from the PR feedback.

Signed-off-by: David Venable <dlv@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: David Venable <dlv@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-08-29 10:01:24 -05:00
Naarcha-AWS dc21de0f80
Add additional technical feedback to workloads (#4879) 
* Add additional technical feedback to workloads

TO DO: Add Running Tasks in Parallel section.

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Fix indices table.

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Fix corpora page

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _benchmark/workloads/corpora.md

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
 2023-08-28 18:09:04 -05:00
sheltie f04a887a60
add "patients" before "smoker" (#4921) 
Signed-off-by: sheltie <sheltie.fusafusa@gmail.com>
 2023-08-28 18:11:08 -04:00
kolchfa-aws c88019e597
Reformat wildcard query request (#4920) 
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
 2023-08-28 17:35:35 -04:00
kolchfa-aws 63059ce9e2
Case insensitive parameter for wildcard query (#4914) 
* added missing documentation about case_insensitive param in wildcard query

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* Update _query-dsl/query-dsl/term.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/query-dsl/term.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/query-dsl/term.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/term/wildcard.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _query-dsl/term/wildcard.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Co-authored-by: Mark Cohen <markcoh@amazon.com>
 2023-08-28 16:29:32 -04:00
kolchfa-aws 871f8abcfa
Add Index Stats API (#4892) 
* Add Index Stats API

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Reword for clarity

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Update _api-reference/index-apis/stats.md

Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implement editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-28 15:57:44 -04:00
David Venable 27cbf9d03a
Removes the acknowledgements_timeout configuration from the Data Prepper Kafka source. (#4898) 
Signed-off-by: David Venable <dlv@amazon.com>
 2023-08-28 11:47:36 -05:00
kolchfa-aws 87ed0af851
Refactor search pipeline documentation (#4908) 
* Refactor search pipeline documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-28 11:56:11 -04:00
David Venable 000aecc1a3
Moves the generic sink options into the Sinks documentation rather than PIpeline Configuration options. (#4907) 
Signed-off-by: David Venable <dlv@amazon.com>
 2023-08-28 10:43:26 -05:00
Chris Moore 834a829b62
Add documentation topic to authentication backends section for HTTP basic authentication (#4638) 
* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#2512 basic for authc backend

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
 2023-08-25 16:26:21 -07:00
Naarcha-AWS 7f9a06120d
Add new Cohere connector blueprint (#4894) 
* Update connectors.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Fix local connector example

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-08-25 09:27:11 -05:00
Heather Halter e907d90fcc
Update java-rest-high-level.md (#4880) 
Updated text as per #4844

Signed-off-by: Heather Halter <HDHALTER@AMAZON.COM>
 2023-08-24 16:43:14 -07:00
Naarcha-AWS 18702840c6
Add workload section to Benchmarks (#4705) 
* Add Benchmark workload section.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add workload reference intro. Add indices and corpora reference.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add technical feedback

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix typo

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Apply suggestions from code review

Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* indices consistency.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add final piece of feedback.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* One last comment.

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-24 13:03:56 -05:00
kolchfa-aws 0ca5c0ce81
Add Profile API (#4851) 
* Add profile API

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Add profile API documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Formatting

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Implemented tech review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Change time_in_nanos to long

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Update _api-reference/profile.md

Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Doc review feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-23 20:45:50 -04:00
Chris Moore b2d258d513
Add breaking changes documentation for ES 6.8 to OS 1.x migration issues (#4856) 
* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
 2023-08-23 13:24:00 -07:00
David Venable 5306134c41
Updated the intro text for the s3 sink. (#4854) 
Signed-off-by: David Venable <dlv@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-08-23 13:33:46 -05:00
Naarcha-AWS 1250649984
Fix typos on S3 sink documentation (#4862) 
* Fix typos on S3 sink documentation

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _data-prepper/pipelines/configuration/sinks/s3.md

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
 2023-08-23 12:49:46 -05:00
David Venable ed21ec74cf
Removes the Data Prepper csv sink codec. This is not ready for use and should not be documented. (#4859) 
Signed-off-by: David Venable <dlv@amazon.com>
 2023-08-23 09:19:04 -05:00
Asif Sohail Mohammed cc21df7ee8
S3 scan doc update (#4848) 
* Updated s3 scan docs

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-08-22 15:28:13 -05:00
David Venable 0b5011409a
Data Prepper documentation updates for the s3 sink in 2.4.0 (#4847) 
* Data Prepper documentation updates for the s3 sink in 2.4.0. Includes other corrections.

* Updated the Parquet/Avro codecs to include auto_schema as well as some clarifications on the restrictions of the auto-generated schema.

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-08-22 15:18:40 -05:00
kolchfa-aws 6bece563ea
Add k-NN vector field type (#4850) 
* Add k-NN vector field type

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Rename topic

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
 2023-08-22 13:27:31 -04:00
Melissa Vagi fc14355c1f
[DOC} Reconcile Alerting Monitors 2.9 Documentation Changes (#4710) 
* Reconcile PR changes that weren't published due to files being edited simultaneously

---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
 2023-08-21 12:22:25 -06:00
Asif Sohail Mohammed 8e9d0ed4de
S3 scan docs (#4756) 
* Add notification_source option for S3

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Added S3 scan configuration

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Addressed some failing style checks

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>

* Edit S3 additions.

* Fix links.

* Fix style flaw

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update s3.md

---------

Signed-off-by: Asif Sohail Mohammed <nsifmoh@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-21 11:02:07 -05:00
David Venable ac3f60d5ca
Documentation for bucket ownership features in Data Prepper 2.4 (#4679) 
* Adds documentation for new features in Data Prepper 2.4 related to bucket ownership. Includes a section explaining how the bucket ownership works and can be configured for cross-account access. Resolves #4678

Signed-off-by: David Venable <dlv@amazon.com>

* Updates from PR feedback.

Signed-off-by: David Venable <dlv@amazon.com>

* Remove redundant header

Add a name to primary H2 header to section to prevent links from breaking.

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: David Venable <dlv@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-21 10:46:04 -05:00
Qi Chen 7d077786bc
MAINT: update distribution_version in opensearch sink (#4742) 
* MAINT: update distribution_version in opensearch sink

Signed-off-by: George Chen <qchea@amazon.com>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Qi Chen <chenqi0805@gmail.com>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Qi Chen <chenqi0805@gmail.com>

* Fix typo

* ADD: request compression flag

Signed-off-by: George Chen <qchea@amazon.com>

* Update opensearch.md

---------

Signed-off-by: George Chen <qchea@amazon.com>
Signed-off-by: Qi Chen <chenqi0805@gmail.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-08-21 10:45:40 -05:00
Naarcha-AWS 152ffcd79f
Add Kafka source for DP 2.4 (#4737) 
* Add Kafka source for DP 2.4

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Use new Kafka settings

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Add technical feedback

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Fix typos

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>

* Apply suggestions from code review

Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Change array to object.

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Last minute changes to Kafka defaults

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Naarcha-AWS <naarcha@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Heather Halter <HDHALTER@AMAZON.COM>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-21 10:43:32 -05:00
Taylor Gray 09ff9fc10c
Add documentation for managing data prepper source coordination (#4758) 
* Add documentation for managing data prepper source coordination

Signed-off-by: Taylor Gray <tylgry@amazon.com>

* Update source-coordination.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Update _data-prepper/managing-data-prepper/source-coordination.md

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Add TTL link

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: Taylor Gray <tylgry@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-21 10:39:50 -05:00
David Venable 442f4c446a
Documents general sink options (#4759) 
* Adds general sink options which includes: routes, tags_target_key, include_keys, exclude_keys.

Signed-off-by: David Venable <dlv@amazon.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>

---------

Signed-off-by: David Venable <dlv@amazon.com>
Signed-off-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
 2023-08-21 10:39:31 -05:00
toyozaki ff0492a966
[DOC] Fix typo in IDs query doc (#4836) 
Signed-off-by: Akira Toyozaki <61676668+toyozaki@users.noreply.github.com>
 2023-08-20 12:24:30 -04:00
Chris Moore b9b21e1e30
Add documentation to provide a link from detector creation to detection rule creation in using rules docs (#4829) 
* fix#4828 link to detection rule creation

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4828 link to detection rule creation

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4828 link to detection rule creation

Signed-off-by: cwillum <cwmmoore@amazon.com>

* fix#4828 link to detection rule creation

Signed-off-by: cwillum <cwmmoore@amazon.com>

---------

Signed-off-by: cwillum <cwmmoore@amazon.com>
 2023-08-17 17:22:04 -07:00
Heather Halter 8f91f1a49b
Update docker.md (#4822) 
As per Peter Zhu, `docker container prune` is right to use when trying to remove stopped containers: https://docs.docker.com/engine/reference/commandline/container_prune/

Signed-off-by: Heather Halter <HDHALTER@AMAZON.COM>
 2023-08-17 15:50:13 -07:00
kolchfa-aws 3ade0a93b8
Add data type to term and term set queries (#4821) 
* Add data type to term and term set queries

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Remove extra parenthesis

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
 2023-08-17 18:47:42 -04:00
kolchfa-aws cac580ef00
Refactor term query documentation (#4787) 
* Refactor term query documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Refactor term-level query documentation

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* fix links

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* More examples

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* Add section about expensive queries

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

* More editorial feedback

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>

---------

Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Chris Moore <107723039+cwillum@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-17 14:38:31 -04:00
Nathan Bower b1767a1e0b
Add acronyms (#4816) 
* Add acronyms

Signed-off-by: natebower <102320899+natebower@users.noreply.github.com>

* Add pipe

Signed-off-by: natebower <102320899+natebower@users.noreply.github.com>

---------

Signed-off-by: natebower <102320899+natebower@users.noreply.github.com>
 2023-08-16 14:08:49 -04:00
akashsha1 91c65e525f
Add zstd compression content to performance tuning doc (#4814) 
* add codec info

Signed-off-by: Shankaran <akash.shankaran@intel.com>

* Update _tuning-your-cluster/performance.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>

---------

Signed-off-by: Shankaran <akash.shankaran@intel.com>
Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
 2023-08-16 11:03:51 -04:00
Vacha Shah 476e2d6422
Correcting the java client code snippets and updating java client version (#4789) 
Signed-off-by: Vacha Shah <vachshah@amazon.com>
 2023-08-15 16:00:32 -04:00