AmatyaAvadhanula 1f63b447c4

Mitigate Kinesis stream LimitExceededException by using listShards API (#12161) ...

Makes kinesis ingestion resilient to `LimitExceededException` caused by resharding.
Replace `describeStream` with `listShards` (recommended) to get shard related info.
`describeStream` has a limit (100) to the number of shards returned per call and a low default TPS limit of 10.
`listShards` returns the info for at most 1000 shards and has a higher TPS limit of 100 as well.

Key changed/added classes in this PR
 * `KinesisRecordSupplier`
 * `KinesisAdminClient`

2022-01-21 10:15:51 +05:30

..

src

Mitigate Kinesis stream LimitExceededException by using listShards API (#12161)

2022-01-21 10:15:51 +05:30

pom.xml

bump version to 0.23.0-SNAPSHOT (#11670)

2021-09-08 15:56:04 -07:00