druid/extensions-core/kinesis-indexing-service/src
Gian Merlino a83125e4a0
Track IngestionState more accurately in realtime tasks. (#16934)
Previously, SeekableStreamIndexTaskRunner set ingestion state to
COMPLETED when it finished reading data from Kafka. This is incorrect.
After the changes in this patch, the transitions go:

1) The task stays in BUILD_SEGMENTS after it finishes reading from Kafka,
   while it is building its final set of segments to publish.

2) The task transitions to SEGMENT_AVAILABILITY_WAIT after publishing,
   while waiting for handoff.

3) The task transitions to COMPLETED immediately before exiting, when
   truly done.
2024-08-22 11:43:46 +05:30
..
main Kinesis Input Format for timestamp, and payload parsing (#16813) 2024-08-02 08:48:44 -04:00
test Track IngestionState more accurately in realtime tasks. (#16934) 2024-08-22 11:43:46 +05:30