druid/extensions-core
Adithya Chakilam a7dd436a32
Check if supervisor could be idle on startup (#16844)
Fixes #13936 

In cases where a supervisor is idle and the overlord is restarted for some reason, the supervisor would
start spinning tasks again. In clusters where there are many low throughput streams, this would spike
the task count unnecessarily.

This commit compares the latest stream offset with the ones in metadata during the startup of supervisor
and sets it to idle state if they match.
2024-08-09 14:42:48 +05:30
..
avro-extensions Better error handling when retrieving Avro schemas from registry (#16684) 2024-07-02 16:48:34 -07:00
azure-extensions remove Firehose and FirehoseFactory (#16758) 2024-07-19 14:37:21 -07:00
datasketches Quidem record (#16624) 2024-08-05 14:58:32 +02:00
druid-aws-rds-extensions Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
druid-basic-security Fix excessive logging from druid-basic-security (#16767) 2024-07-22 08:33:00 +05:30
druid-bloom-filter Quidem record (#16624) 2024-08-05 14:58:32 +02:00
druid-catalog Quidem record (#16624) 2024-08-05 14:58:32 +02:00
druid-kerberos Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
druid-pac4j Remove index_realtime and index_realtime_appenderator tasks (#16602) 2024-06-24 20:13:33 -07:00
druid-ranger-security Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
ec2-extensions Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
google-extensions Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
hdfs-storage Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
histogram Quidem record (#16624) 2024-08-05 14:58:32 +02:00
kafka-extraction-namespace Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
kafka-indexing-service Check if supervisor could be idle on startup (#16844) 2024-08-09 14:42:48 +05:30
kinesis-indexing-service Kinesis Input Format for timestamp, and payload parsing (#16813) 2024-08-02 08:48:44 -04:00
kubernetes-extensions #16717 defer provider instantiation in Kubernetes Module (#16726) 2024-07-16 13:05:28 -07:00
lookups-cached-global upgrade mysql:mysql-connector-java to 8.2.0 (#16024) 2024-05-06 21:58:37 +08:00
lookups-cached-single upgrade mysql:mysql-connector-java to 8.2.0 (#16024) 2024-05-06 21:58:37 +08:00
multi-stage-query Add ability to run MSQ in Quidem tests (#16798) 2024-08-08 06:37:06 +02:00
mysql-metadata-storage remove Firehose and FirehoseFactory (#16758) 2024-07-19 14:37:21 -07:00
orc-extensions Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
parquet-extensions Refactor: Clean up `DecimalParquetInputTest` using Assume (#16436) 2024-05-14 21:13:07 +05:30
postgresql-metadata-storage remove Firehose and FirehoseFactory (#16758) 2024-07-19 14:37:21 -07:00
protobuf-extensions Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
s3-extensions Reduce logging in RetryableS3OutputStream (#16853) 2024-08-08 10:42:40 +05:30
simple-client-sslcontext Prepare master branch for 31.0.0 release (#16333) 2024-04-26 09:22:43 +05:30
stats Quidem record (#16624) 2024-08-05 14:58:32 +02:00
testing-tools Quidem record (#16624) 2024-08-05 14:58:32 +02:00