Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
druid/extensions-core
History
Tejaswini Bandlamudi bf10ff73a8
Fixes Kafka Supervisor Lag Report (#13380) 
Fixes inclusion of all stream partitions in all tasks.

The PR (Adds Idle feature to `SeekableStreamSupervisor` for inactive stream) - https://github.com/apache/druid/pull/13144 updates the resulting lag calculation map in `KafkaSupervisor` to include all the latest partitions from the stream to set the idle state accordingly rather than the previous way of lag calculation only for the partitions actively being read from the stream. This led to an explosion of metrics in lag reports in cases where 1000s of tasks per supervisor are present.

Changes:
- Add a new method to generate lags for only those partitions a single task is actively reading from while updating the Supervisor reports.
 		2022-11-17 22:24:45 +05:30
..
avro-extensions nested column support for Parquet and Avro (#13325) 2022-11-14 16:09:05 -08:00
azure-extensions Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects (#13027) 2022-11-10 23:46:40 -08:00
datasketches fix complex_decode_base64 function, add SQL bindings (#13332) 2022-11-09 23:40:25 -08:00
druid-aws-rds-extensions Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
druid-basic-security Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
druid-bloom-filter Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
druid-catalog Druid Catalog basics (#13165) 2022-11-12 15:30:22 -08:00
druid-kerberos Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
druid-pac4j Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
druid-ranger-security Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
ec2-extensions Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
google-extensions Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects (#13027) 2022-11-10 23:46:40 -08:00
hdfs-storage Lazy initialization of segment killers, movers and archivers (#13170) 2022-10-04 15:55:46 +05:30
histogram Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
kafka-extraction-namespace Dependency cleanup (#13194) 2022-10-10 20:34:38 +08:00
kafka-indexing-service Fixes Kafka Supervisor Lag Report (#13380) 2022-11-17 22:24:45 +05:30
kinesis-indexing-service Add taskActionType dimension to task/action/run/time. (#13333) 2022-11-11 12:00:08 +05:30
kubernetes-extensions Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
lookups-cached-global Use lookup memory footprint in MSQ memory computations. (#13271) 2022-11-03 07:36:54 -07:00
lookups-cached-single Use lookup memory footprint in MSQ memory computations. (#13271) 2022-11-03 07:36:54 -07:00
multi-stage-query Add a limit to the number of columns in the CLUSTERED BY clause (#13352) 2022-11-15 22:05:15 +05:30
mysql-metadata-storage Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
orc-extensions introduce a "tree" type to the flattenSpec (#12177) 2022-11-01 14:49:30 +08:00
parquet-extensions nested column support for Parquet and Avro (#13325) 2022-11-14 16:09:05 -08:00
postgresql-metadata-storage Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
protobuf-extensions Add inline descriptor Protobuf bytes decoder (#13192) 2022-10-11 13:37:28 -05:00
s3-extensions Use standard library to correctly glob and stop at the correct folder structure when filtering cloud objects (#13027) 2022-11-10 23:46:40 -08:00
simple-client-sslcontext Bump up the version to 25.0.0 (#12975) 2022-08-29 11:27:38 +05:30
stats Enhancements to the Calcite test framework (#13283) 2022-11-08 14:28:49 -08:00
testing-tools more consistent expression error messages (#12995) 2022-09-06 23:21:38 -07:00