Apache/druid
1
0
Fork 0
mirror of https://github.com/apache/druid.git synced 2025-03-06 01:09:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
druid/extensions-core
History
AmatyaAvadhanula 1ec57cb935
Improve kinesis task assignment after resharding (#12235) 
Problem:
- When a kinesis stream is resharded, the original shards are closed.
   Any intermediate shard created in the process is eventually closed as well.
- If a shard is closed before any record is put into it, it can be safely ignored for ingestion.
- It is expensive to determine if a closed shard is empty, since it requires a call to the Kinesis cluster.

Changes:
- Maintain a cache of closed empty and closed non-empty shards in `KinesisSupervisor`
- Add config `skipIngorableShards` to `KinesisSupervisorTuningConfig`
- The caches are used and updated only when `skipIgnorableShards = true`
2022-02-18 12:37:06 +05:30
..
avro-extensions
Throw parse exceptions on schema get errors for SchemaRegistryBasedAvroBytesDecoder (#12080)
2022-01-13 12:36:51 -06:00
azure-extensions
Lazy instantiation for segmentKillers, segmentMovers, and segmentArchivers (#12207)
2022-02-08 13:02:06 -08:00
datasketches
allow optimizing sql expressions and virtual columns (#12241)
2022-02-09 14:55:50 -08:00
druid-aws-rds-extensions
bump version to 0.23.0-SNAPSHOT (#11670)
2021-09-08 15:56:04 -07:00
druid-basic-security
Fix classNotFoundException when connecting to secure LDAP (#11978)
2021-12-03 12:08:19 +05:30
druid-bloom-filter
allow optimizing sql expressions and virtual columns (#12241)
2022-02-09 14:55:50 -08:00
druid-kerberos
Support for hadoop 3 via maven profiles (#11794)
2021-10-30 22:46:24 +05:30
druid-pac4j
bump version to 0.23.0-SNAPSHOT (#11670)
2021-09-08 15:56:04 -07:00
druid-ranger-security
Support for hadoop 3 via maven profiles (#11794)
2021-10-30 22:46:24 +05:30
ec2-extensions
bump version to 0.23.0-SNAPSHOT (#11670)
2021-09-08 15:56:04 -07:00
google-extensions
Lazy instantiation for segmentKillers, segmentMovers, and segmentArchivers (#12207)
2022-02-08 13:02:06 -08:00
hdfs-storage
Lazy instantiation for segmentKillers, segmentMovers, and segmentArchivers (#12207)
2022-02-08 13:02:06 -08:00
histogram
allow optimizing sql expressions and virtual columns (#12241)
2022-02-09 14:55:50 -08:00
kafka-extraction-namespace
TestKafkaExtractionCluster: Shut down Kafka, ZK in @After. (#11963)
2021-11-20 15:17:05 -08:00
kafka-indexing-service
Fix infinite retrying during task pausing (#12167)
2022-01-19 09:03:36 +05:30
kinesis-indexing-service
Improve kinesis task assignment after resharding (#12235)
2022-02-18 12:37:06 +05:30
kubernetes-extensions
Remove CloseQuietly and migrate its usages to other methods. (#10247)
2021-10-23 17:03:21 -07:00
lookups-cached-global
Fix bad lookup config fails task (#12021)
2021-12-07 00:55:34 -05:00
lookups-cached-single
bump version to 0.23.0-SNAPSHOT (#11670)
2021-09-08 15:56:04 -07:00
mysql-metadata-storage
do not explode if mysql transient exception class does not exist (#12213)
2022-02-01 09:06:24 +05:30
orc-extensions
Update ORC to 1.7.2 (#12084)
2022-02-15 10:04:12 -08:00
parquet-extensions
Support JsonPath functions in JsonPath expressions (#11722)
2021-12-10 10:53:23 +08:00
postgresql-metadata-storage
bump version to 0.23.0-SNAPSHOT (#11670)
2021-09-08 15:56:04 -07:00
protobuf-extensions
Add parse error list API for stream supervisors, use structured object for parse exceptions, simplify parse exception message (#11961)
2021-12-09 15:42:55 -06:00
s3-extensions
Lazy instantiation for segmentKillers, segmentMovers, and segmentArchivers (#12207)
2022-02-08 13:02:06 -08:00
simple-client-sslcontext
bump version to 0.23.0-SNAPSHOT (#11670)
2021-09-08 15:56:04 -07:00
stats
allow optimizing sql expressions and virtual columns (#12241)
2022-02-09 14:55:50 -08:00
testing-tools
allow optimizing sql expressions and virtual columns (#12241)
2022-02-09 14:55:50 -08:00