druid/extensions-contrib
Rishabh Singh 8c802e4c9b
Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985)
In the current design, brokers query both data nodes and tasks to fetch the schema of the segments they serve. The table schema is then constructed by combining the schemas of all segments within a datasource. However, this approach leads to a high number of segment metadata queries during broker startup, resulting in slow startup times and various issues outlined in the design proposal.

To address these challenges, we propose centralizing the table schema management process within the coordinator. This change is the first step in that direction. In the new arrangement, the coordinator will take on the responsibility of querying both data nodes and tasks to fetch segment schema and subsequently building the table schema. Brokers will now simply query the Coordinator to fetch table schema. Importantly, brokers will still retain the capability to build table schemas if the need arises, ensuring both flexibility and resilience.
2023-11-04 19:33:25 +05:30
..
aliyun-oss-extensions Add system fields to input sources. (#15276) 2023-11-02 10:31:28 -07:00
ambari-metrics-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
cassandra-storage Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
cloudfiles-extensions Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
compressed-bigdecimal Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985) 2023-11-04 19:33:25 +05:30
distinctcount Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
dropwizard-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
druid-iceberg-extensions Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
gce-extensions Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
graphite-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
influx-extensions Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
influxdb-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
kafka-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
kubernetes-overlord-extensions Ability to send task types to k8s or worker task runner (#15196) 2023-10-25 09:55:56 -07:00
materialized-view-maintenance Filter pending segments upgraded with transactional replace (#15169) 2023-10-23 21:18:47 +05:30
materialized-view-selection Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985) 2023-11-04 19:33:25 +05:30
momentsketch Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
moving-average-query Use min of scheduler threads and server threads for subquery guardrails. (#15295) 2023-11-01 22:34:53 -07:00
opentelemetry-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
opentsdb-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
prometheus-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
redis-cache Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
sqlserver-metadata-storage Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
statsd-emitter Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
tdigestsketch Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985) 2023-11-04 19:33:25 +05:30
thrift-extensions Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
time-min-max Prepare master for Druid 29 (#15121) 2023-10-11 10:33:45 +05:30
virtual-columns sql compatible three-valued logic native filters (#15058) 2023-10-12 00:06:23 -07:00
README.md fix broken links (#9537) 2020-03-22 17:41:18 -07:00

README.md

Community Extensions

Please contribute all community extensions in this directory and include a doc of how your extension can be used under docs/development/extensions-contrib/.

Please note that community extensions are maintained by their original contributors and are not packaged with the core Druid distribution. If you'd like to take on maintenance for a community extension, please post on dev@druid.apache.org to let us know!