druid/.github
Rishabh Singh 8c802e4c9b
Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985)
In the current design, brokers query both data nodes and tasks to fetch the schema of the segments they serve. The table schema is then constructed by combining the schemas of all segments within a datasource. However, this approach leads to a high number of segment metadata queries during broker startup, resulting in slow startup times and various issues outlined in the design proposal.

To address these challenges, we propose centralizing the table schema management process within the coordinator. This change is the first step in that direction. In the new arrangement, the coordinator will take on the responsibility of querying both data nodes and tasks to fetch segment schema and subsequently building the table schema. Brokers will now simply query the Coordinator to fetch table schema. Importantly, brokers will still retain the capability to build table schemas if the need arises, ensuring both flexibility and resilience.
2023-11-04 19:33:25 +05:30
..
ISSUE_TEMPLATE Add 'Flaky test' issue template (#14394) 2023-06-11 19:02:38 -07:00
scripts Removes support for Hadoop 2 (#14763) 2023-08-09 17:47:52 +05:30
workflows Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985) 2023-11-04 19:33:25 +05:30
dependabot.yml increase dependabot PR limit for Java dependencies (#14804) 2023-08-14 19:51:59 -07:00
labeler.yml Tweak GHA runner label for MSQ (#14992) 2023-09-15 05:44:21 +00:00
pull_request_template.md Move the tips section in PR template into comments block (#13676) 2023-01-16 17:01:20 +05:30