druid/docs/api-reference
Rishabh Singh 8c802e4c9b
Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985)
In the current design, brokers query both data nodes and tasks to fetch the schema of the segments they serve. The table schema is then constructed by combining the schemas of all segments within a datasource. However, this approach leads to a high number of segment metadata queries during broker startup, resulting in slow startup times and various issues outlined in the design proposal.

To address these challenges, we propose centralizing the table schema management process within the coordinator. This change is the first step in that direction. In the new arrangement, the coordinator will take on the responsibility of querying both data nodes and tasks to fetch segment schema and subsequently building the table schema. Brokers will now simply query the Coordinator to fetch table schema. Importantly, brokers will still retain the capability to build table schemas if the need arises, ensuring both flexibility and resilience.
2023-11-04 19:33:25 +05:30
..
api-reference.md API reference refactor (#14372) 2023-06-26 15:48:54 -07:00
automatic-compaction-api.md Automatic compaction API documentation refactor (#14740) 2023-08-21 11:34:41 -07:00
data-management-api.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
dynamic-configuration-api.md Dynamic configuration API documentation refactor (#15098) 2023-10-11 14:45:05 -07:00
json-querying-api.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
legacy-metadata-api.md Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985) 2023-11-04 19:33:25 +05:30
lookups-api.md API reference refactor (#14372) 2023-06-26 15:48:54 -07:00
retention-rules-api.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
service-status-api.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
sql-api.md docs: remove experimental note from query from deep storage docs (#15132) 2023-10-12 11:51:02 +05:30
sql-ingestion-api.md Add worker status and duration metrics in live and task reports (#15180) 2023-10-30 09:43:22 +05:30
sql-jdbc.md docs: add note about transparent_reconnection (#14953) 2023-09-11 11:58:39 -07:00
supervisor-api.md Reset offsets supervisor API (#14772) 2023-08-17 14:13:10 -07:00
tasks-api.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00