druid/.github/workflows
Rishabh Singh 8c802e4c9b
Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985)
In the current design, brokers query both data nodes and tasks to fetch the schema of the segments they serve. The table schema is then constructed by combining the schemas of all segments within a datasource. However, this approach leads to a high number of segment metadata queries during broker startup, resulting in slow startup times and various issues outlined in the design proposal.

To address these challenges, we propose centralizing the table schema management process within the coordinator. This change is the first step in that direction. In the new arrangement, the coordinator will take on the responsibility of querying both data nodes and tasks to fetch segment schema and subsequently building the table schema. Brokers will now simply query the Coordinator to fetch table schema. Importantly, brokers will still retain the capability to build table schemas if the need arises, ensuring both flexibility and resilience.
2023-11-04 19:33:25 +05:30
..
codeql-config.yml Add CodeQL workflow (#13477) 2022-12-21 09:24:39 +05:30
codeql.yml Configure caching for static-check actions (#15010) 2023-09-20 14:11:39 -07:00
cron-job-its.yml run some integration tests with Java 21 (#15104) 2023-10-20 11:18:13 +08:00
labeler.yml gha: add auto labeler for doc prs (#13791) 2023-02-16 12:05:34 +05:30
reusable-revised-its.yml run some integration tests with Java 21 (#15104) 2023-10-20 11:18:13 +08:00
reusable-standard-its.yml run some integration tests with Java 21 (#15104) 2023-10-20 11:18:13 +08:00
reusable-unit-tests.yml run build and unit tests using Java 21 (#15088) 2023-10-06 12:45:07 -07:00
revised-its.yml Skip tests based on files changed in the PR (#14445) 2023-06-22 12:27:23 +05:30
stale.yml Fix exempt labels in stale.yml (#14733) 2023-08-02 17:12:18 +05:30
standard-its.yml Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985) 2023-11-04 19:33:25 +05:30
static-checks.yml run build and unit tests using Java 21 (#15088) 2023-10-06 12:45:07 -07:00
unit-and-integration-tests-unified.yml Fix GHA workflow bugs (#15138) 2023-10-12 21:25:57 +05:30
unit-tests.yml Skip tests based on files changed in the PR (#14445) 2023-06-22 12:27:23 +05:30