druid/integration-tests/script
Rishabh Singh 8c802e4c9b
Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985)
In the current design, brokers query both data nodes and tasks to fetch the schema of the segments they serve. The table schema is then constructed by combining the schemas of all segments within a datasource. However, this approach leads to a high number of segment metadata queries during broker startup, resulting in slow startup times and various issues outlined in the design proposal.

To address these challenges, we propose centralizing the table schema management process within the coordinator. This change is the first step in that direction. In the new arrangement, the coordinator will take on the responsibility of querying both data nodes and tasks to fetch segment schema and subsequently building the table schema. Brokers will now simply query the Coordinator to fetch table schema. Importantly, brokers will still retain the capability to build table schemas if the need arises, ensuring both flexibility and resilience.
2023-11-04 19:33:25 +05:30
..
build_run_k8s_cluster.sh Use K3S instead of minikube for integration tests (#13782) 2023-02-17 23:06:30 +05:30
copy_hadoop_resources.sh Fixing typos in docker build scripts (#11866) 2021-11-02 23:50:52 +05:30
copy_resources_template.sh Build reliablity fixes (#15048) 2023-09-28 12:27:52 -07:00
docker_build_containers.sh run some integration tests with Java 21 (#15104) 2023-10-20 11:18:13 +08:00
docker_compose_args.sh Relocating Table Schema Building: Shifting from Brokers to Coordinator for Improved Efficiency (#14985) 2023-11-04 19:33:25 +05:30
docker_run_cluster.sh Use Druid's extension loading for integration test instead of maven (#12095) 2022-01-05 23:33:04 -08:00
setup_druid_on_k8s.sh Use K3S instead of minikube for integration tests (#13782) 2023-02-17 23:06:30 +05:30
setup_druid_operator_on_k8s.sh add latest version of druid operator to integeration tests (#13883) 2023-03-10 16:11:25 +05:30
setup_k8s_cluster.sh Use K3S instead of minikube for integration tests (#13782) 2023-02-17 23:06:30 +05:30
stop_k8s_cluster.sh Use K3S instead of minikube for integration tests (#13782) 2023-02-17 23:06:30 +05:30