druid/docs/operations
Rishabh Singh e30790e013
Introduce Segment Schema Publishing and Polling for Efficient Datasource Schema Building (#15817)
Issue: #14989

The initial step in optimizing segment metadata was to centralize the construction of datasource schema in the Coordinator (#14985). Thereafter, we addressed the problem of publishing schema for realtime segments (#15475). Subsequently, our goal is to eliminate the requirement for regularly executing queries to obtain segment schema information.

This is the final change which involves publishing segment schema for finalized segments from task and periodically polling them in the Coordinator.
2024-04-24 22:22:53 +05:30
..
alerts.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
auth-ldap.md docs: LDAP trust store property clarification (#15028) 2023-11-02 13:00:08 -07:00
auth.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
basic-cluster-tuning.md Update basic-cluster-tuning.md (#14964) 2024-02-28 09:48:20 +08:00
clean-metadata-store.md Set default `KillUnusedSegments` duty to coordinator's indexing period & `killTaskSlotRatio` to 0.1 (#16247) 2024-04-14 18:56:17 -07:00
deep-storage-migration.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
dump-segment.md update the doc for dump-segment tool when using jdk11+ (#15971) 2024-02-28 09:40:10 +08:00
durable-storage.md Add MSQ Durable Storage Connector for Google Cloud Storage and change current Google Cloud Storage client library (#15398) 2023-12-14 07:34:49 +05:30
dynamic-config-provider.md [Docs] Refactor streaming ingestion section (#15591) 2024-02-12 13:52:42 -08:00
export-metadata.md Update Kafka loading docs to use the streaming data loader (#8544) 2019-09-22 15:00:52 -07:00
high-availability.md fixes web console introduction and addresses linking issues (#11609) 2021-08-18 08:37:05 -07:00
http-compression.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
insert-segment-to-db.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
java.md Claim full support for Java 17. (#14384) 2023-07-07 12:52:35 -07:00
kubernetes.md Update kubernetes.md (#13858) 2023-02-28 11:20:24 -08:00
metadata-migration.md Clean up after add kill bufferPeriod (#14868) 2023-08-19 00:00:04 +05:30
metrics.md Introduce Segment Schema Publishing and Polling for Efficient Datasource Schema Building (#15817) 2024-04-24 22:22:53 +05:30
migrate-from-firehose-ingestion.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
mixed-workloads.md Enable query request queuing by default when total laning is turned on. (#15440) 2024-01-09 07:54:26 +05:30
other-hadoop.md Removes support for Hadoop 2 (#14763) 2023-08-09 17:47:52 +05:30
password-provider.md Security overview documentation (#10339) 2020-11-19 15:24:58 -08:00
pull-deps.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
request-logging.md Add sql planning time metric (#12923) 2022-08-22 11:09:44 +05:30
reset-cluster.md Update reset-cluster.md (#10990) 2021-03-29 20:38:35 -07:00
rolling-updates.md docs: clean up some rolling updates stuff (#15762) 2024-01-26 14:10:53 -08:00
rule-configuration.md Update retention rules doc (#15439) 2023-12-05 09:53:17 -08:00
security-overview.md remove references to Jupyter notebooks within the Druid repo (#15143) 2023-11-01 13:17:06 -07:00
security-user-auth.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
segment-optimization.md Docs: Fix spelling of 5 GB. (#16040) 2024-03-04 22:37:38 -08:00
single-server.md Docs: reword single server page (#13659) 2023-01-11 21:12:52 -08:00
tls-support.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
use_sbt_to_build_fat_jar.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
web-console.md docs: Anchor link checker (#15624) 2024-01-08 15:19:05 -08:00