druid/docs/multi-stage-query
Adarsh Sanjeev b7c661b801
Make tempStorageDirectory configuration optional and rely on task dir instead (#17015)
Currently, durable storage and export both require configuring a temporary directory to be used using druid.export.storage.<connectorType>.tempLocalDir and druid.msq.intermediate.storage.tempDir.

Tasks on middle manager already have a configured temporary directory. This PR aims to reduce the configuration required by using the task directory as a default if it is not explicitly configured, thus reducing the number of configs that a user has to set.

Please note that preference would be given to the user configured, druid.*.storage.temp*Dir, on the tasks. If that is not configured, we then use the configured temporary directory.

Overlord and brokers also require storage connector configurations (for the durableStorageCleanerOverlordDuty and to fetch results of async queries respectively), but do not have a default temporary task directory. The configuration is still required for these services.
2024-10-29 13:36:59 +05:30
..
concepts.md Segments sorted by non-time columns. (#16849) 2024-08-23 08:24:43 -07:00
examples.md docs: add note about finalizeaggregations for sql-based ingestion (#15631) 2024-01-08 10:06:10 -08:00
index.md Docusaurus2 upgrade for master (#14411) 2023-08-16 19:01:21 -07:00
known-issues.md docs: msq autocompaction (#16681) 2024-10-17 10:40:53 -07:00
reference.md Make tempStorageDirectory configuration optional and rely on task dir instead (#17015) 2024-10-29 13:36:59 +05:30
security.md Fix typo in security.md (#17413) 2024-10-25 13:43:58 -07:00