druid/docs
imply-cheddar aaa6cc1883
Make the tasks run with only a single directory (#14063)
* Make the tasks run with only a single directory

There was a change that tried to get indexing to run on multiple disks
It made a bunch of changes to how tasks run, effectively hiding the
"safe" directory for tasks to write files into from the task code itself
making it extremely difficult to do anything correctly inside of a task.

This change reverts those changes inside of the tasks and makes it so that
only the task runners are the ones that make decisions about which
mount points should be used for storing task-related files.

It adds the config druid.worker.baseTaskDirs which can be used by the
task runners to know which directories they should schedule tasks inside of.
The TaskConfig remains the authoritative source of configuration for where
and how an individual task should be operating.
2023-04-13 00:45:02 -07:00
..
_bin De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
assets Fix querying sql (#14026) 2023-04-06 14:50:06 -07:00
comparisons remove ref to plywood repo (#12809) 2022-07-26 10:12:13 +08:00
configuration Make the tasks run with only a single directory (#14063) 2023-04-13 00:45:02 -07:00
data-management Create update.md (#13451) 2023-01-25 16:23:40 -08:00
dependencies Zero-copy local deep storage. (#13394) 2022-12-12 17:28:24 -08:00
design Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
development Docs: updating Kafka input format docs (#14049) 2023-04-11 20:06:23 -07:00
ingestion Make the tasks run with only a single directory (#14063) 2023-04-13 00:45:02 -07:00
misc Various changes and fixes to UNNEST. (#13892) 2023-03-10 16:42:08 +05:30
multi-stage-query Frames: Ensure nulls are read as default values when appropriate. (#14020) 2023-04-10 05:28:46 +05:30
operations Add basic security functions to druidapi (follow up to #14009) (#14055) 2023-04-11 10:55:27 -07:00
querying docs: sql unnest and cleanup unnest datasource (#13736) 2023-04-04 13:07:54 -07:00
tutorials Remove unnecessary python topic. Style changes to quickstart. (#13647) 2023-04-07 09:55:52 -07:00