druid/docs/ingestion
imply-cheddar aaa6cc1883
Make the tasks run with only a single directory (#14063)
* Make the tasks run with only a single directory

There was a change that tried to get indexing to run on multiple disks
It made a bunch of changes to how tasks run, effectively hiding the
"safe" directory for tasks to write files into from the task code itself
making it extremely difficult to do anything correctly inside of a task.

This change reverts those changes inside of the tasks and makes it so that
only the task runners are the ones that make decisions about which
mount points should be used for storing task-related files.

It adds the config druid.worker.baseTaskDirs which can be used by the
task runners to know which directories they should schedule tasks inside of.
The TaskConfig remains the authoritative source of configuration for where
and how an individual task should be operating.
2023-04-13 00:45:02 -07:00
..
data-formats.md Docs: updating Kafka input format docs (#14049) 2023-04-11 20:06:23 -07:00
data-model.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
faq.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
hadoop.md Fix some broken links in docs (#13968) 2023-03-24 10:48:23 -07:00
index.md Add missing MSQ error code fields to docs (#13308) 2022-11-10 21:03:04 +05:30
ingestion-spec.md actually backwards compatible frontCoded string encoding strategy (#13996) 2023-03-31 02:24:12 -07:00
migrate-from-firehose-ingestion.md docs: fix html nits (#13835) 2023-03-02 11:19:32 -08:00
native-batch-firehose.md Firehose migration doc (#12981) 2022-11-21 11:17:12 -08:00
native-batch-input-source.md pitfall when using combining input source (#13639) 2023-01-25 12:50:19 -08:00
native-batch-simple-task.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
native-batch.md Removes FiniteFirehoseFactory and its implementations (#12852) 2023-03-02 18:07:17 +05:30
partitioning.md Add missing MSQ error code fields to docs (#13308) 2022-11-10 21:03:04 +05:30
rollup.md Add missing MSQ error code fields to docs (#13308) 2022-11-10 21:03:04 +05:30
schema-design.md Update nested columns docs (#13461) 2022-12-01 10:47:32 -08:00
standalone-realtime.md Reduce visibility of Tranquility documentation (#11134) 2021-05-03 16:48:24 -07:00
tasks.md Make the tasks run with only a single directory (#14063) 2023-04-13 00:45:02 -07:00
tranquility.md Reduce visibility of Tranquility documentation (#11134) 2021-05-03 16:48:24 -07:00