druid/docs/ingestion
Lucas Capistrant 8264203cee
Allow client to configure batch ingestion task to wait to complete until segments are confirmed to be available by other (#10676)
* Add ability to wait for segment availability for batch jobs

* IT updates

* fix queries in legacy hadoop IT

* Fix broken indexing integration tests

* address an lgtm flag

* spell checker still flagging for hadoop doc. adding under that file header too

* fix compaction IT

* Updates to wait for availability method

* improve unit testing for patch

* fix bad indentation

* refactor waitForSegmentAvailability

* Fixes based off of review comments

* cleanup to get compile after merging with master

* fix failing test after previous logic update

* add back code that must have gotten deleted during conflict resolution

* update some logging code

* fixes to get compilation working after merge with master

* reset interrupt flag in catch block after code review pointed it out

* small changes following self-review

* fixup some issues brought on by merge with master

* small changes after review

* cleanup a little bit after merge with master

* Fix potential resource leak in AbstractBatchIndexTask

* syntax fix

* Add a Compcation TuningConfig type

* add docs stipulating the lack of support by Compaction tasks for the new config

* Fixup compilation errors after merge with master

* Remove erreneous newline
2021-04-08 21:03:00 -07:00
..
compaction.md Allow client to configure batch ingestion task to wait to complete until segments are confirmed to be available by other (#10676) 2021-04-08 21:03:00 -07:00
data-formats.md Add config and header support for confluent schema registry. (#10314) 2021-02-27 14:25:35 -08:00
data-management.md First refactor of compaction (#10935) 2021-03-24 11:41:44 -07:00
faq.md remove outdated info from faq (#11053) 2021-04-01 08:13:29 -07:00
hadoop.md Allow client to configure batch ingestion task to wait to complete until segments are confirmed to be available by other (#10676) 2021-04-08 21:03:00 -07:00
index.md First refactor of compaction (#10935) 2021-03-24 11:41:44 -07:00
native-batch.md Allow client to configure batch ingestion task to wait to complete until segments are confirmed to be available by other (#10676) 2021-04-08 21:03:00 -07:00
schema-design.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
standalone-realtime.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
tasks.md First refactor of compaction (#10935) 2021-03-24 11:41:44 -07:00
tranquility.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00