druid/docs
Samarth Jain afbcb9c07f Improve parallelism of zookeeper based segment change processing (#7088)
* V1 - improve parallelism of zookeeper based segment change processing

* Create zk nodes in batches. Address code review comments.
Introduce various configs.

* Add documentation for the newly added configs

* Fix test failures

* Fix more test failures

* Remove prinstacktrace statements

* Address code review comments

* Use a single queue

* Address code review comments

Since we have a separate load peon for every historical, just having a single SegmentChangeProcessor
task per historical is enough. This commit also gets rid of the associated config druid.coordinator.loadqueuepeon.curator.numCreateThreads

* Resolve merge conflict

* Fix compilation failure

* Remove batching since we already have a dynamic config maxSegmentsInNodeLoadingQueue that provides that control

* Fix NPE in test

* Remove documentation for configs that are no longer needed

* Address code review comments

* Address more code review comments

* Fix checkstyle issue

* Address code review comments

* Code review comments

* Add back monitor node remove executor

* Cleanup code to isolate null checks  and minor refactoring

* Change param name since it conflicts with member variable name
2019-05-03 15:58:42 +02:00
..
_bin Fix bugs in milestone contributor script (#7545) 2019-04-24 22:11:57 -07:00
_graphics add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00
_includes fix links to use relative references (#6696) 2018-11-30 16:32:10 -08:00
_layouts Update license headers. (#5976) 2018-07-11 09:55:18 -07:00
content Improve parallelism of zookeeper based segment change processing (#7088) 2019-05-03 15:58:42 +02:00
img Add master/data/query server concepts to docs/packaging (#6916) 2019-01-30 19:41:07 -08:00
_config.yml add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00
_redirects.json Add missing redirects and fix broken links (#7213) 2019-03-09 15:16:23 -08:00
index.html Update license headers. (#5976) 2018-07-11 09:55:18 -07:00