Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
druid/website
History
Clint Wylie 7aafcf8bca parallel broker merges on fork join pool (#8578) 
* sketch of broker parallel merges done in small batches on fork join pool

* fix non-terminating sequences, auto compute parallelism

* adjust benches

* adjust benchmarks

* now hella more faster, fixed dumb

* fix

* remove comments

* log.info for debug

* javadoc

* safer block for sequence to yielder conversion

* refactor LifecycleForkJoinPool into LifecycleForkJoinPoolProvider which wraps a ForkJoinPool

* smooth yield rate adjustment, more logs to help tune

* cleanup, less logs

* error handling, bug fixes, on by default, more parallel, more tests

* remove unused var

* comments

* timeboundary mergeFn

* simplify, more javadoc

* formatting

* pushdown config

* use nanos consistently, move logs back to debug level, bit more javadoc

* static terminal result batch

* javadoc for nullability of createMergeFn

* cleanup

* oops

* fix race, add docs

* spelling, remove todo, add unhandled exception log

* cleanup, revert unintended change

* another unintended change

* review stuff

* add ParallelMergeCombiningSequenceBenchmark, fixes

* hyper-threading is the enemy

* fix initial start delay, lol

* parallelism computer now balances partition sizes to partition counts using sqrt of sequence count instead of sequence count by 2

* fix those important style issues with the benchmarks code

* lazy sequence creation for benchmarks

* more benchmark comments

* stable sequence generation time

* update defaults to use 100ms target time, 4096 batch size, 16384 initial yield, also update user docs

* add jmh thread based benchmarks, cleanup some stuff

* oops

* style

* add spread to jmh thread benchmark start range, more comments to benchmarks parameters and purpose

* retool benchmark to allow modeling more typical heterogenous heavy workloads

* spelling

* fix

* refactor benchmarks

* formatting

* docs

* add maxThreadStartDelay parameter to threaded benchmark

* why does catch need to be on its own line but else doesnt
 		2019-11-07 11:58:46 -08:00
..
core Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
i18n fix doc headers (#8729) 2019-10-24 11:17:39 -07:00
pages/en Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
script Add version to canonical URL (#8747) 2019-10-25 12:46:39 -07:00
scss Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
static Add 'edit' and 'copy code' buttons to docs (#8483) 2019-09-13 16:56:50 -07:00
.gitignore Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
.spelling parallel broker merges on fork join pool (#8578) 2019-11-07 11:58:46 -08:00
README.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
package-lock.json Update Kafka loading docs to use the streaming data loader (#8544) 2019-09-22 15:00:52 -07:00
package.json Spellcheck docs (#8548) 2019-09-17 12:47:30 -07:00
pom.xml add druid version correctly (#8586) 2019-09-24 18:19:06 -07:00
redirects.json merge recommendations into basic-cluster-tuning, add additional info (#8649) 2019-10-08 16:33:54 -07:00
sidebars.json merge recommendations into basic-cluster-tuning, add additional info (#8649) 2019-10-08 16:33:54 -07:00
siteConfig.js Fix download link in header links (#8600) 2019-09-26 18:06:12 -07:00

README.md

Druid doc builder

This website was created with Docusaurus.

To edit this documentation run:

npm install

Then run

npm start