druid/extensions-contrib
Clint Wylie 7aafcf8bca parallel broker merges on fork join pool (#8578)
* sketch of broker parallel merges done in small batches on fork join pool

* fix non-terminating sequences, auto compute parallelism

* adjust benches

* adjust benchmarks

* now hella more faster, fixed dumb

* fix

* remove comments

* log.info for debug

* javadoc

* safer block for sequence to yielder conversion

* refactor LifecycleForkJoinPool into LifecycleForkJoinPoolProvider which wraps a ForkJoinPool

* smooth yield rate adjustment, more logs to help tune

* cleanup, less logs

* error handling, bug fixes, on by default, more parallel, more tests

* remove unused var

* comments

* timeboundary mergeFn

* simplify, more javadoc

* formatting

* pushdown config

* use nanos consistently, move logs back to debug level, bit more javadoc

* static terminal result batch

* javadoc for nullability of createMergeFn

* cleanup

* oops

* fix race, add docs

* spelling, remove todo, add unhandled exception log

* cleanup, revert unintended change

* another unintended change

* review stuff

* add ParallelMergeCombiningSequenceBenchmark, fixes

* hyper-threading is the enemy

* fix initial start delay, lol

* parallelism computer now balances partition sizes to partition counts using sqrt of sequence count instead of sequence count by 2

* fix those important style issues with the benchmarks code

* lazy sequence creation for benchmarks

* more benchmark comments

* stable sequence generation time

* update defaults to use 100ms target time, 4096 batch size, 16384 initial yield, also update user docs

* add jmh thread based benchmarks, cleanup some stuff

* oops

* style

* add spread to jmh thread benchmark start range, more comments to benchmarks parameters and purpose

* retool benchmark to allow modeling more typical heterogenous heavy workloads

* spelling

* fix

* refactor benchmarks

* formatting

* docs

* add maxThreadStartDelay parameter to threaded benchmark

* why does catch need to be on its own line but else doesnt
2019-11-07 11:58:46 -08:00
..
ambari-metrics-emitter Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
azure-extensions Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
cassandra-storage Remove commons-httpclient (#8407) 2019-09-27 02:14:58 -07:00
cloudfiles-extensions Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
distinctcount Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
dropwizard-emitter Fix jackson property name for dropwizardemitterconfig (#8691) 2019-10-22 14:40:19 -07:00
graphite-emitter Implementing dropwizard emitter for druid (#7363) 2019-10-01 14:59:30 -07:00
influx-extensions Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
influxdb-emitter Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
kafka-emitter Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
materialized-view-maintenance Fix ambiguity about IndexerSQLMetadataStorageCoordinator.getUsedSegmentsForInterval() returning only non-overshadowed or all used segments (#8564) 2019-11-06 11:07:04 -08:00
materialized-view-selection parallel broker merges on fork join pool (#8578) 2019-11-07 11:58:46 -08:00
momentsketch Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
moving-average-query parallel broker merges on fork join pool (#8578) 2019-11-07 11:58:46 -08:00
opentsdb-emitter Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
redis-cache Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
sqlserver-metadata-storage Fix dependency analyze warnings (#8230) 2019-09-09 14:37:21 -07:00
statsd-emitter Fix statsd types (#8628) 2019-10-06 14:14:09 -07:00
tdigestsketch Fix ambiguity about IndexerSQLMetadataStorageCoordinator.getUsedSegmentsForInterval() returning only non-overshadowed or all used segments (#8564) 2019-11-06 11:07:04 -08:00
thrift-extensions Bump Apache Thrift to 0.10.0 (#8419) 2019-11-05 15:38:50 -08:00
time-min-max remove select query (#8739) 2019-10-30 19:29:56 -07:00
virtual-columns remove select query (#8739) 2019-10-30 19:29:56 -07:00
README.md add missing license headers, in particular to MD files; clean up RAT … (#6563) 2018-11-13 09:38:37 -08:00

README.md

Community Extensions

Please contribute all community extensions in this directory and include a doc of how your extension can be used under /docs/content/development/extensions-contrib/.

Please note that community extensions are maintained by their original contributors and are not packaged with the core Druid distribution. If you'd like to take on maintenance for a community extension, please post on dev@druid.apache.org to let us know!