Parag Jain cb03efeb14 Kafka Index Task that supports Incremental handoffs (#4815) ...

* Kafka Index Task that supports Incremental handoffs
- Incrementally handoff segments when they hit maxRowsPerSegment limit
- Decouple segment partitioning from Kafka partitioning, all records from consumed partitions go to a single druid segment
- Support for restoring task on middle manager restarts by check pointing end offsets for segments

* take care of review comments

* make getCurrentOffsets call async, keep track of publishing sequence, review comments

* fix setEndoffset duplicate request handling, formatting

* fix unit test

* backward compatibility

* make AppenderatorDriverMetadata backwards compatible

* add unit test

* fix deadlock between persist and push executors in AppenderatorImpl

* fix formatting

* use persist dir instead of work dir

* review comments

* fix deadlock

* actually fix deadlock

2017-11-17 16:05:20 -06:00

..

approximate-histograms.md

refactor extensions into their own docs

2016-03-22 18:54:10 -07:00

avro.md

Add flattenSpec support to the Avro parser. (#4832)

2017-09-26 09:26:06 -07:00

datasketches-aggregators.md

Fix broken DataSketches link. (#4221)

2017-04-27 17:37:12 -07:00

druid-kerberos.md

Fix kerberos authenticator docs (#4822)

2017-09-19 14:32:22 -05:00

druid-lookups.md

Cached lookup module. first cut implementing JDBC cache (#2819)

2016-09-16 13:45:54 -07:00

examples.md

refactor extensions into their own docs

2016-03-22 18:54:10 -07:00

hdfs.md

Adding hadoop kerberos authentification. (#3419)

2016-09-13 10:42:50 -07:00

kafka-eight-firehose.md

refactor extensions into their own docs

2016-03-22 18:54:10 -07:00

kafka-extraction-namespace.md

Silly Typo in docs

2016-05-24 13:31:58 -07:00

kafka-ingestion.md

Kafka Index Task that supports Incremental handoffs (#4815)

2017-11-17 16:05:20 -06:00

lookups-cached-global.md

Add namespace extraction thread config (#4833)

2017-09-25 09:52:36 -07:00

mysql.md

Fix various broken links in the docs. (#2833)

2016-04-13 13:30:01 -07:00

postgresql.md

refactor extensions into their own docs

2016-03-22 18:54:10 -07:00

protobuf.md

Protobuf extension (#4039)

2017-05-30 13:11:58 -07:00

s3.md

Add support for HttpFirehose (#4297)

2017-05-25 16:13:04 -05:00

simple-client-sslcontext.md

TLS support (#4270)

2017-07-06 17:40:12 -07:00

stats.md

Support variance and standard deviation (#2525)

2016-08-04 17:32:58 -07:00

test-stats.md

adding new post aggregators for test statistics to druid-stats extension (#4532)

2017-10-09 23:43:27 -07:00