druid/docs/content/ingestion
Jihoon Son 241efafbb2
Automatic compaction by coordinators (#5102)
* Automatic compaction by coordinator

* add links

* skip compaction for very recent segments if they are small

* fix finding search interval

* fix finding search interval

* fix TimelineHolder iteration

* add test for newestSegmentFirstPolicy

* add CompactionSegmentIterator

* add numTargetCompactionSegments

* add missing config

* fix skipping huge shards

* fix handling large number of segments per shard

* fix test failure

* change recursive call to loop

* fix logging

* fix build

* fix test failure

* address comments

* change dataSources type

* check running pendingTasks at each run

* fix test

* address comments

* fix build

* fix test

* address comments

* address comments

* add doc for segment size optimization

* address comment
2018-01-13 13:52:37 +09:00
..
batch-ingestion.md Update batch-ingestion.md (#4963) 2017-10-18 16:44:09 -07:00
command-line-hadoop-indexer.md add doc rendering 2016-02-04 14:21:59 -08:00
data-formats.md Add support for headers and skipping thereof for CSV and TSV (#4254) 2017-05-15 22:57:31 -07:00
faq.md new quickstart 2016-02-04 09:37:38 -08:00
firehose.md Add compaction task (#4985) 2017-11-03 21:55:27 -06:00
flatten-json.md Add jq expression support in flattenSpec (#4171) 2017-09-12 14:18:34 -05:00
index.md Add flattenSpec support to the Avro parser. (#4832) 2017-09-26 09:26:06 -07:00
schema-changes.md more docs for common questions 2015-08-25 17:49:04 -07:00
schema-design.md Adding double colums supports (#4491) 2017-07-20 10:14:14 +03:00
stream-ingestion.md add doc rendering 2016-02-04 14:21:59 -08:00
stream-pull.md Automatic compaction by coordinators (#5102) 2018-01-13 13:52:37 +09:00
stream-push.md Automatic compaction by coordinators (#5102) 2018-01-13 13:52:37 +09:00
tasks.md Replace IOPeon with SegmentWriteOutMedium; Improve buffer compression (#4762) 2017-12-04 18:04:27 -08:00
update-existing-data.md Remove "granularity" from IngestSegmentFirehose. (#4110) 2017-03-24 10:28:54 -07:00