Apache
/
druid
mirror of https://github.com/apache/druid.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
druid/docs/content/ingestion
History
David Glasser 4e23c11345 Make IngestSegmentFirehoseFactory splittable for parallel ingestion (#7048) 
* Make IngestSegmentFirehoseFactory splittable for parallel ingestion

* Code review feedback

- Get rid of WindowedSegment
- Don't document 'segments' parameter or support splitting firehoses that use it
- Require 'intervals' in WindowedSegmentId (since it won't be written by hand)

* Add missing @JsonProperty

* Integration test passes

* Add unit test

* Remove two FIXME comments from CompactionTask

I'd like to leave this PR in a potentially mergeable state, but I still would
appreciate reviewer eyes on the questions I'm removing here.

* Updates from code review
 		2019-04-02 14:59:17 -07:00
..
batch-ingestion.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
command-line-hadoop-indexer.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
compaction.md Add support maxRowsPerSegment for auto compaction (#6780) 2019-01-10 09:50:14 -08:00
data-formats.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
delete-data.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
faq.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
firehose.md Make IngestSegmentFirehoseFactory splittable for parallel ingestion (#7048) 2019-04-02 14:59:17 -07:00
flatten-json.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
hadoop-vs-native-batch.md Fix supported file formats for Hadoop vs Native batch doc (#7069) 2019-02-28 19:44:45 -08:00
hadoop.md Deprecate NoneShardSpec and drop support for automatic segment merge (#6883) 2019-03-15 23:29:25 -07:00
index.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
ingestion-spec.md index_parallel: support !appendToExisting with no explicit intervals (#7046) 2019-02-20 10:54:26 -08:00
locking-and-priority.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
misc-tasks.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
native_tasks.md Make IngestSegmentFirehoseFactory splittable for parallel ingestion (#7048) 2019-04-02 14:59:17 -07:00
reports.md Add missing redirects and fix broken links (#7213) 2019-03-09 15:16:23 -08:00
schema-changes.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
schema-design.md lol (#6985) 2019-02-01 14:21:13 -08:00
stream-ingestion.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
stream-pull.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
stream-push.md Reword 'node' to 'process' (#7172) 2019-02-28 18:10:39 -08:00
tasks.md Add doc for Hadoop-based ingestion vs Native batch ingestion (#7044) 2019-02-13 11:23:08 -08:00
transform-spec.md Front Matter header needs to be on the first line for md to be rendered properly by jekyll (#6733) 2018-12-13 11:47:20 -08:00
update-existing-data.md Add master/data/query server concepts to docs/packaging (#6916) 2019-01-30 19:41:07 -08:00