From 026e2fdbf9ea9569967e88e446b544679a2c1f8a Mon Sep 17 00:00:00 2001 From: liujianhuan Date: Fri, 8 May 2020 18:52:44 +0800 Subject: [PATCH] hadoop ingest infra --- DataIngestion/hadoopbased.md | 28 ++++++++++++++++++++++++++-- 1 file changed, 26 insertions(+), 2 deletions(-) diff --git a/DataIngestion/hadoopbased.md b/DataIngestion/hadoopbased.md index 0bf7dcd..25fd696 100644 --- a/DataIngestion/hadoopbased.md +++ b/DataIngestion/hadoopbased.md @@ -1,5 +1,29 @@ ## 基于Hadoop的摄入 ### 教程 -### 任务符号 -#### `partitionsSpec` \ No newline at end of file +### 并行任务 +#### 任务符号 +##### `dataSchema` +##### `ioConfig` +##### `tuningConfig` +#### 分割提示规范 +##### `partitionsSpec` +#### HTTP状态接口 +#### 容量规划 +### 简单任务 +#### 任务符号 +##### `dataSchema` +##### `ioConfig` +##### `tuningConfig` +##### `partitionsSpec` +##### `segmentWriteOutMediumFactory` +#### 段推模式 +### 输入源 +#### S3输入源 +#### 谷歌云存储输入源 +#### Azure输入源 +#### HDFS输入源 +#### HTTP输入源 +#### Inline输入源 +#### Local输入源 +#### Druid输入源 \ No newline at end of file