对 Kafka 数据载入 页面中的摘要部分进行翻译

This commit is contained in:
YuCheng Hu 2021-08-09 10:26:08 -04:00
parent 461bad9659
commit 6818215f83
1 changed files with 10 additions and 42 deletions

View File

@ -1,42 +1,16 @@
--- # Kafka 数据载入
id: kafka-ingestion Kafka 索引服务Kafka indexing service将会在 Overlord 上启动并配置 *supervisors*
title: "Apache Kafka ingestion" supervisors 通过管理 Kafka 索引任务的创建和销毁的生命周期以便于从 Kafka 中载入数据。
sidebar_label: "Apache Kafka" 这些索引任务使用Kafka自己的分区和偏移机制读取事件因此能够保证只读取一次exactly-once
---
<!-- supervisor 对索引任务的状态进行监控,以便于对任务进行扩展或切换,故障管理等操作。
~ Licensed to the Apache Software Foundation (ASF) under one
~ or more contributor license agreements. See the NOTICE file
~ distributed with this work for additional information
~ regarding copyright ownership. The ASF licenses this file
~ to you under the Apache License, Version 2.0 (the
~ "License"); you may not use this file except in compliance
~ with the License. You may obtain a copy of the License at
~
~ http://www.apache.org/licenses/LICENSE-2.0
~
~ Unless required by applicable law or agreed to in writing,
~ software distributed under the License is distributed on an
~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
~ KIND, either express or implied. See the License for the
~ specific language governing permissions and limitations
~ under the License.
-->
这个服务是由 `druid-kafka-indexing-service` 这个 druid 核心扩展(详情请见 [扩展列表](../../development/extensions.md)提供的。
The Kafka indexing service enables the configuration of *supervisors* on the Overlord, which facilitate ingestion from > [!WARNING]
Kafka by managing the creation and lifetime of Kafka indexing tasks. These indexing tasks read events using Kafka's own > Kafka索引服务支持在 Kafka 0.11.x 中开始使用的事务主题。这些更改使 Druid 使用的 Kafka 消费者与旧的 Kafka brokers 不兼容。
partition and offset mechanism and are therefore able to provide guarantees of exactly-once ingestion. > 在使用 Druid 从 Kafka中导入数据之前请确保你的 Kafka 版本为 0.11.x 或更高版本。
The supervisor oversees the state of the indexing tasks to coordinate handoffs, > 如果你使用的是旧版本的 Kafka brokers请参阅《 [Kafka升级指南](https://kafka.apache.org/documentation/#upgrade) 》中的内容先进行升级。
manage failures, and ensure that the scalability and replication requirements are maintained.
This service is provided in the `druid-kafka-indexing-service` core Apache Druid extension (see
[Including Extensions](../../development/extensions.md#loading-extensions)).
> The Kafka indexing service supports transactional topics which were introduced in Kafka 0.11.x. These changes make the
> Kafka consumer that Druid uses incompatible with older brokers. Ensure that your Kafka brokers are version 0.11.x or
> better before using this functionality. Refer [Kafka upgrade guide](https://kafka.apache.org/documentation/#upgrade)
> if you are using older version of Kafka brokers.
## Tutorial ## Tutorial
@ -419,12 +393,6 @@ Hadoop (see [here](https://github.com/apache/druid/pull/5102)).
## Apache Kafka 摄取数据 ## Apache Kafka 摄取数据
Kafka索引服务支持在Overlord上配置*supervisors*supervisors通过管理Kafka索引任务的创建和生存期来便于从Kafka摄取数据。这些索引任务使用Kafka自己的分区和偏移机制读取事件因此能够保证只接收一次**exactly-once**。supervisor监视索引任务的状态以便于协调切换、管理故障并确保维护可伸缩性和复制要求。
这个服务由 `druid-kafka-indexing-service` 这个druid核心扩展详情请见 [扩展列表](../Development/extensions.md所提供。
> [!WARNING]
> Kafka索引服务支持在Kafka 0.11.x中引入的事务主题。这些更改使Druid使用的Kafka消费者与旧的brokers不兼容。在使用此功能之前请确保您的Kafka broker版本为0.11.x或更高版本。如果您使用的是旧版本的Kafka brokers请参阅《[Kafka升级指南](https://kafka.apache.org/documentation/#upgrade)》。
### 教程 ### 教程