druid/docs
Atul Mohan 03d6d395a0
Extension to read and ingest iceberg data files (#14329)
This adds a new contrib extension: druid-iceberg-extensions which can be used to ingest data stored in Apache Iceberg format. It adds a new input source of type iceberg that connects to a catalog and retrieves the data files associated with an iceberg table and provides these data file paths to either an S3 or HDFS input source depending on the warehouse location.

Two important dependencies associated with Apache Iceberg tables are:

Catalog : This extension supports reading from either a Hive Metastore catalog or a Local file-based catalog. Support for AWS Glue is not available yet.
Warehouse : This extension supports reading data files from either HDFS or S3. Adapters for other cloud object locations should be easy to add by extending the AbstractInputSourceAdapter.
2023-07-18 08:59:57 +05:30
..
_bin De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00
api-reference Tasks API documentation refactor (#14492) 2023-07-11 13:19:39 -07:00
assets Fixup data deletion tutorial docs (#14283) 2023-05-17 17:05:35 -07:00
comparisons remove ref to plywood repo (#12809) 2022-07-26 10:12:13 +08:00
configuration Cross reference backpressure info (#14508) 2023-07-12 10:02:04 -07:00
data-management API reference refactor (#14372) 2023-06-26 15:48:54 -07:00
design Update slack text (#14578) 2023-07-12 12:08:48 -07:00
development Extension to read and ingest iceberg data files (#14329) 2023-07-18 08:59:57 +05:30
ingestion Extension to read and ingest iceberg data files (#14329) 2023-07-18 08:59:57 +05:30
misc Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
multi-stage-query Remove the deprecated `InsertCannotOrderByDescending` MSQ fault (#14588) 2023-07-17 09:23:39 +00:00
operations Add ZooKeeper connection state alerts and metrics. (#14333) 2023-07-12 09:34:28 -07:00
querying Add `aggregatorMergeStrategy` property in SegmentMetadata queries (#14560) 2023-07-13 12:37:36 -04:00
tutorials Update Jupyter notebook tutorial instructions for ARM devices (#14459) 2023-07-11 10:01:20 -07:00