druid/docs/development
Atul Mohan 03d6d395a0
Extension to read and ingest iceberg data files (#14329)
This adds a new contrib extension: druid-iceberg-extensions which can be used to ingest data stored in Apache Iceberg format. It adds a new input source of type iceberg that connects to a catalog and retrieves the data files associated with an iceberg table and provides these data file paths to either an S3 or HDFS input source depending on the warehouse location.

Two important dependencies associated with Apache Iceberg tables are:

Catalog : This extension supports reading from either a Hive Metastore catalog or a Local file-based catalog. Support for AWS Glue is not available yet.
Warehouse : This extension supports reading data files from either HDFS or S3. Adapters for other cloud object locations should be easy to add by extending the AbstractInputSourceAdapter.
2023-07-18 08:59:57 +05:30
..
extensions-contrib Extension to read and ingest iceberg data files (#14329) 2023-07-18 08:59:57 +05:30
extensions-core Change default handoffConditionTimeout to 15 minutes. (#14539) 2023-07-13 13:17:14 -07:00
build.md Update Hadoop3 as default build version (#14005) 2023-04-26 12:52:51 +05:30
docs-contribute.md docs: add basic contributor guide for docs (#14365) 2023-06-05 10:53:17 -07:00
experimental-features.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
experimental.md
javascript.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
modules.md Various documentation updates. (#13107) 2022-09-16 21:58:11 -07:00
overview.md Fix a broken link in the development doc (#11226) 2021-05-10 16:14:06 +08:00
versioning.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00