druid/docs/development/extensions-contrib
Atul Mohan 03d6d395a0
Extension to read and ingest iceberg data files (#14329)
This adds a new contrib extension: druid-iceberg-extensions which can be used to ingest data stored in Apache Iceberg format. It adds a new input source of type iceberg that connects to a catalog and retrieves the data files associated with an iceberg table and provides these data file paths to either an S3 or HDFS input source depending on the warehouse location.

Two important dependencies associated with Apache Iceberg tables are:

Catalog : This extension supports reading from either a Hive Metastore catalog or a Local file-based catalog. Support for AWS Glue is not available yet.
Warehouse : This extension supports reading data files from either HDFS or S3. Adapters for other cloud object locations should be easy to add by extending the AbstractInputSourceAdapter.
2023-07-18 08:59:57 +05:30
..
aliyun-oss-extensions.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
ambari-metrics-emitter.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
cassandra.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
cloudfiles.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
compressed-big-decimal.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
distinctcount.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
gce-extensions.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
graphite.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
iceberg.md Extension to read and ingest iceberg data files (#14329) 2023-07-18 08:59:57 +05:30
influx.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
influxdb-emitter.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
k8s-jobs.md docs: k8s-jobs role needs batch apigroup (#14343) 2023-07-04 14:34:20 +05:30
kafka-emitter.md Adding SegmentMetadataEvent and publishing them via KafkaEmitter (#14281) 2023-06-02 21:28:26 +05:30
materialized-view.md Make NodeRole available during binding; add support for dynamic registration of DruidService (#12012) 2021-12-03 11:59:00 -08:00
momentsketch-quantiles.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
moving-average-query.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
opentsdb-emitter.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
prometheus.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
redis-cache.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
sqlserver.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
statsd.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
tdigestsketch-quantiles.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
thrift.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00
time-min-max.md Update Ingestion section (#14023) 2023-05-19 09:42:27 -07:00