druid/extensions-contrib/druid-deltalake-extensions/src/test
Abhishek Radhakrishnan aa833a711c
Support for reading Delta Lake table snapshots (#17004)
Problem
Currently, the delta input source only supports reading from the latest snapshot of the given Delta Lake table. This is a known documented limitation.

Description
Add support for reading Delta snapshot. By default, the Druid-Delta connector reads the latest snapshot of the Delta table in order to preserve compatibility. Users can specify a snapshotVersion to ingest change data events from Delta tables into Druid.

In the future, we can also add support for time-based snapshot reads. The Delta API to read time-based snapshots is not clear currently.
2024-09-09 14:12:48 +05:30
..
java/org/apache/druid/delta Support for reading Delta Lake table snapshots (#17004) 2024-09-09 14:12:48 +05:30
resources Support for reading Delta Lake table snapshots (#17004) 2024-09-09 14:12:48 +05:30