druid

mirror of https://github.com/apache/druid.git synced 2025-02-10 03:55:02 +00:00

History

Abhishek Radhakrishnan aa833a711c

Support for reading Delta Lake table snapshots (#17004 )

Problem
Currently, the delta input source only supports reading from the latest snapshot of the given Delta Lake table. This is a known documented limitation.

Description
Add support for reading Delta snapshot. By default, the Druid-Delta connector reads the latest snapshot of the Delta table in order to preserve compatibility. Users can specify a snapshotVersion to ingest change data events from Delta tables into Druid.

In the future, we can also add support for time-based snapshot reads. The Delta API to read time-based snapshots is not clear currently.

2024-09-09 14:12:48 +05:30

extensions-contrib

Support for reading Delta Lake table snapshots (#17004 )

2024-09-09 14:12:48 +05:30

extensions-core

Middle Manager wording update in docs (#17005 )

2024-09-05 10:25:30 -07:00

build.md

Updates build documentation to not mention explicit Java version as it was out of sync with the dedicated Java page. (#16674 )

2024-07-03 20:53:15 +05:30

docs-contribute.md

Update docs contribution with correct script (#16581 )