druid/docs/development
Abhishek Radhakrishnan aa833a711c
Support for reading Delta Lake table snapshots (#17004)
Problem
Currently, the delta input source only supports reading from the latest snapshot of the given Delta Lake table. This is a known documented limitation.

Description
Add support for reading Delta snapshot. By default, the Druid-Delta connector reads the latest snapshot of the Delta table in order to preserve compatibility. Users can specify a snapshotVersion to ingest change data events from Delta tables into Druid.

In the future, we can also add support for time-based snapshot reads. The Delta API to read time-based snapshots is not clear currently.
2024-09-09 14:12:48 +05:30
..
extensions-contrib Support for reading Delta Lake table snapshots (#17004) 2024-09-09 14:12:48 +05:30
extensions-core Middle Manager wording update in docs (#17005) 2024-09-05 10:25:30 -07:00
build.md Updates build documentation to not mention explicit Java version as it was out of sync with the dedicated Java page. (#16674) 2024-07-03 20:53:15 +05:30
docs-contribute.md Update docs contribution with correct script (#16581) 2024-06-26 10:30:52 -07:00
experimental.md Docusaurus build framework + ingestion doc refresh. (#8311) 2019-08-20 21:48:59 -07:00
javascript.md cleaning up and fixing links (#10528) 2020-12-17 13:37:43 -08:00
modules.md docs: Correct some outdated module names (#16584) 2024-06-11 14:17:40 -07:00
overview.md remove Firehose and FirehoseFactory (#16758) 2024-07-19 14:37:21 -07:00
versioning.md De-incubation cleanup in code, docs, packaging (#9108) 2020-01-03 12:33:19 -05:00