v4.3.0·Delta Lake 4.3.0
Summary
Databricks practitioners can now use Unity Catalog as the source of truth for managed Delta tables via the new UC Delta REST API integration. New DataFrame APIs, `replaceOn` and `replaceUsing`, allow for selective data replacement within Delta tables.
Summary generated by brickster.ai. For the full changelog and any code/binary attachments, follow the GitHub link above.
More from delta-io/delta
Delta Lake 4.2.0
This release enhances Unity Catalog managed tables with support for REPLACE TABLE, RTAS, Dynamic Partition Overwrite, and improved streaming read options like startingTimestamp. It also introduces general availability for Variant columns and new support for Geospatial and Collations table features.
Delta Lake 4.1.0
Delta Lake 4.1.0 introduces enhanced support for Unity Catalog managed tables, including batch/streaming read/write and conflict-free enablement of Deletion Vectors and Column Mapping. It also requires Java 17 and Spark 4.0.1+, dropping support for Spark 3.5, and blocks manual VACUUM for catalog-managed tables.
Delta Lake 4.0.1
The "managed table" feature is renamed to `catalogManaged` and its associated Unity Catalog table ID property is updated, which is a breaking change. Unity Catalog now supports OAuth authentication for catalogs and allows creating UC-managed Delta tables where properties are sent to the UC server as the source of truth.
Delta Lake 4.0.0
Delta Lake 4.0 introduces preview support for catalog-managed tables, Delta Connect for Spark Connect, and the Variant data type for semi-structured data. It also allows dropping table features instantly without history truncation and graduates Type Widening from preview.