v4.3.1·Delta Lake 4.3.1
Summary
This release fixes a bug in Delta REST Catalog authentication where OAuth config keys were incorrectly lowercased. It also enables fast S3A listing for OSS Unity Catalog and prevents `is_managed_location` from being persisted in Delta table metadata.
Summary generated by brickster.ai. For the full changelog and any code/binary attachments, follow the GitHub link above.
Topics
More from delta-io/delta
Delta Lake 4.3.0
Databricks practitioners can now integrate Spark with Unity Catalog's Delta REST API for managed Delta tables and selectively replace data using new `replaceOn` and `replaceUsing` DataFrame APIs. UniForm for Iceberg conversion is now atomic and incremental, and Delta Sharing supports streaming and Change Data Feed for shared tables.
Delta Lake 4.2.0
This release enhances Unity Catalog managed tables with support for REPLACE TABLE, RTAS, Dynamic Partition Overwrite, and improved streaming read options like startingTimestamp. It also introduces general availability for Variant columns and new Geospatial and Collations table features, alongside a new experimental Kernel-based Flink connector.
Delta Lake 4.1.0
Delta Lake 4.1.0 enhances Unity Catalog integration with improved support for catalog-managed tables, including atomic CTAS and conflict-free feature enablement for Deletion Vectors and Column Mapping. It also introduces a new Spark V2 connector based on Delta Kernel for streaming reads and server-side planning capabilities.
Delta Lake 4.0.1
The "managed table" feature is renamed to `catalogManaged` (breaking change) and now supports creating Unity Catalog-managed Delta tables with properties sent to the UC server. Unity Catalog OAuth authentication is now supported via catalog-scoped configurations, and a bug causing `REORG TABLE … APPLY (PURGE)` to fail on Spark 4.0.1 is fixed.
Delta Lake 4.0.0
Delta Lake 4.0 introduces preview support for catalog-managed tables and the Variant data type for semi-structured data, alongside Delta Connect for Spark Connect integration. Type Widening is now generally available, and dropping table features no longer requires history truncation.