v3.3.3·Delta Lake 3.3.3
Summary
Delta 3.3.3 fixes transaction log retention bugs that broke time travel and CDF reads, and a Delta Sharing deletion vector cache bug causing long-running queries to fail. It adds opt-in RANDOMIZE_FILE_PREFIXES to spread S3 object keys for high-throughput workloads and upgrades Delta Sharing client for improved OAuth and retry handling.
Summary generated by brickster.ai. For the full changelog and any code/binary attachments, follow the GitHub link above.
Topics
More from delta-io/delta
Delta Lake 4.3.1
Delta Lake 4.3.1 fixes OAuth authentication failures in the Delta REST Catalog caused by incorrect key lowercasing and enables S3A fast listing when using OSS UnityCatalog's CredScopedFileSystem wrapper. It also prevents the reserved is_managed_location property from persisting into managed table metadata.
Delta Lake 4.3.0
Delta 4.3.0 deepens Unity Catalog integration by making it the source of truth for managed table operations via the UC Delta REST API, introduces replaceOn/replaceUsing DataFrame APIs for selective row-level data replacement, and improves UniForm with atomic Iceberg conversion and incremental metadata updates. Delta Sharing gains streaming support, Change Data Feed capabilities, and Trigger.AvailableNow, plus performance improvements like better V2 checkpoint parallelization and variant column statistics for data skipping.
Delta Lake 4.2.0
Delta 4.2.0 enables atomic REPLACE TABLE, RTAS, and DPO for catalog-managed tables, enhances streaming capabilities, and adds a Kernel-based Flink connector. The release makes Variant generally available, adds geospatial and collation support, and includes comprehensive security hardening.
Delta Lake 4.1.0
Delta Lake 4.1.0 supports Apache Spark 4.1.0 and introduces conflict-free enablement of Deletion Vectors and Column Mapping on existing tables without blocking concurrent writes. The release requires Java 17 and Spark 4.0.1 or higher (dropping Spark 3.5), adds full catalog-managed table support in Delta Kernel for Unity Catalog integration, and fixes MERGE/INSERT struct expansion bugs.
Delta Lake 4.0.1
Delta Lake 4.0.1 introduces a breaking change renaming catalogOwned-preview to catalogManaged, adds Unity Catalog OAuth with automatic token refresh, and enables UC-managed Delta table creation. It also fixes a Spark 4.0.1 compatibility issue causing NoSuchMethodError in REORG TABLE APPLY (PURGE).
Delta Lake 4.0.0
Delta Lake 4.0.0 introduces Delta Connect for Spark Connect connectivity, catalog-managed tables in preview for catalog-controlled commits, full Variant data type support for semi-structured storage, and graduates Type Widening to enable column type changes without rewriting data. The release requires Apache Spark 4.0 and discontinues active development of Delta Standalone and related connectors (Flink, Hive) in 4.x, shifting them to maintenance-only mode.