Latest releases from the Databricks ecosystem.
New versions from the official SDKs, CLI and Asset Bundles, Terraform provider, Unity Catalog, MLflow, Delta, dbt-databricks, and more. Summarized for scanning.
This week
2 releasesThis release fixes several regressions, including issues with MERGE operations, overwriting tables with partition changes, and schema mode with mixed-case columns. It also enables passing non-string datatypes in custom commit metadata and updates the minimum PyArrow version to 21.0.0 for preliminary variant type support.
Last week
1 releaseThis release fixes a bug preventing partition column changes when overwriting tables and addresses a memory regression in Python MERGE operations. It also adds support for passing non-string datatypes in custom commit metadata and enables nanosecond timestamp support.
Week of Apr 20
1 releaseThis release improves the new Datafusion TableProvider and log parsing performance, alongside numerous bug fixes addressing issues like incorrect row counts for deletes, merge failures, and S3/Azure storage inconsistencies. A new feature allows adding post-commit hook properties to DeltaTable.restore operations.
Week of Mar 9
1 releasepython-v1.5.0: faster writes, log compaction, spil config in MERGE
This release introduces faster Delta table writes through parallel partition writers and adds log compaction for improved performance. The `get_add_actions` method now returns an Arrow Table instead of an Arrow RecordBatch, which is a breaking change.
Week of Feb 16
1 releaseWeek of Feb 9
2 releasesWeek of Jan 26
1 releaseWeek of Jan 12
1 releaseWeek of Jan 5
2 releasespython-v1.3.1: read support deletion vectors, column mapping
This release adds read support for Delta Lake tables utilizing deletion vectors and column mapping. It also includes performance improvements for table scans and predicate pushdown, alongside better error messages for Unity Catalog and LakeFS.
This release adds support for multiple constraints at once, generates Symlink Manifests for external engines, and introduces GCS auto-registration. It also includes fixes for schema evolution in merge operations, improved error reporting, and enhanced handling of empty tables.