python-v1.5.0·python-v1.5.0: faster writes, log compaction, spil config in MERGE
Summary
This release introduces faster Delta table writes through parallel partition writers and adds log compaction for improved performance. The `get_add_actions` method now returns an Arrow Table instead of an Arrow RecordBatch, which is a breaking change.
Summary generated by brickster.ai. For the full changelog and any code/binary attachments, follow the GitHub link above.
More from delta-io/delta-rs
This release fixes several regressions, including issues with MERGE operations, overwriting tables with partition changes, and schema mode with mixed-case columns. It also enables passing non-string datatypes in custom commit metadata and updates the minimum PyArrow version to 21.0.0 for preliminary variant type support.
This release fixes a bug preventing partition column changes when overwriting tables and addresses a memory regression in Python MERGE operations. It also adds support for passing non-string datatypes in custom commit metadata and enables nanosecond timestamp support.
This release improves the new Datafusion TableProvider and log parsing performance, alongside numerous bug fixes addressing issues like incorrect row counts for deletes, merge failures, and S3/Azure storage inconsistencies. A new feature allows adding post-commit hook properties to DeltaTable.restore operations.