Summary
This release improves the new Datafusion TableProvider and log parsing performance, alongside numerous bug fixes addressing issues like incorrect row counts for deletes, merge failures, and S3/Azure storage inconsistencies. A new feature allows adding post-commit hook properties to DeltaTable.restore operations.
Summary generated by brickster.ai. For the full changelog and any code/binary attachments, follow the GitHub link above.
More from delta-io/delta-rs
This release fixes several regressions, including issues with MERGE operations, overwriting tables with partition changes, and schema mode with mixed-case columns. It also enables passing non-string datatypes in custom commit metadata and updates the minimum PyArrow version to 21.0.0 for preliminary variant type support.
This release fixes a bug preventing partition column changes when overwriting tables and addresses a memory regression in Python MERGE operations. It also adds support for passing non-string datatypes in custom commit metadata and enables nanosecond timestamp support.
python-v1.5.0: faster writes, log compaction, spil config in MERGE
This release introduces faster Delta table writes through parallel partition writers and adds log compaction for improved performance. The `get_add_actions` method now returns an Arrow Table instead of an Arrow RecordBatch, which is a breaking change.