Summary
Databricks' UCX v0.61.0 makes UCX recognize more PySpark DataFrame write calls, including `saveAsTable`, when linting tables, and fixes pagination so large accounts get all account groups instead of only the first page. It also fixes API compatibility with DBR 16 in table migration workflows, upgrades Blueprint to 0.13.0, and moves the build from Hatch to uv.
Summary generated by brickster.ai. For the full changelog and any code/binary attachments, follow the GitHub link above.
More from databrickslabs/ucx
Assessment export now handles large files through zip compression to prevent export failures. Workflow assessment has been split into a standalone run-assess-workflows task, giving users independent control over its execution instead of it being bundled with the main Assessment workflow.
Added Excel export format for assessment results and optional skip for workflow assessment tasks via configuration. Fixed multiple migration issues including federated catalog creation to include all external locations, external location name sanitization, GLUE credential lookup for external HMS, and improved error handling throughout the create-missing-principals and migrate-locations workflows.
The assessment workflow now includes a force-refresh parameter to rerun assessments and obtain updated results, and a new experimental workflow converts Azure WASBS URLs to the more performant ABFSS format. Dashboard management is now more resilient, automatically recreating dashboards when permission issues occur or they're trashed, and service principals are now supported as members of account groups.
UCX now includes an experimental workflow assessment feature that analyzes workflows from the last 30 days to identify migration issues, with findings available in the assessment dashboard. The release requires Databricks SDK 0.56 or later and includes updated documentation for installation and getting started guidance.
Assessment workflows require account groups to be created beforehand, and Service Principal is no longer supported for workspace installations—account-level installations now require Service Principal with Account Admin and Workspace Admin privileges. Table migration with default catalogs is fixed, workflow assessment filters to the last 30 days, migration progress workflows pause by default, and account group conflicts produce warnings instead of errors.
UCX v0.58.0 adds offline installation support for restricted-access environments and enables creation of account-level groups from nested workspace groups for improved governance. The release also enhances dashboard navigation with hyperlinks to table and cluster resources, and includes fixes for assessment exporters and improved error handling in the Workflow linter.