Service Principal
Recent items mentioning Service Principal across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.
Terraform provider v1.125.0 now resolves workspace_id from host metadata instead of SCIM, fixing failures for service principals lacking /Me access 6. Recent Python and Go SDK releases made service principal and user identity fields required as part of broader IAM v2 breaking changes, while also adding forward_user_access_token support for apps 5. Separately, a Databricks Skill Builder video walks through configuring OAuth service principal client IDs and secrets in Azure DevOps variable groups for pipeline authentication 8.
Generated daily from the 8 most recent items mentioning Service Principal. Click any [N] to jump to the source.
The SDK adds comprehensive IAM v2 API methods to both account and workspace clients for managing groups, users, service principals, and workspace assignments through create, read, list, and delete operations. The `newCluster` field in `JobCluster` is no longer required, making job cluster configuration more flexible.
The SDK adds new methods for managing groups, users, service principals, and workspace assignments at both account and workspace levels, providing expanded IAM capabilities. The NewCluster field in JobCluster is now optional, a breaking change that affects existing cluster configuration code.
The SDK adds comprehensive IAM v2 methods for account and workspace-level management of users, groups, service principals, and workspace assignments. The `new_cluster` field for `JobCluster` is now optional, which is a breaking change.
The SDK adds job triggers for scheduling, API source connectors for pipelines, secret value retrieval in requests, new GpuXlarge8 workload types, Netsuite connection support, and token forwarding for apps. Breaking changes remove browse-related fields from model and MCP service APIs and make several user and service principal fields required.
The SDK removes the include_browse field from catalog service requests and browse_only field from service objects, which is a breaking change requiring code updates for affected users. New features include forward_user_access_token for applications, docker_image_url for AI runtime jobs, gpu_xlarge_8 GPU workload size, and required IAM fields for users and service principals.
The databricks_repo resource now supports an optional git_credential_id attribute to explicitly select credentials for repo operations. Workspace-level hosts now resolve workspace_id from host metadata instead of SCIM calls, preventing failures for service principals without /Me access and catching workspace_id mismatches at plan time rather than apply time.
The SDK adds support for AWS Bedrock access key authentication in the model provider service configuration. New Microsoft Entra service principal authentication fields are now available for Azure OpenAI and Microsoft Foundry provider configurations.
NewsWhy You Need Variable Groups in Azure Pipelines #AzureDevOps #DevOps #Shorts
Azure DevOps variable groups store environment-specific Databricks workspace hosts and authentication secrets. OAuth service principal client IDs and secrets enable secure connection to development and production workspaces within the pipelines.
Introduces catalogs.yml v2 support, a `skip_optimize` config for opting out of post-materialization OPTIMIZE, and Rust kernel backend for SQL warehouses. Fixes numerous incremental model bugs around constraints and tags, but now requires `--full-refresh` to apply changes to primary/foreign key expressions.
Declarative Asset Bundle Service Principals best practices
NewsDeploying Azure Databricks with Terraform? Watch this first!
This video demonstrates how to deploy an Azure Databricks workspace using Terraform by cloning a provided script, configuring variables, and executing Terraform commands. It walks through setting up prerequisites, authenticating Azure CLI, and populating a Terraform variables file to successfully provision the workspace.
The provider adds service principal Git credential management via principal_id on databricks_git_credential and enables permission management for Agent Bricks resources. Key fixes include metastore external_access_enabled now properly sent in PATCH requests, vector search index timeout increased to 75 minutes and made configurable, and workspace_id now accepting connection IDs alongside numeric workspace IDs.
NewsTerraform AWS Databricks Deployment Guide!
The video demonstrates how to deploy an AWS Databricks workspace using a provided Terraform script. It covers prerequisites, AWS and Databricks authentication, variable configuration, and executing the Terraform commands to create the workspace.
This release fixes a state decoding error affecting library, share, and quality monitor resources that occurred after upgrading to version 1.114.0. It also resolves workspace-tracking failures on account-
Added Excel export format for assessment results and optional skip for workflow assessment tasks via configuration. Fixed multiple migration issues including federated catalog creation to include all external locations, external location name sanitization, GLUE credential lookup for external HMS, and improved error handling throughout the create-missing-principals and migrate-locations workflows.
Tutorials51 Setup Azure DevOps Pipeline with Databricks Asset Bundles (DABs) | Complete CICD Process
The video demonstrates how to set up an Azure DevOps pipeline to deploy Databricks Asset Bundles (DABs) to higher environments like QA. It covers configuring service principal permissions, setting up Azure pipeline variables for environment-specific details, and writing the YAML pipeline code to validate and deploy Databricks assets.
The assessment workflow now includes a `force-refresh` parameter to rerun assessments and obtain updated results, and a new experimental workflow converts Azure WASBS URLs to the more performant ABFSS format. Dashboard management is now more resilient, automatically recreating dashboards when permission issues occur or they're trashed, and service principals are now supported as members of account groups.
Assessment workflows require account groups to be created beforehand, and Service Principal is no longer supported for workspace installations—account-level installations now require Service Principal with Account Admin and Workspace Admin privileges. Table migration with default catalogs is fixed, workflow assessment filters to the last 30 days, migration progress workflows pause by default, and account group conflicts produce warnings instead of errors.
