Declare and optimize with UNIQUE constraints on Databricks
Summary
Databricks UNIQUE constraints let you declare multiple nullable or composite uniqueness guarantees beyond a table's single PRIMARY KEY and reference them from foreign keys. Once you've validated and continuously maintained these informational constraints, marking them RELY lets the optimizer eliminate redundant joins and DISTINCT aggregations, removing over 99.99% of shuffle and speeding up queries by up to 12× in 10 TB TPC-DS benchmarks.
Summary generated by brickster.ai. For the full article, follow the source link above.
More from Databricks Blog
Claude Platform now supports native OpenTelemetry observability in Databricks MLflow
Claude Platform's native OpenTelemetry export is now in Public Beta, sending traces from Anthropic SDKs, the Messages API, and Claude Managed Agents into Databricks MLflow, where they're stored in Unity Catalog. Use trace analysis and MLflow Issues to investigate bad answers and spot repeated tool calls, then have domain experts review answers and rerun evaluation on the same test cases to check whether changes improve quality and cut unnecessary work.
Lakebase Postgres is now generally available on Google Cloud
Lakebase Postgres, Databricks' fully managed serverless Postgres database, is now generally available on Google Cloud, with autoscaling, scale to zero, instant branching, and point-in-time recovery built in. Because operational and analytical data share the same storage foundation, analytics, apps, and agents run on one platform without fragile pipelines to maintain.
Lakebase branching for CI/CD: lessons from 100 PR databases
Snorkel AI's CI/CD pipeline now gives every open pull request its own Lakebase Postgres branch, a full read/write copy of production data that's ready in under a minute rather than the 30+ minutes that previously made per-PR copies impractical. Because branches are copy-on-write, 100 concurrent PR databases on a ~2.5 TB production dataset add storage only for what each one changes, with TTL expiration cleaning up automatically and private connectivity plus Okta SSO keeping the setup governed.
Databricks and SAP unleash end-to-end data & AI capabilities to level up enterprise AI transformation
Databricks and SAP are expanding their partnership to give customers broader access to SAP application data across cloud and on-premises, speeding time to value for analytics and AI. Genie, Lakeflow, Unity Gateway, and Lakebase now come to SAP Databricks fully integrated with SAP Business Data Cloud, so teams can use the full Data + AI Platform on all their SAP data.
Wealth Management Client Onboarding Needs More Than AI
Task-level AI speeds up document processing and KYC screening, but wealth management client onboarding still stalls when evidence, case state, and decisions are fragmented across systems. The fix is governed case context, a shared, versioned view of each case's evidence, exceptions, and decision history, which supervised AI agents on the Databricks Data + AI Platform use with human reviewers to coordinate the full journey with traceability, and whose impact you can measure through cycle time, manual touches, and approval-to-funding time.
Deliberate decisions and enterprise AI value
Enterprise AI value depends on deliberate, grounded decisions, especially when organizational readiness, evidence and expectations vary widely. The post draws on what senior leaders are learning about investment, ownership, human judgment and strategic flexibility, and lays out 5 leadership disciplines for turning AI ambition into sustained value.