Personalized for Data Engineer
Your feed
Everything across the Databricks world, ordered for you.
News, releases, videos, GitHub projects, and community Q&A merged into one feed — reordered for Data Engineer.
Reorder for your role
This ordering came from a link — click the highlighted chip to keep it.
Streams
Window
Topics
Showing 445 of 445
Videodatabricks TaskValue and Lakeflow - orchestrate using Python lists and arrays
databricks MVP Hubert Dudek13h ago
News
Read Restrictions and Catalog Labels: Unifying governance across engines and catalogs
databricks-blog14h ago
Community
Lakeflow Jobs update! Task output in foreach now available in Beta!
reddit1d ago0 pts · 0 comments
CommunityUnity Catalog
Writing to externally managed Iceberg tables from Databricks: am I missing something?
reddit2d ago0 pts · 0 comments
CommunityDelta Lake
Can a Delta table be “correct” even when the source and target row counts match?
reddit2d ago0 pts · 0 comments
CommunityDelta Live Tables
Data Quality in Microsoft Fabric – Native features vs. external tools (like Databricks Expectations)?
reddit2d ago0 pts · 0 comments
CommunityUnity Catalog
Time to Swap the Cookies for Jetfuel - New Dataset & New Databricks Genie Tutorial
reddit3d ago0 pts · 0 comments
CommunityDelta Live Tables
Declarative Pipeline Expectations - Quarantining Bad Records
databricks-community3d ago0 pts · 0 comments
CommunityDelta Lake
Change data feed from a materialized view
databricks-community3d ago0 pts · 0 comments
VideoLakeFlowTrigger a job automatically on databricks DABs bundle deploy
databricks MVP Hubert Dudek3d ago
CommunityDelta Lake
AUTO CDC SCD Type 2 with late-arriving deletes: edge cases the docs don't cover
databricks-community5d ago0 pts · 0 comments
News
IP Functions are Generally Available, bringing high-performance network analytics to the Lakehouse
databricks-blog1d ago
Community
Lakeflow connect SQL server ingestion can be made elastic?
databricks-community1d ago0 pts · 0 comments
Community
system.query.history is now Generally Available in Databricks
reddit1d ago0 pts · 0 comments
Community
The 32nd Column: Why Your Z-Order or Clustering Key May Be Doing Nothing
databricks-community1d ago0 pts · 0 comments
CommunityAnswered
Streaming read fails with "Detected a data update" after a restatement job touches the source
databricks-community1d ago0 pts · 0 comments
Community
Dashboard DAB Deployment: default_catalog and default_schema do not work for metric views anymore
databricks-community2d ago0 pts · 0 comments
CommunityWorkflows
DevOps Fundamentals: Lecture - DevOps Fundamentals: Repeated word
databricks-community2d ago0 pts · 0 comments
CommunityDelta Lake
Tip: Why your Delta MERGE fails with "multiple source rows matched" (and the simple fix)
databricks-community2d ago0 pts · 0 comments
CommunityUnity Catalog
Implementing a "Zero-Bus" Architecture with Unity Catalog
databricks-community2d ago0 pts · 0 comments
CommunityETL
Implementing a "Zero-Bus" Architecture in a Lakehouse: Best Practices for Shared Dimensions?
databricks-community2d ago0 pts · 0 comments
CommunityWorkflows
Stop using standard worker nodes for intermittent batch jobs
reddit3d ago0 pts · 0 comments
CommunityDelta Lake
Databricks Micro Apps, App Spaces and Genie App Generator
reddit3d ago0 pts · 0 comments
NewsDelta Lake
Fivetran + dbt Labs Announces New Capabilities to Make Enterprise Data Agent-Ready at dbt Summit 2026
dbt-blog15d ago
CommunityDelta Lake
Your Databricks query is slow — what would you fix first?
reddit3d ago0 pts · 0 comments
CommunityAnsweredDelta Lake
Liquid clustering vs. partitioning for a 5 TB Silver table with frequent MERGEs
databricks-community4d ago0 pts · 0 comments
NewsUnity Catalog
Unifying governance across engines and catalogs in the Open Lakehouse
databricks-blog21d ago
NewsUnity Catalog
Building High-Quality and Trusted Data Products with Databricks
databricks-blog28d ago
VideoDelta Lake138: Databricks Apps Explained | Part 2: Code Walkthrough
Raja's Data Engineering28d ago
VideoUnity CatalogDatabricks News: ZeroOps, DABs, Indexes, Genie, sandboxes, migration from PowerBI, secrets
databricks MVP Hubert Dudek49d ago
VideoDelta LakeAugust 2026 Databricks Updates: Omnigent, Disaster Recovery and Lakehouse//RT
DatabricksAug 2026
ProjectDelta Lake
DataWithBaraa/databricks_bootcamp_2026
Jupyter NotebookJan 2026★ 441 · Jupyter Notebook
CommunityUnity Catalog
Use Genie to crate a dashboard to show cost per catalog or workflow
reddit5d ago0 pts · 0 comments
Community
I am trying to build an interactive dashboard on the underlying Databricks. Which of these are the best?
reddit9h ago0 pts · 0 comments
Community
PARTITIONED BY, Liquid Clustering, and OPTIMIZE: when should you use each?
databricks-community17h ago0 pts · 0 comments
Release
databricks/databricks-vscode — Release: v2.20.0 (#2232) (release-v2.20.0)
databricks/databricks-vscode1d ago
VideoDelta LakeBig Data LDN 2026 - Lakebase & LTAP | Simon Whiteley & Holly Smith
Advancing Analytics7d ago
Community
Row-level security for a RAG agent: what Unity Catalog enforces, and what you have to build
databricks-community1d ago0 pts · 0 comments
NewsDelta Lake
How Concurrence governs clinical AI at a trillion-token scale with Unity Gateway
databricks-blog8d ago
CommunityAnswered
At what data size do you stop reaching for Spark?
databricks-community1d ago0 pts · 0 comments
CommunityAnswered
Photon enabled but a large share of the plan is falling back, cost up and runtime flat
databricks-community1d ago0 pts · 0 comments
Community
Azure Databricks, two-week-old account: partner pay-per-token endpoints (Claude, Grok) have never once succeeded — "Databricks-set rate limit of 0" — and the Assistant has "no daily token allowance". Open models work. What gates this?
reddit2d ago0 pts · 0 comments
Community
How to make each person see only their specific data (i.e. their own rows in Genie) with RBAC & ABAC
databricks-community2d ago0 pts · 0 comments
News
Your data, your storage, your rules: a 2026 guide to storing Unity Catalog managed tables
databricks-blog2d ago
CommunityUnity Catalog
Avoid Unity Catalog external location permission bugs by using managed storage
reddit3d ago0 pts · 0 comments
VideoUnity CatalogHow Databricks Genie Automates Data Workflows with Genie Ontology and Scheduled Tasks
Databricks14d ago
CommunityUnity Catalog
Salesforce Hosted MCP + UC HTTP connection — stops working after ~1 hour?
databricks-community3d ago0 pts · 0 comments
CommunityLakehouse Federation
Connecting to Snowflake via Workload Identity Federation
databricks-community3d ago0 pts · 0 comments
NewsStructured Streaming
Announcing On-Demand State Repartitioning for Apache Spark™ Structured Streaming on Databricks
databricks-blog17d ago
ReleaseUnity Catalog
databricks/terraform-provider-databricks — v1.135.0
databricks/terraform-provider-databricks4d ago
CommunityUnity Catalog
What information about external agents can be retrieved from Unity Catalog?
databricks-community4d ago0 pts · 0 comments
VideoUnity CatalogHow to Build and Serve Production ML Features | Databricks Feature Store Demo
Databricks24d ago
VideoDelta Lake140. Databricks Lakebase Explained | Episode 1 | Fully Managed PostgreSQL for Lakehouse (2026)
Raja's Data Engineering24d ago
NewsDelta Lake
Southern Company’s SCOUT: Completing the Storm Intelligence Story
databricks-blog29d ago
NewsUnity Catalog
How the FDA is building a secure, AI-ready data foundation on Databricks for Government
databricks-blog30d ago
CommunityUnity Catalog
Balancing Model Agility and Centralized Governance with Mosaic AI Gateway
databricks-community4d ago0 pts · 0 comments
NewsUnity Catalog
Choosing Data Governance Tools for Enterprise Data Governance
databricks-blog37d ago
NewsUnity Catalog
Data Mesh vs. Data Fabric: Key Differences and How the Lakehouse Resolves the Debate
databricks-blog37d ago
NewsUnity Catalog
Connecting retail demand planning to campaign and store execution
databricks-blog41d ago
NewsDelta Lake
Busting SQL Migration Myths: How New SQL Features Make Lift-and-Shift to Lakehouse Easier
databricks-blog42d ago
ReleaseUnity Catalog
unitycatalog/unitycatalog — UnityCatalog 0.6.0 (v0.6.0)
unitycatalog/unitycatalog42d ago
VideoWorkflowsAzure Pipelines: Triggering Deployments Based on Branches
Databricks Skill Builder42d ago
VideoUnity CatalogHow AI and Data Keep 2.3 Million Lawns Healthy | TruGreen & Databricks
Databricks46d ago
VideoUnity CatalogHow to Connect Databricks and Fabric (No Copying Required)
Databricks Skill Builder49d ago
VideoUnity CatalogEp 5: All About Genie One & Genie Ontology | Ashley Warren
Advancing AnalyticsJul 2026
Community
Join the Live AI/BI + Genie Launchpad (Oct 6–8)
databricks-community17h ago0 pts · 0 comments
Community
CUSTOMER STORY | BookMyShow scales self-service analytics with Genie
databricks-community18h ago0 pts · 0 comments
Community
Gemini Foundation Model endpoint unavailable in 14-day commercial trial
databricks-community21h ago0 pts · 0 comments
Community
Routing between GLM 5.3 Flash and GLM 5.3 with ai_decide: a cheap router in front of ai_query
databricks-community21h ago0 pts · 0 comments
News
From Data to Dialogue: How S&P Global Energy Made Its Structured Data Estate Conversational with Databricks Genie Agents and MCP
databricks-blog6d ago
Community
Setting my Expectations for Microsoft CSS support in Azure Databricks (2026)
reddit1d ago0 pts · 0 comments
VideoHow HSS Offloads Provider Administrative Burden with the Databricks Data + AI Platform
Databricks8d ago
Community
MLflow traces accepted by StartTraceV3 (200 OK) but never stored: GetTrace returns NOT_FOUND
databricks-community1d ago0 pts · 0 comments
Community
How to build FinOps chargeback by cost centre — allocating the whole cloud bill, not just your DBUs
databricks-community1d ago0 pts · 0 comments
Community
Announcement | Five ways marketers can use Genie One
databricks-community1d ago0 pts · 0 comments
Community
CUSTOMER STORY | ANA Seguros turns insurance data into faster decisions with AI/BI and Genie
databricks-community2d ago0 pts · 0 comments
Community
Quick clarification about GENAI or Context engineering certification
databricks-community2d ago0 pts · 0 comments
Community
Step-by-Step: Building a Vacation Rental Operations App with AppKit
databricks-community2d ago0 pts · 0 comments
News
Unity Catalog Pages: a governed home for your business knowledge in Genie Ontology
databricks-blog9d ago
Release
databricks/terraform-provider-databricks — v1.133.0
databricks/terraform-provider-databricks11d ago
Community
1.Not able to access interent (gcp databricks) 2.both ingress and egress access given
databricks-community2d ago0 pts · 0 comments
Community
Serverless Interactive and Realtime Inferencing costs scaling rapidly
reddit2d ago0 pts · 0 comments
Community
Announcement | The Genie One MCP is now Generally Available
databricks-community2d ago0 pts · 0 comments
Community
Solution Accelerator Series | Incident Investigation Using Graphistry
databricks-community2d ago0 pts · 0 comments
Community
Certification Support Request #01015865 – No Response Since September 14
databricks-community2d ago0 pts · 0 comments
Community
How to bring the project id info into the databricks billing usage table on GCP
databricks-community3d ago0 pts · 0 comments
News
"Regex for Rows": Simplifying Pattern Detection in SQL with MATCH_RECOGNIZE
databricks-blog15d ago
VideoUnity CatalogAI Watermarking, Databricks AI Extract, Hugging Face, and Unity Catalog | AI Newsround - Summer 2026
Advancing Analytics15d ago
Community
Workshop on bringing systematic evaluation and MLflow tracking to LLM apps, Oct 3
reddit3d ago0 pts · 0 comments
News
How energy teams turn theft detection into governed action with Genie and AI business processes
databricks-blog16d ago
Community
How to get people to actually choose Genie: train the mindset, not just the buttons
databricks-community3d ago0 pts · 0 comments
Community
Claude Academy's Using Databricks for Data Analysis - This official documentation from Anthropic on Claude Academy for how to work with Databricks is really underwhelming, so I wanted to share a guide that properly explains everything.
reddit3d ago0 pts · 0 comments
Community
Announcement | EBOOK: Operationalizing Agent Fleets at Scale
databricks-community3d ago0 pts · 0 comments
Release
databricks/terraform-provider-databricks — v1.132.0
databricks/terraform-provider-databricks18d ago
Community
Your exam is being suspended for non-compliance with requirement set by test sponsor
databricks-community3d ago0 pts · 0 comments
Community
Knowledge Assistant fails to load after indexing; generated AI Search index cannot be reused
databricks-community3d ago0 pts · 0 comments
Community
Community BrickTalk | Databricks Certification: Did You Know?, What's New, and Where We're Going
databricks-community4d ago0 pts · 0 comments
Community
What Are the Key Considerations for Building AI-Powered Applications?
databricks-community4d ago0 pts · 0 comments
Community
Unlock the Power: Databricks Genie One vs. Code and Agent
databricks-community4d ago0 pts · 0 comments
NewsUnity Catalog
Five AI Questions We're Hearing from Financial Services Leaders
databricks-blog22d ago
NewsWorkflows
A practical approach to end-to-end Solvency II reporting in Databricks
databricks-blog22d ago
NewsUnity Catalog
Beyond embedding: How to secure AI/BI Dashboards for every viewer
databricks-blog22d ago
NewsDelta Lake
The 40-year-old database rule agents just broke: How LTAP unifies OLTP and OLAP workloads
databricks-blog24d ago
VideoUnity Catalog139: Databricks Apps Explained | Part 3: Deploy a Real App in Databricks
Raja's Data Engineering27d ago
NewsUnity Catalog
Governance beyond security: knowledge, context & ontology on the lakehouse
databricks-blog28d ago
VideoUnity CatalogGovern Models and Model Services Using ABAC Grant Policies
Databricks Skill Builder28d ago
ReleaseWorkflows
databricks/databricks-vscode — Release: v2.16.0 (#2172) (release-v2.16.0)
databricks/databricks-vscode28d ago
NewsUnity Catalog
Expanding Genie Agents: Deep analysis, file reasoning, and more
databricks-blog29d ago
Community
UC Berkeley renames football stadium to Databricks Field in sponsorship deal
reddit4d ago0 pts · 0 comments
NewsStructured Streaming
Building for the AI Era: Lakebase, Streaming, and Lakehouse Innovations at VLDB 2026
databricks-blog35d ago
ReleaseAsset Bundles
databricks/databricks-vscode — Release: v2.15.0 (#2155) (release-v2.15.0)
databricks/databricks-vscode36d ago
NewsUnity Catalog
Introducing Governance Hub: Intelligent, account-level governance over your Databricks estate
databricks-blog37d ago
VideoUnity CatalogPages in Unity Catalog: Govern Business Knowledge for Humans and AI
Databricks37d ago
NewsUnity Catalog
Run, debug, and scale Databricks workloads from your local IDE
databricks-blog38d ago
ReleaseAsset Bundles
databricks/terraform-provider-databricks — v1.129.0
databricks/terraform-provider-databricks39d ago
NewsUnity Catalog
When it comes to Governance, Retailers need a control plane for context
databricks-blog44d ago
ReleaseUnity Catalog
databricks/terraform-provider-databricks — v1.127.0
databricks/terraform-provider-databricks46d ago
ReleaseAsset Bundles
databricks/databricks-vscode — Release: v2.13.1 (#2106) (release-v2.13.1)
databricks/databricks-vscode50d ago
ReleaseUnity Catalog
databricks/databricks-vscode — Release: v2.13.0 (#2089) (release-v2.13.0)
databricks/databricks-vscode56d ago
VideoUnity CatalogIs Your AI Strategy Out of Control? Track and Govern it with Unity AI Gateway
Databricks Skill Builder57d ago
Community
Zempira: dagelijkse capsules voor darmbalans en gewichtsbeheer
databricks-community5d ago0 pts · 0 comments
Community
Stop Moving Data Into Spreadsheets. Databricks Is Moving the Spreadsheet to the Data.
reddit5d ago0 pts · 0 comments
Community
Accidentally removed the only workspace admin – Free Edition
databricks-community5d ago0 pts · 0 comments
Community
Databricks now deletes unused service principal secrets after 90 days
databricks-community5d ago0 pts · 0 comments
Community
Accidentally removed the only workspace admin – Free Edition
databricks-community6d ago0 pts · 0 comments
Release
databricks/databricks-vscode — Release: v2.19.0 (#2215) (release-v2.19.0)
databricks/databricks-vscode6d ago
News
Context engineering is already possible in your warehouse. Here's how to get started.
dbt-blog7d ago
VideoBig Data LDN 2026 - what's the vibe like? | Simon Whiteley & Holly Smith
Advancing Analytics7d ago
VideoHow NOL Universe Scales Global Travel Operations for 1,000+ Users With Databricks
Databricks8d ago
Release
databricks/terraform-provider-databricks — v1.134.0
databricks/terraform-provider-databricks8d ago
VideoDatabricks for Good x MapAid: Creating a Searchable Database for Groundwater Discovery
Databricks14d ago
Release
databricks/databricks-vscode — Release: v2.18.0 (#2201) (release-v2.18.0)
databricks/databricks-vscode14d ago
News
How Databricks’ marketers use data 3x more with Genie, an AI analytics assistant
databricks-blog17d ago
VideoDatabricks for Good x Crisis Text Line: Using GenAI to control and optimize costs
Databricks17d ago
VideoDeploy an Azure Databricks Serverless Workspace in Under 2 Minutes | Step-by-Step Tutorial
Databricks Skill Builder20d ago
Release
databricks/databricks-vscode — Release: v2.17.2 (#2191) (release-v2.17.2)
databricks/databricks-vscode20d ago
VideoHow to Build Production-Ready Apps in Replit with Lakebase Postgres | Databricks + Replit Demo
Databricks21d ago
Release
databricks/databricks-vscode — Release: v2.17.1 (rollback to v2.16.0) (release-v2.17.1)
databricks/databricks-vscode21d ago
Release
databricks/databricks-vscode — Release: v2.17.0 (#2187) (release-v2.17.0)
databricks/databricks-vscode22d ago
VideoDatabricks for Good x Toast91: Redefining how Young People access Mental Health Support
Databricks22d ago
News
Adaptive Instructed-Retriever: Frontier-Quality Search at 2x Lower Latency
databricks-blog22d ago
News
Evaluation-First AI Agents: How Zepto Scales Customer Support on Databricks and MLflow
databricks-blog23d ago
Release
databricks/terraform-provider-databricks — v1.131.0
databricks/terraform-provider-databricks25d ago
VideoForward Deployed Engineers (FDE) vs Data Engineers (DE) #fde #dataengineering
Ease With Data27d ago
VideoHow Syngenta turns AI experimentation into business impact | Data + AI Executive Series: Fast 5
Databricks28d ago
VideoDatabricks Genie Data Democratization at Amadeus | Data + AI Executive Series: Fast 5
Databricks28d ago
VideoHow to Connect Your Coding Agent and IDE to Databricks Compute | Databricks SSH Tunnel Demo
Databricks28d ago
Video137: Databricks Apps Explained | Part 1: The Problem Every Data Team Faces
Raja's Data Engineering29d ago
News
The new Brickbuilder Partner Network tiers for ISVs and Data Providers are here
databricks-blog30d ago
News
How Discovery Bank delivers hyper-personalized banking at scale: behavioral AI, governed data, and real-time decisioning
databricks-blog30d ago
Release
databricks/terraform-provider-databricks — v1.130.0
databricks/terraform-provider-databricks32d ago
Release
databricks/databricks-vscode — Release: v2.14.1 (#2140) (release-v2.14.1)
databricks/databricks-vscode41d ago
News
Inbound Private Link now supports account-level Genie One, the account console, and custom URLs
databricks-blog42d ago
Release
databricks/databricks-vscode — Release: v2.14.0 (#2137) (release-v2.14.0)
databricks/databricks-vscode42d ago
Release
databricks/terraform-provider-databricks — v1.128.0
databricks/terraform-provider-databricks43d ago
News
Databricks Document Intelligence: pushing the frontier for complex document extraction
databricks-blog44d ago
Release
databricks/terraform-provider-databricks — v1.126.0
databricks/terraform-provider-databricks50d ago
VideoDatabricks All Purpose vs Serverless Computes #databricks #databrickstutorial
Ease With Data51d ago
Weekly digest
The week that mattered across the Databricks world — one email, Tuesday mornings.
Read past issues