Personalized for Data Engineer
Your feed
Everything across the Databricks world, ordered for you.
News, releases, videos, GitHub projects, and community Q&A merged into one feed — reordered for Data Engineer.
Reorder for your role
This ordering came from a link — click the highlighted chip to keep it.
Streams
Window
Topics
Showing 150 of 447
VideoMigrate Databricks classic workloads to serverless with Genie Migrate | Databricks Demo
Databricks12h ago
VideoMulti-Statement Transactions in Unity Catalog: Atomic Writes on Delta and Iceberg
Databricks14h ago
Community
Hourly streaming table refresh jobs keep running after the table was dropped (Free Edition)
databricks-community17h ago0 pts · 0 comments
Community
Auto Loader: Schema Evolution and the Rescued Data Column
databricks-community19h ago0 pts · 0 comments
Community
Views in SDP - intended use and how to change object types (View -> MV)?
reddit1d ago0 pts · 0 comments
Community
How to Read XML in Databricks: rowTag, Auto Loader, and Rescued Data
reddit2d ago0 pts · 0 comments
CommunityDelta Lake
Best Lakeflow ingestion pattern for Full, Append, Replace, SCD Type 1, and SCD Type 2?
reddit2d ago0 pts · 0 comments
CommunityDelta Lake
Databricks Streaming table to Fabric for Gold Lakehouse
reddit2d ago0 pts · 0 comments
CommunityAnsweredLakeFlow
Approaches and utilities for migrating SSIS packages (.dtsx) to Databricks?
databricks-community2d ago0 pts · 0 comments
CommunityUnity Catalog
Spark Declarative Pipelines - possible to write UC Managed Iceberg Tables instead of materialized views?
reddit3d ago0 pts · 0 comments
CommunityDelta Lake
Lakeflow Declarative Pipelines with external: managed tables, or publish step?
reddit3d ago0 pts · 0 comments
CommunityDelta Live Tables
How do you handle dirty data and data quality failures in your pipelines? (Quarantine vs. Fail Fast)
reddit4d ago0 pts · 0 comments
CommunityDelta Lake
Are you using Databricks Materialized Views for your Gold layers yet? Thoughts?
reddit4d ago0 pts · 0 comments
CommunityDelta Lake
How are you handling enterprise CDC and file ingestion in Databricks lately? (Lakeflow Connect vs. Custom Spark)
reddit4d ago0 pts · 0 comments
Community
Preserving Salesforce connector SCD2 history across Full Refreshes
databricks-community12h ago0 pts · 0 comments
Community
Auto Loader: addNewColumns can still stop your stream
databricks-community20h ago0 pts · 0 comments
NewsUnity Catalog
Air gapped, not data dark: how Bright Machines gives customers live factory dashboards without opening the plant
databricks-blog7d ago
Community
Photon cut this Databricks job from 60 to 40 minutes, but DBUs rose 33%
reddit1d ago0 pts · 0 comments
Community
Lakeflow Jobs: Retries, Timeouts and Alerts That Actually Help
databricks-community1d ago0 pts · 0 comments
Community
Building a Self-Validating AI Summary Pipeline on Databricks
databricks-community2d ago0 pts · 0 comments
ReleaseUnity Catalog
databricks/terraform-provider-databricks — v1.142.0
databricks/terraform-provider-databricks9d ago
CommunityAuto Loader
What’s something you believed about Databricks for way too long before finding out you were wrong?
reddit2d ago0 pts · 0 comments
NewsUnity Catalog
Talk to your clinical data: unlocking AWS HealthLake with OpenSharing and Genie One
databricks-blog2d ago
NewsDelta Lake
Read, don't copy: replacing file and API feeds with OpenSharing - Part 1 (The Why)
databricks-blog12d ago
ProjectDelta Lake
DataWithBaraa/databricks_bootcamp_2026
Jupyter Notebook12d ago★ 466 · Jupyter Notebook
NewsDelta Lake
Push-based CDC into Unity Catalog with Zerobus Ingest and Debezium
databricks-blog13d ago
NewsLakeFlow
Introducing Apache Spark® 4.3 - Now available in Databricks Runtime 19
databricks-blog14d ago
CommunityUnity Catalog
Deploy models pattern via MLflow deployment jobs + multiple workspaces
reddit3d ago0 pts · 0 comments
CommunityDelta Live Tables
Why your materialized view keeps doing full recomputes, and how to find out
databricks-community3d ago0 pts · 0 comments
CommunityWorkflows
DevOps Fundamentals: Demo: Deploying the Databricks Project
databricks-community3d ago0 pts · 0 comments
CommunityUnity Catalog
Federated PostgreSQL timestamps in Unity Catalog: a view that gives everyone the same answer
databricks-community3d ago0 pts · 0 comments
NewsLakeFlow
Announcing General Availability of Real-Time Mode for Spark Declarative Pipelines on Databricks
databricks-blog20d ago
NewsUnity Catalog
How dbt Labs and Fivetran are moving dbt workloads onto the data lake, model by model
dbt-blog22d ago
VideoUnity CatalogLakebase Search: Build AI Retrieval for Agents with Lakebase Postgres
Databricks23d ago
VideoUnity CatalogDatabricks Pipelines: Write to One Unity Catalog Table from Multiple Sources with FLOWs
Databricks23d ago
CommunityApache Spark
Using the Apache DataFusion Comet accelerator to save cost
reddit4d ago0 pts · 0 comments
VideoDelta LakeBuilding Reliable Data Pipelines with Lakeflow on Databricks | Lakeflow Demo
Databricks27d ago
VideoLakeFlowTutorial: Genie for Data Engineers, Data Scientists, and Everybody Else
Databricks29d ago
VideoUnity CatalogDatabricks Breaking News: Lakeflow Jobs, DABs, Apps, AI, Private Network Gateway
databricks MVP Hubert Dudek31d ago
VideoLakeFlowdatabricks TaskValue and Lakeflow - orchestrate using Python lists and arrays
databricks MVP Hubert Dudek48d ago
VideoLakeFlowTrigger a job automatically on databricks DABs bundle deploy
databricks MVP Hubert Dudek51d ago
Community
Undo a bad write on a Delta table: history, time travel and RESTORE
databricks-community17h ago0 pts · 0 comments
Community
The Small Files Problem, and What Predictive Optimization Does About It
databricks-community19h ago0 pts · 0 comments
Community
DEEP CLONE fails with DELTA_CLONE_INCOMPLETE_FILE_COPY
databricks-community20h ago0 pts · 0 comments
Community
Cert rotation killed our continuous jobs. The paused one stayed dead
databricks-community21h ago0 pts · 0 comments
CommunityAnswered
Suggestions for migrating legacy SAS workloads to Databricks?
databricks-community21h ago0 pts · 0 comments
ReleasePrerelease
databricks/databricks-vscode — Release: v3.1.0 (release-v3.1.0)
databricks/databricks-vscode23h ago
Community
suspension of myDatabricks: Certified Associate Developer for Apache Spark exam
databricks-community1d ago0 pts · 0 comments
CommunityAnswered
Suggestions/Recommendations for a Teradata to Databricks migration?
databricks-community1d ago0 pts · 0 comments
NewsUnity Catalog
From enterprise context to action: Genie Agents now analyze more data sources to transform your work
databricks-blog7d ago
News
Advancing Catalog Interoperability with Unity Catalog and Google Cloud’s Borderless Lakehouse
databricks-blog1d ago
Community
Is legacy data migration still a major pain point for enterprises? What if we could automate most of it?
reddit1d ago0 pts · 0 comments
CommunityAnswered
Databricks Associate Exam: Mastering Delta Lake Concepts
databricks-community1d ago0 pts · 0 comments
CommunityAnswered
Tips and Utilities for migrating Tableau workbooks & Prep flows to Databricks?
databricks-community2d ago0 pts · 0 comments
Community
Validate API-Based Promotion / deploy of a Databricks Genie Agent from Dev to QC
databricks-community2d ago0 pts · 0 comments
Community
Validation of API-Based Promotion of Databricks Genie Agent from Dev to QC
databricks-community2d ago0 pts · 0 comments
Community
Zerobus Ingest availability in Azure South Africa North (southafricanorth)?
databricks-community2d ago0 pts · 0 comments
News
Clean data was never enough: How IFS Copperleaf taught AI its business with Databricks Genie One
databricks-blog2d ago
News
Build a real-time next-best-offer recommender using Databricks Feature Views
databricks-blog2d ago
Community
Do you cache DataFrames in Spark as often as you can, or only when necessary?
reddit2d ago0 pts · 0 comments
Community
Guidance on resolving Delta Lake concurrency exceptions during parallel writes
databricks-community2d ago0 pts · 0 comments
NewsDelta Lake
Read, don't copy: replacing file feeds with OpenSharing - Part 2 (How to Implement)
databricks-blog12d ago
Community
5 Common Challenges in Data Engineering and How Databricks Can Help
databricks-community2d ago0 pts · 0 comments
Community
Delta Lake vs. Traditional Data Lakes: Which One Is Better for Modern Data Engineering?
databricks-community2d ago0 pts · 0 comments
CommunityDelta Lake
Undoing a bad MERGE on a Delta table: find it, size it, and RESTORE without losing later writes
databricks-community3d ago0 pts · 0 comments
VideoUnity CatalogHow To Detect Telecom Fraud in Real Time with an AI Fraud Analyst Coworker | Databricks Demo
Databricks15d ago
CommunityUnity Catalog
Governed Spreadsheets on Databricks: Row Zero Acquisition & What It Means for Business Users on Databricks (Demo + Chat)
reddit3d ago0 pts · 0 comments
CommunityAsset Bundles
Databricks Latest Features: Genie Code CLI, App Builder, Agent Memory and DABs Deployment History
databricks-community3d ago0 pts · 0 comments
CommunityApache Spark
Does throwing more resources at a slow Spark job actually solve the problem?
reddit4d ago0 pts · 0 comments
NewsETL
How Sweetwater catches broken dbt pipelines before anyone notices, with Datadog
dbt-blog22d ago
NewsUnity Catalog
Unlocking Investment Insights Without Migrating Your Data: Lakehouse Federation
databricks-blog22d ago
ReleaseDelta Live Tables
databricks/databricks-sdk-java — v0.171.0
databricks/databricks-sdk-java24d ago
CommunityUnity Catalog
How do you manage table schema changes in Databricks across dev/test/prod?
reddit4d ago0 pts · 0 comments
CommunityUnity Catalog
Genie ignored my Unity Catalog wiki, so I tested what it actually reads
reddit4d ago0 pts · 0 comments
VideoDelta LakeCan AI Really Model Your Data in Hours? Databricks Vibe Modeling
Databricks Skill Builder27d ago
CommunityDelta Lake
Transactional apps on Databricks: Lakebase owns the decision, Delta gets the copy
databricks-community4d ago0 pts · 0 comments
CommunityWorkflows
What do you use for Databricks cost optimization beyond system tables?
reddit4d ago0 pts · 0 comments
ReleaseUnity Catalog
unitycatalog/unitycatalog — UnityCatalog 0.7.0 (v0.7.0)
unitycatalog/unitycatalog36d ago
VideoUnity CatalogHow Genie Ontology Enhances AI Cowork | Databricks Genie One Demo
Databricks42d ago
ReleaseLakeFlow
databricks/terraform-provider-databricks — v1.137.0
databricks/terraform-provider-databricks43d ago
Weekly digest
The week that mattered across the Databricks world — one email, Tuesday mornings.
Read past issues












