Skip to content
All videos
newsDatabricks·November 5, 2026

Why the Creator of Delta Lake Says: Stop Writing ETL

Summary

Spark declarative pipelines, or SDP, allow engineers to define what data tables and transformations should exist rather than manually scripting how to execute them, letting the system handle the underlying orchestration, incremental updates, and error handling. Michael Armbrust and Alexandra Chashchina explain how SDP simplifies data pipelines across various workloads, improves cost efficiency, and reduces manual intervention compared to traditional Spark and Delta Live Tables approaches.

Summary generated by brickster.ai from the video transcript.

More from Databricks