Photon

Master Databricks 2nd Ed: Lesson 3 - Understanding Clusters

This video explains Databricks clusters, detailing their components like driver and worker nodes, configuration options such as autoscaling and Photon acceleration, and how to create and manage them within Azure. It also covers common interview questions related to cluster sizing and performance tuning, emphasizing that Databricks clusters are essentially Spark clusters enhanced with the Databricks runtime for cloud environments.

Top Performance and Cost Optimizations for DLT

Understanding Databricks & Apache Spark Performance Tuning: Lesson 02 - Spark Hardware

Databricks and Delta Lake: Lessons Learned from Building Akamai's Web Security Analytics Product

Best Exploration of Columnar Shuffle Design

Best Practices for Running Efficient Apache Spark™ Workloads on Databricks

Photon for Dummies: How Does this New Execution Engine Actually Work?

Radical Speed on the Lakehouse: Photon Under the Hood

Building a Lakehouse on AWS for Less with AWS Graviton and Photon

Delta Lake, the Foundation of Your Lakehouse

How AT&T Data Science Team Solved an Insurmountable Big Data Challenge on Databricks