Skip to content
All videos
releasesDatabricks·July 19, 2022

Apache Spark on Kubernetes—Lessons Learned from Launching Millions of Spark Executors

Summary

The video explains the design and implementation of Apple's self-service elastic analytics platform, built on Kubernetes to scale Apache Spark. It shares lessons learned and pitfalls encountered while supporting Spark at scale, focusing on orchestration, security, monitoring, and workload optimization.

Summary generated by brickster.ai from the video transcript.

More from Databricks