Skip to content
All videos
newsDatabricks·July 22, 2020

How Adobe Does 2 Million Records Per Second Using Apache Spark!

Summary

Adobe shares Apache Spark lessons from its Unified Profile System, the heart of Experience Platform, which ingests terabytes a day and holds petabytes. Topics include caching physical plans for repeated queries, understanding joins and shuffle, monitoring Kafka consumer lag and backpressure in Structured Streaming, handling skew, sampling, and pairing pipelining with Redis.

Summary generated by brickster.ai from the video transcript.

More from Databricks