Spark RT Mode
Recent items mentioning Spark RT Mode across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.
Databricks recently showcased the significant latency reductions achieved with Apache Spark Streaming Real-Time Mode (RTM), demonstrating P50 and P95 latencies of 26ms and 50ms respectively in a simplified setup 2. This capability was further highlighted in a real-time air traffic control application, achieving sub-second end-to-end latency for processing live flight telemetry and generating alerts 3. A recent community deep-dive also featured Databricks' Zerobus event data ingestion, likely leveraging these real-time streaming advancements 1.
Generated daily from the 3 most recent items mentioning Spark RT Mode. Click any [N] to jump to the source.
Databricks' Zerobus Event Data Ingestion Deep-Dive Demo (w/ Databricks' Staff Developer)
So very excited to share this demo + presentation with the one and only, [Scott Haines](https://www.linkedin.com/feed#), Staff Developer Advocate @ [Databricks](https://www.linkedin.com/feed#). The topic? Zerobus, which is a great option for easily ingesting event data at scale into Unity Catalog. We do a demo and overview of the technology, talk about how it is similar & different to Kafka, when to use Real-Time Mode vs Zerobus, and much more! Hope you enjoy this very technical overview!
TutorialsApache Spark Streaming Real-Time Mode - Latency Demo
The video demonstrates how to deploy and run Apache Spark Streaming in Real-Time Mode (RTM) using a declarative automation bundle. It shows that RTM significantly reduces P50 and P95 latencies compared to microbatch mode, achieving 26ms and 50ms respectively in a simplified setup without an external messaging bus.
TutorialsAir Traffic Control with Apache Spark Structured Streaming Real-Time Mode
The video demonstrates building a real-time air traffic control application using Apache Spark Structured Streaming Real-Time Mode, Lakehouse, and Databricks Apps. This system processes live flight telemetry, detects congestion, and generates alerts with sub-second end-to-end latency, all within a single Databricks platform.
NewsDatabricks: What’s new in September 2025? #databricks
Databricks now supports geospatial data types (geography and geometry) with new functions for visualization and spatial operations, and introduces serverless GPU clusters for distributed GPU code execution. The platform also offers enhanced notebook features like side-by-side editing and a notebook-specific search, along with new options for managing serverless environments, SQL warehouses, and access requests in Unity Catalog.
News
