Zerobus
Recent items mentioning Zerobus across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.
Databricks recently introduced Zerobus Ingest, a new serverless streaming API designed for petabyte-scale data pipelines with automatic scaling and high throughput 6. This technology is a key component of Lakeflow, a unified data engineering stack that also features AI-powered operations with Genie Zero Ops 34. While enabling massive data ingestion 5, there have been reports of Zerobus ingestion failures in Databricks Free Edition when using Service Principal OAuth 1.
Generated daily from the 6 most recent items mentioning Zerobus. Click any [N] to jump to the source.
Zerobus ingestion fails in Databricks Free Edition using Service Principal OAuth
Real Time Healthcare Analytics with Databricks Zerobus and Lakehouse RT via Reyden
EventsUnlocking agentic data engineering with Lakeflow + Genie
The video introduces Lakeflow as a unified, open data engineering stack that simplifies data transformation, ingestion, and orchestration through declarative pipelines, no-code tools, and managed services. It also announces Genie Zero Ops, an AI agent that automates data operations by autonomously detecting, diagnosing, and verifying fixes for data incidents and PII exposures within the data plane.
Lakeflow: A new era of agentic data engineering
Lakeflow unifies ingestion, transformation, and orchestration under Unity Catalog, providing a single source of trusted, real-time context for agentic AI. It offers high-performance ingestion from 100+ sources, real-time streaming, visual pipeline building with Lakeflow Designer, and AI-powered authoring and operations with Genie Code and Genie ZeroOps.
Petabyte scale with Zerobus ingest: Download the Code and Ingest the Milky Way
Ingesting the Milky Way: Petabyte-Scale with Zerobus Ingest
Zerobus Ingest, a new serverless streaming API, enables instant deployment of petabyte-scale data pipelines on Databricks without manual infrastructure management. Its dynamic partitioning architecture automatically scales compute and sustains over 12 GB/s throughput to a single table, efficiently handling unpredictable data volumes.
NewsZerobus Ingest, Lakebase and Databricks Apps in Action: Data Streaming with Databricks
The video demonstrates a real-time IoT data streaming application built with Zerobus for ingestion, Lakebase for low-latency serving, and Databricks Apps for the front and back ends. This architecture processes thousands of concurrent IoT events from mobile phone sensors globally without using Kafka or traditional complex pipelines.
From months to minutes: Building real-time clinical data pipelines with natural language
Databricks and Redox now enable real-time clinical data pipelines from EHRs to Unity Catalog with natural language prompts, reducing integration time from months to minutes. This partnership allows AI outputs to be written back into the EHR in real time, transforming Databricks into an operational layer for point-of-care interventions.
NewsZerobus Ingest and Lakebase in Action: Data Streaming with Databricks
The video demonstrates a real-time IoT data streaming application built with Zerobus for ingestion, Lakebase for low-latency serving, and Databricks apps for the front and back end, without relying on Kafka. It showcases how thousands of concurrent IoT events from mobile phone sensors worldwide are ingested, processed, and visualized on a map, with traces served by Lakebase for fast access.
Tutorials54 Zerobus Ingest Lakeflow Standard Connector | Ingest Streaming data directly into Delta Table
The video demonstrates how to use Databricks Zero Bus Ingest, a push-based API, to directly stream various data types like IoT, event, and telemetry data into Unity Catalog Delta tables. It highlights Zero Bus Ingest's ability to simplify streaming ingestion by eliminating the need for intermediate message buses and managing their infrastructure.