Kafka

Learn about Zerobus in 15 min!

Databricks Lakeflow Connect Zerobus Ingest is a high-performance, multi-cloud ingestion service that allows users to stream event data directly into their lakehouse without the cost and complexity of a traditional message bus. The video explains the architecture of Zerobus Ingest, announces upcoming API integrations for Kafka and MQTT, and demonstrates how to configure and run a Python client to write data directly into a Delta table.

How an Open, Scalable and Secure Data Platform is Powering Quick Commerce Swiggy's AI

No More Fragile Pipelines: Kafka and Iceberg the Declarative Way

Streaming Meets Governance: Building AI-Ready Tables With Confluent Tableflow and Unity Catalog

Sponsored by: Confluent | Turn SAP Data into AI-Powered Insights with Databricks

Creating a Custom PySpark Stream Reader with PySpark 4.0

Practical Pipelines: A Houseplant Alerting System with ksqlDB

Connecting the Dots with DataHub: Lakehouse and Beyond

Near Real-Time Analytics with Event Streaming, Live Tables, and Delta Sharing

Optimizing Speed and Scale of User-Facing Analytics Using Apache Kafka and Pinot

Backfill Streaming Data Pipelines in Kappa Architecture

Serverless Kafka and Apache Spark in a Multi-Cloud Data Lakehouse Architecture

Streaming Data into Delta Lake with Rust and Kafka