Skip to content
All topics

AI Agents

Recent items mentioning AI Agents across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.

60 recent items30 news15 videos15 community threads

What is AI Agents?

On Databricks, an AI agent is an LLM application that can reason over your company's data and call tools, built and run inside the same platform that holds the data. The headline product is Agent Bricks, a set of managed agent builders: Knowledge Assistant turns your documents into a domain-specific chatbot through a point-and-click interface, and Supervisor Agent orchestrates other components, including Genie Agents, agent endpoints, Unity Catalog functions, MCP servers, and custom agents.

The hard part of shipping an agent is rarely the first prototype. It's proving answer quality, tracing what the agent actually did, and governing who can call it. Databricks folds those steps into the platform: agents can be registered in Unity Catalog, MLflow handles tracing and evaluation, and you aren't locked into one framework, since code-first agents can be written in Python with any authoring library, including LangGraph, LangChain, OpenAI, and LlamaIndex.

Maturity varies by piece. Knowledge Assistant has been GA since January 2026, while Agent services, the part that registers agents in Unity Catalog, is still in beta. The overall direction is toward agents you configure and the platform optimizes, instead of pipelines you tune by hand.

What is Agent Bricks?

Agent Bricks is the managed agent-builder layer on Databricks. Its current offerings include Knowledge Assistant, which builds and optimizes a domain-specific chatbot over your documents through a configuration interface, and Supervisor Agent, which orchestrates other agents such as Genie Agents, agent endpoints, Unity Catalog functions, MCP servers, and custom agents.

Can I write my own agents in code instead of using Agent Bricks?

Yes. Databricks supports agents authored in Python with any library, including LangGraph, LangChain, OpenAI, and LlamaIndex. You still get the platform services around them, such as MLflow Tracing for end-to-end observability and agent evaluation, regardless of which framework you pick.

What's the difference between Agent Bricks and Genie Agents?

Genie Agents answer natural-language questions about structured data by generating SQL over curated Unity Catalog datasets. Agent Bricks builds task-focused agents, like document Q&A with Knowledge Assistant or multi-agent orchestration with Supervisor Agent. The two connect: Supervisor Agent can call Genie Agents as one of the agent types it coordinates.

Is Agent Bricks generally available?

Partly. Knowledge Assistant reached general availability on January 27, 2026. Other pieces, such as Agent services for registering agents in Unity Catalog, remain in beta, so check the docs page for each component's current status before you build on it.

Sources: Agent Bricks (Databricks docs) · Build gen AI apps and agents (Databricks docs) · Knowledge Assistant GA announcement (Databricks blog)

What's happening in AI AgentsAI synthesis · updated Nov 18, 2026

Unity Gateway has expanded its agent governance capabilities, introducing Insights to identify cost inefficiencies like failing MCP tools and redundant tasks 2 as organizations like Block adopt it to centrally route multi-agent workflows 10. At the infrastructure layer, Lakebase provides database branching to safely test AI agents against operational data 3, while Lakehouse//RT absorbs agent-driven query spikes at 6x to 10x lower infrastructure costs 9.

Generated daily from the 10 most recent items mentioning AI Agents. Click any [N] to jump to the source.

Reddit

AI Agents & Precedent: Three Gates Before Reusing a Decision

submitted by /u/Berserk_l_ [link] [comments]

00Berserk_l_yesterday
Reddit

I tried to break my own open-source safety check for agent writes on Databricks: 5 SQL attacks, a 2M-row Delta table, 2 real bugs found

A pipeline can run green and still ship wrong data. With AI agents writing more of our code, I wanted a check before changes reach production. https://preview.redd.it/3w9kidmk8w0i1.png?width=1280&format=png&auto=webp&s=99f764348291e6a0c2a31dc1cb6d2c7028717153 bricksentry (free, open source) tells you three things before a change ships: • Who depends on this table (Unity Catalog lineage) • What the change does to the data (rows added, removed, duplicated, totals moved) • How to undo it (the exact Delta restore point) Created by Author. Created by Author. Then it says OK, warn, needs a human, or block. I tried to break it on a 2M-row table. Production was never touched, and I fixed three bugs along the way. Created by Author. Website and docs: bricksentry.org Code (Apache-2.0): github.com/bricksentry/bricksentry Package: pypi.org/project/bricksentry If you’re running agents against Databricks today, I’d like to hear how you handle change-safety, and what breaks when you run bricksentry on your own tables. submitted by /u/According-Future5536 [link] [comments]

00According-Future55361w ago
Reddit

Why use data bricks AI to build agents?

OK y’all, help me understand why it would be beneficial for me to use databricks AI (genie) if it will only integrate with databricks stack? I would much rather use an agentic soliton that will not lock me into a vendor’s tech stack. I’m trying to make the case that using another third party agentic platform that has native databricks integration would be much better than getting locked into databricks. Ideally since using a third party agentic solution to build agents would allow for easier integration with other systems that are outside databricks. Similar to how I wouldn’t use agentforce in salesforce, I wouldn’t use genie in databricks. What have been your experience with agents/AI solutions with genie? submitted by /u/vandev_ [link] [comments]

00vandev_1w ago
Reddit

We pointed an AI agent at 146M NYC taxi rows and asked it to build a Data Vault mart. Here's what broke.

A while ago I said I'd run our agent on dirty data, not clean TPC-H. Here's the first run. Setup. NYC yellow taxi 2015 from databricks-datasets: 146,112,990 rows in one Delta table, CDF on. Serverless jobs, a trial workspace. The request in plain English: "Monthly revenue, number of trips and average tip by payment type and passenger count". The agent profiles the source (structure and stats only, it never sees values), proposes hub/satellite/mart, asks questions, a human approves, then it generates and runs the jobs. What the agent got right on its own: - total_amount is broken in this dataset (≈0.3 in almost every row, 31 distinct values across 146M). The agent flagged it and proposed revenue = fare + extras + tax + tip + tolls. - There is no natural trip key. It picked vendor + pickup/dropoff time + coordinates. What broke (our bugs, not the data's): The key check pulled 200k distinct key values into the app and hit Databricks' 25 MB inline result limit. Now counted in the warehouse. A 7-column composite key of mixed types (string, timestamps, doubles) broke the hash on serverless: ANSI mode coerced the array to TIMESTAMP and died on vendor_id = '1'. The rejected-rows path had never actually run on Databricks. The worst one: that "unique" key wasn't. 51,306 keys repeat, mostly a charge and its reversal (fare 3.0 and -3.0) at the same second. SCD2 got both versions in one batch, closed both, and 51,280 trips silently vanished from the mart. Uniqueness had only been checked on a 200k-row sample. The fix: uniqueness is now checked on the whole table (6 s on 146M). If keys repeat, the agent asks you what to do instead of deciding. At load, one row per key is kept by a deterministic rule and the rest go to skipped rows with a reason, not into the void. Result after the fix: - Mart = vault in all 435 groups, trips and revenue to the cent. 146,061,125 trips = the number of unique keys in the source. - Full build 18 min. With CDF, an empty build takes 2.8 min. - Added 100k new trips plus updates and deletes through CDF: 4.6–5.2 min per build, 2015 numbers didn't move by a cent. - A second mart on the same data (daily trips by vendor) reused the vault and built in 2.8 min with no reload. Same total. Still open: - Keeping one row out of a charge/reversal pair is a business call; the right answer for taxi is probably a multi-active satellite. - On CDF, the same key arriving in different source versions isn't flagged as a duplicate. - Key format chaos (40 vs 40.0, spaces, case) is next on the list. Happy to share the reconciliation queries if anyone wants to poke holes in this. submitted by /u/No_Advertising2536 [link] [comments]

00No_Advertising25362w ago
Reddit

DataRanger: High-Performance Distributed Data Framework for Scalable Streaming and Agentic Workloads

![img](d8tafvgmtyyh1 "DataRanger in Action") **Author:** Akshay Sharma (Lead Member of Technical Staff, Salesforce | IEEE Senior Member) **Repository:** [` https://github.com/akshaysharma1088/dataranger\`\](https://github.com/akshaysharma1088/dataranger) # Abstract & Core Motivation Modern enterprise data architectures and autonomous AI pipelines frequently hit severe scaling, latency, and cost bottlenecks when processing high-concurrency, real-time data streams. Existing frameworks often force engineering teams to choose between compute efficiency and operational complexity. **DataRanger** is a novel, open-source distributed systems framework engineered to streamline data management, execution, and state handling across complex production environments. # Key Architectural Features * **Optimized Distributed Streaming:** Bridges traditional medallion architecture layers with high-throughput stream processing to eliminate unnecessary compute overhead. * **Agentic Context & Data Interoperability:** Designed to support modern agentic runtimes by efficiently serving low-latency, context-rich data structures without scaling friction. * **Reproducible Systems Evaluation:** Built and benchmarked for rigorous systems performance validation, targeting top-tier database venue submission (PVLDB). # Access & Archival Reference * **Source Code:** Available on GitHub under `akshaysharma1088/dataranger`. * **Archival & DOI:** Permanent release records and pre-prints are archived via **Zenodo** to ensure citable, open-access distribution for the systems engineering community. Article DOI - [ https://doi.org/10.5281/zenodo.23852354\](https://doi.org/10.5281/zenodo.23852354) submitted by /u/GuidanceBrief612 [link] [comments]

00GuidanceBrief6122w ago
Reddit

Does agentic analytics need a separate semantic layer if the data is already well modeled?

submitted by /u/Apprehensive_Tie2494 [link] [comments]

00Apprehensive_Tie24942w ago
Reddit

unit tests

Hi, we use Databricks, this is not 100% Databricks related, but i wonder, how do you do your unit testing with todays agentic engineering, currently we don't have any skill or rule, or hook that helps AI to write unit tests, so it just writes a lot of bloat unit tests which we do not trust, it has more than 1000 unit tests on 30k lines of code. I see a lot of mentioning mutation testing, did not check that out yet, but in general how do you approach this? Because unit tests should be a useful guardrail for agentic coding. submitted by /u/ptab0211 [link] [comments]

00ptab02112w ago
Databricks CommunityData Engineering

AI Agents Should Not Start Every Conversation From Zero

002w ago
Reddit

Agentic code converter is GA for SQL

Migration · GA Agentic code converter is GA for SQL Genie Code converts T-SQL, Snowflake, Redshift, Oracle, BigQuery, and Teradata SQL to Databricks SQL. It validates each file and fixes errors before writing to a workspace folder. Work in a migration project, or run /migrate in a Genie Code chat for one file or folder. Afterward, keep chatting to clear action items. The Notebooks target is not part of this GA. https://preview.redd.it/u5m0quj71fyh1.png?width=1808&format=png&auto=webp&s=1a5f16a1d66fa88e9bc171e10efb16c33dadfa2b Looking to migrate workloads but don't have the labor to do so. This is going to continue to expand its SQL dialect but taking an agentic approach to migrations really speeds up migrations and cuts down on time/money from labor submitted by /u/Wise_Ear_4064 [link] [comments]

00Wise_Ear_40642w ago
HackerNews

Show HN: 10x faster, 3x cheaper ETL

For the past few months our team has been working on an agentic framework that takes large, expensive SQL workloads and compiles them to Rust, backed by a formal proof of correctness. This is the sort of work I used to do by hand as a systems performance engineer, but now it happens in hours instead of months. We first redid our internal pipelines with this technique and they're now 10x faster and 3x cheaper. Next, we went live with our Snowflake and Databricks SQL customers. They're seeing similar results with critical production workloads that originally cost 6-7 figures per year. We'll be publishing benchmarks and code samples over the coming weeks; for now, you can read a bit more (and watch our anime launch trailer) on the site. Happy to answer questions about how it all works. --- top comments --- [gtirloni] Why was SQL slow? Where did processing shift to?

11karamazov3w ago
Reddit

Do any other teams build web apps for fully flexible analytics/reporting?

Databricks dashboards are extremely limiting in their flexibility/capabilities (and I don't see that changing as they pursue everything AI/Agentic) and tools like Power BI have shitty CI/CD processes and still have their visualization limitations. Has anyone moved reporting/analytics to React/App Kit applications on Databricks for greater flexibility and ease of CI/CD? submitted by /u/TheOnlinePolak [link] [comments]

00TheOnlinePolak3w ago
Reddit

Enterprise Data with AI Agents: A Data Platform Guide

submitted by /u/codingdecently [link] [comments]

00codingdecently3w ago
Databricks CommunityLakebase Articles

Test on a Branch, Not on Patients: Agentic Drug Substitution with Lakebase

003w ago
Reddit

AI Agent Memory

Databricks supports agent memory storage. The amazing part is that Lakebase stores the memory, so we can also inspect the saved record. We can save "User prefers Mexican recipes" and recall it through a client with the question "What should I cook for dinner?" more news https://medium.com/databrickscommunity/databricks-news-genie-cli-app-builder-agent-memory-dabs-41820427fcc2 submitted by /u/hubert-dudek [link] [comments]

00hubert-dudek3w ago
Databricks CommunityDatabricks TV

Agent Bricks: Production Ready AI Agents on your Enterprise Data

003w ago

Get Tuesday's version of this

Tracking AI Agents? The Tuesday email carries what moved across the whole ecosystem, not just this topic. Free, one-click unsubscribe.

Read past issues first