Skip to content
All topics

AI Functions

Recent items mentioning AI Functions across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.

23 recent items8 releases6 news9 community threads
What's happening in AI FunctionsAI synthesis · updated Nov 16, 2026

Databricks rolled out coordinated breaking changes to AI Functions batch processing across its Go, Java, and Python SDKs 234. The batch output reference field is now mandatory, and the expired status enum value has been removed across all three language clients 234.

Generated daily from the 6 most recent items mentioning AI Functions. Click any [N] to jump to the source.

Reddit

How I check every prompt before the LLM on Databricks: GovTech's LionGuard on a small CPU endpoint

I wanted one shared safety check that every agent, job or SQL query on Databricks calls before the LLM. How it works: - LionGuard 2 Lite from GovTech Singapore: a small classifier on Google's EmbeddingGemma. It scores insults, hate, violence, self-harm and misconduct, and it handles English, Singlish, Chinese, Malay and Tamil. - Packaged as one MLflow model, registered in Unity Catalog, served on a small CPU endpoint. - From SQL, ai_query sends each question to the guard. Only questions with an unsafe score under 0.5 go to the LLM. Results on 7 synthetic questions: a Singlish insult, a Malay threat, a harmful Chinese message and an English "how do I hack the website" question were blocked. Safe questions in English, Singlish and Tamil were answered. Lessons: - The full set-up took 25 minutes. 19 of them were the endpoint start. - Do not use scale to zero for a production guard (cold start). - Turn on inference tables from day one, so you can show what was blocked. - It does not detect prompt injection. That needs a separate check. How do you check prompts for your agents today? Built-in AI Gateway guardrails, a custom endpoint, or both? submitted by /u/sundarleads [link] [comments]

00sundarleads1w ago
Databricks CommunityTechnical Blog

AI Functions for Synthetic Test Data: Generate Realistic Datasets in Pure SQL

003w ago
Databricks CommunityCommunity Articles

Turning P&C Claim Documents into Structured Data with Databricks AI Functions

001mo ago
Reddit

Databricks ai_decide: The AI Judge That Never Writes a Word

Use Databricks ai_decide() to grade every ai_query output in SQL and decide what gets sent, without a second LLM submitted by /u/Lenkz [link] [comments]

00Lenkz1mo ago
Databricks CommunityGenerative AI

Routing between GLM 5.3 Flash and GLM 5.3 with ai_decide: a cheap router in front of ai_query

001mo ago
Reddit

AI is apparently getting a new name: SI (Super Intelligence)

Donald Trump said at the UN that super-intelligence will replace artificial intelligence in US government documents. If you work with Databricks, this probably sounds strangely familiar. So now I’m wondering… was Databricks just preparing for this? Because there are still plenty of names left: AI Search → SI Search? AI Functions → SI Functions? AI Runtime → SI Runtime? AI Gateway → SI Gateway? P.S. I keep track of Databricks renames and product changes on REbricked.org submitted by /u/Significant-Guest-14 [link] [comments]

00Significant-Guest-141mo ago
Reddit

Manager wants us to "use AI." Thinking about an AI-driven data testing framework for DevOps promotions. Sanity check?

Although we are using genie code alot but manager wants some functionality based on AI. ( maybe that’s hood goal). Our devs hate manually writing tests, so I'm drafting an automated testing gate for DevOps promotions (Local ➔ Dev ➔ QA). Wanted review with all of you. The Proposed Architecture: 1. Extract Metadata: Pull column tags, schemas, and lineage from Databricks Unity Catalog. 2. AI-Generated Tests (Llama via ⁠ai_query⁠ ): LLM reads metadata to draft SQL data checks (nulls, types, basic business logic). 3. Persist & Cache: Save SQL rules to a table. Re-generate only when schema hashes change so bug-fix retests stay 100% deterministic. 4. Execution: Run the generated SQL on a SQL Warehouse (fast, cheap, no LLM cost per data row). 5. Alerting: Feed error logs to LLM for a 2-sentence summary and send directly to Teams via Webhook (avoiding ignored email reports). How does it sound like? Is it really worth it? Anybody using this or any other AI based functionality to make devs life easy. submitted by /u/Terrible_Mud5318 [link] [comments]

00Terrible_Mud53182mo ago
Reddit

Databricks: 5 Minute Features - AI Functions

To celebrate that AI functions are now a fully governed part of Unity Catalog alongside the rest of your functions I thought it would be fun to do a run through of how easy it is to use. submitted by /u/Remarkable_Rock5474 [link] [comments]

00Remarkable_Rock54742mo ago
Reddit

Tagging individual ai_query() calls in SQL?

Essentially the title, but for background we’re using ai_query() in Databricks SQL Warehouse and our pipeline makes 3 LLM calls in parallel for different steps. We can see token usage/cost in system.ai_gateway.usage, but we can’t tell which call came from which step. From what I can tell, request tags are possible via the Python/rest sdk, but not through ai_query() in SQL. Has anyone found a workaround, or is moving the calls out of SQL currently the only option? Edit for clarity: the main thing we’re trying to do is join each pipeline step back to system.ai_gateway.usage so we can attribute token usage/cost to steps a/b/c etc submitted by /u/hulioshort [link] [comments]

00hulioshort3mo ago

Get Tuesday's version of this

Tracking AI Functions? The Tuesday email carries what moved across the whole ecosystem, not just this topic. Free, one-click unsubscribe.

Read past issues first