Skip to content
All topics

Model Serving

Recent items mentioning Model Serving across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.

55 recent items19 releases8 news20 videos8 community threads
What's happening in Model ServingAI synthesis · updated Nov 17, 2026

Databricks added a new provisioned throughput term field (pt_term / ptTerm) to PtServedModel across the latest Python and Java SDK releases 34. Concurrently, Model Serving is slated to launch on Azure Databricks on Azure Government ahead of planned FedRAMP and IL5 authorizations 1, while Databricks released end-to-end patterns for serving distilled 0.8B LLMs using Foundation Model APIs and Serverless GPUs 2.

Generated daily from the 7 most recent items mentioning Model Serving. Click any [N] to jump to the source.

Reddit

I'm building an AI data engineer that runs as a Databricks App. Here's what broke along the way

I'm the founder of AI Data Engineer, so take this with that in mind. I've worked with data for over ten years, first at a bank, then as a team lead. One thing never changed: the business asks for one new table, and it waits weeks for an engineer. So I built a Databricks App for that. You describe the table in plain English, the agent studies your Unity Catalog tables and asks business questions, and after you approve, it builds a Data Vault and the final mart as serverless jobs and keeps them updated on schedule. A few lessons from the last weeks: The model should not write SQL. It only proposes a plan: entities, keys, joins, rules. Plain code turns that plan into hubs, links, history satellites and the mart. Same plan, same tables, every time. Samples lie. My first checks ran on samples. On a 7.5M row table they said only 27% of orders matched a customer. The real number was 100%. Now every check runs on the full table through the SQL warehouse. The model doesn't need your data. It sees table structure and statistics, never values, and it's called through a Model Serving endpoint in your own workspace. If a rule needs a value, like "which status means paid", it asks a human. Open models aren't ready for this yet. I replayed real planning requests on the Qwen and GPT-OSS endpoints in Databricks. Valid JSON, but they skipped the business questions and guessed. One grouped monthly revenue by month without year, so March 1997 and March 1998 would be one row. Change Data Feed deletes hide the worst bugs. Delete keys came back as 40.0000000000 while the hub had 40, and 2,398 rows were marked deleted. Since then every build is reconciled against the source. Where it is now: a 30M row TPC-H mart matched a direct query on the source with zero mismatches across 3,213 checked cells, and an incremental build after 1,000 updates and 100 deletes matched exactly. Once a mart is built, one click makes an AI/BI dashboard and a Genie space on top of it. submitted by /u/No_Advertising2536 [link] [comments]

00No_Advertising25362w ago
Databricks CommunityDatabricks TV

Databricks Apps vs Model Serving: Authentication, Cost, and Performance Compared

001mo ago
Reddit

Use Genie Code outside the workspace

Hey! I’m a Databricks product manager working on third-party development experiences. We just shipped Genie Code CLI , a new coding agent specialised for data and AI work. We’d love for you to try it out and share what you want to see next! Why we built this: Many of you prefer working locally with agents, but these agents might not always know the best way to work with Databricks. We wanted to provide an agent preconfigured to understand your Databricks data, pipelines, models, and apps. Use this when you want: Minimal setup and maintenance to use an agent that works effectively with Databricks. Governance provided through Unity Gateway. Access to agents outside of the Databricks workspace without model subscriptions or contracts. Getting started: (1) Install the latest version of the Databricks CLI . (2) Install Genie Code CLI : macOS, Linux, WSL: curl -fsSL https://github.com/databricks/genie-code-cli/releases/latest/download/install.sh | bash Windows powershell: powershell -ExecutionPolicy Bypass -c "irm https://github.com/databricks/genie-code-cli/releases/latest/download/install.ps1 | iex" (3) Start an interactive session by running genie in your project directory. Note that usage is billed through Unity Gateway’s model serving capabilities . For full details, check out the Genie Code CLI docs . Share your feedback: We’re releasing this fast to get your input asap. Please leave feedback and questions in the comments or reach out directly with a Reddit message! submitted by /u/BricksTrixTwix [link] [comments]

00BricksTrixTwix1mo ago
Databricks CommunityTechnical Blog

Multi-region model serving on Databricks with OpenSharing

001mo ago
Databricks CommunityMachine Learning

Model Serving An internal error occurred during feature store lookup all deploys failing

002mo ago
Databricks CommunityTechnical Blog

Databricks AI Model Serving in production: scaling, cost, and latency lessons

004mo ago
Databricks CommunityGenerative AI

Azure OpenAI v1 API support for External Model Serving / Mosaic AI Gateway?

005mo ago
Databricks CommunityGet Started Discussions

Databricks Model Serving: The Complete Guide to Production ML at Scale

005mo ago

Get Tuesday's version of this

Tracking Model Serving? The Tuesday email carries what moved across the whole ecosystem, not just this topic. Free, one-click unsubscribe.

Read past issues first