Smart Routing in Unity AI Gateway: Match frontier quality with 30%+ lower cost per task
Summary
Smart Routing in Databricks Unity AI Gateway automatically directs coding tasks to the optimal model and harness across the price/performance frontier, matching frontier-level quality while cutting cost per task by more than 30%. The feature addresses the growing diversity of models and harnesses practitioners face by handling that selection for them rather than requiring manual tuning.
Summary generated by brickster.ai. For the full article, follow the source link above.
More from Databricks Blog
Using AI_Functions in Your Data Warehouse: Top Use Cases
In most organizations, data warehouses hold structured data, while unstructured data...
How Scottish Water Made Its Capital Investment Data Conversational With Databricks Genie
Scottish Water replaced fragmented, specialist-dependent reporting with Databricks Genie and governed data layers, letting teams query capital investment data in natural language and get trusted answers on demand. By surfacing this through Microsoft Teams via Copilot, the utility put governed insights directly into the tools business users already work in. Client.listTools() called but server does not advertise tools capability - returning empty list
What are AI Hallucinations?
What are AI hallucinations, why does it matter, and what can enterprises do about it? Newer reasoning models from OpenAI and DeepSeek are actually hallucinating more than their predecessors, not less, making detection and prevention a must for any production deployment. Enterprises can curb the risk with retrieval-augmented generation, domain-specific fine-tuning, systematic evaluation frameworks, and strong data governance.
Databricks Network Configuration delivery to Tens of Millions of Serverless VMs
Databricks rebuilt serverless network configuration delivery around an event-driven pipeline, replacing synchronous upstream calls with background pre-computation served from a snapshot store, which removed expensive multi-service aggregation from the cluster-startup path. At billions of requests per day, the change cut RPC p99 latency by 98.5% (5,000ms to 75ms), lifted availability to 99.99%, and reduced upstream call volume by 86%.
How Amtrak is building the data backbone for its largest transformation in over 50 years
"Every new trainset is a data-generating asset. The intelligence platform that connects...
How a major freight railroad scaled pipeline creation with Genie Code
Freight railroad rolled out Databricks Genie Code to automatically modernize legacy data pipelines, cutting delivery time from days per table to minutes while hitting over 90% automation for new table ingestion. The approach used Genie Code's Agent Skills and Unity Catalog integration to preserve enterprise standards, metadata grounding, and expert review across hundreds of pipelines.