Description
Productionalizing ML models is hard. In fact, very few ML projects make it to production, and one of the hardest problems is data! Most AI platforms are disconnected from the data platform, making it challenging to keep features constantly updated and available in real-time. Offline/online skew prevents models from being used in real-time or, worse, introduces bugs and biases in production. Building systems to enable real-time inference requires valuable production engineering resources. As a result of these challenges, most ML models do not see the light of day. Learn how you can simplify production ML using Databricks Feature Store, the first feature store built on the data lakehouse. Data sources for features are drawn from a central data lakehouse, and the feature tables themselves are tables in the lakehouse, accessible in Spark and SQL for both machine learning and analytics use cases. Features, data pipelines, source data, and models can all be co-governed in a central platform. Feature Store is seamlessly integrated with Apache Spark™, enabling automatic lineage tracking, and with MLflow, enabling models to look up feature values at inference time automatically. See these…
Description from YouTube. Full content on the video page.
Topics
More from Databricks
NewsHow FOX Sports Uses AI to Power Search
Fox Sports rebuilt their search system on Databricks to handle rapidly changing sports information by continuously streaming player, team, and content data into the index while computing real-time trends. The system uses semantic vector search with time-weighted ranking to surface fresh content higher, doubling the rate at which users find what they're looking for.
NewsHow AI Helps Match Doctors With Communities in Need | Databricks for Good
Databricks provides pro bono services and compute discounts to help nonprofits stay lean through its Databricks for Good program. The video demonstrates the Virtue Foundation agent, which uses Genie and interactive hex maps to identify underserved populations and medical facility distribution in Kenya.
NewsOmnigent: Open-Source Meta-Harness for AI Agents | Matei Zaharia
Omnigen is an open-source meta-harness developed by Databricks that acts as an orchestration and control layer to wrap, manage, and combine multiple AI coding agents. The platform introduces contextual security policies, cost controls, multi-agent task routing, and sandbox integrations to enable collaborative workflows and centralized governance.
NewsBuilding Agents on Databricks with Custom Apps and Omnigent
This video demonstrates how to build, update, and govern custom AI agents on Databricks using Agent Bricks, Databricks Apps, and Omnigent. The tutorial shows how to integrate Model Context Protocol servers, track execution with MLflow traces, schedule automated agent tasks, and manage security policies through Unity AI Gateway.
NewsGoverning AI Strategy with Unity AI Gateway
The Unity AI gateway provides centralized monitoring, cost tracking, and governance for enterprise AI models, MCP servers, and coding agents. Administrators can use the platform to set budget limits, configure external providers, and enforce input policies that block personally identifiable information.
NewsAI for Mental Health: Crisis Text Line and Databricks
Crisis Text Line provides 24/7 text-based mental health support to millions of individuals facing crises like anxiety, bullying, and financial hardship. The organization uses the Databricks platform to safely analyze anonymized conversation data and improve how researchers understand and serve people in need.