LLM
Recent items mentioning LLM across the Databricks ecosystem — releases, news, videos, and community Q&A. Updated hourly.
Databricks is enhancing LLM governance and orchestration with the Unity AI Gateway now managing MCP servers alongside built-in foundation models 1. MLflow provides comprehensive tools for building, evaluating, and deploying high-quality AI agents, including observability, automated evaluation, and prompt optimization 3. LLM agents are also demonstrating practical applications, such as improving Databricks join order optimization by 1.3x in 80% of cases 8.
Generated daily from the 9 most recent items mentioning LLM. Click any [N] to jump to the source.
NewsGovern MCP servers in Databricks #databricks #mcp #aigovernance
Databricks Unity AI Gateway now governs MCP servers, centralizing their management alongside built-in foundation models and LLMs. This integration allows for easier governance and orchestration of various AI components and agents within Databricks.
TutorialsHow to Build an AI Security Governance Hub with Agent Bricks
Databricks Agent Bricks enables building an AI Security Governance Hub by transforming static security playbooks into adaptive multi-agent systems. The video demonstrates combining a knowledge assistant for unstructured documents and a Genie space for structured data into a supervisor agent, then details how to tune and monitor these agents for improved performance and data privacy.
EventsBuilding Trustworthy, High-Quality AI Agents with MLflow
MLflow provides a comprehensive platform for building, evaluating, and deploying high-quality AI agents, offering tools for observability, automated evaluation, prompt optimization, and production monitoring. It enables developers to streamline the agent development lifecycle, from prototyping and testing with human and AI judges to fixing issues and ensuring reliable, governed deployment.
LLMs access to few delta tables inside unity catalog
I want llm to access few tables (not all tables) either through an api endpoint or mcp. Which is the cleanest way? And secure as well Do I create service principles or genie mcp (add only specific tables to genie space)
LLM Vs AI: A Practical Guide to Differences, Use Cases, and Tools
LLMs are a subset of AI, and this guide clarifies their practical differences, use cases, and tools. Understand how LLMs fit into the broader AI landscape and what that means for your Databricks workflows.
AI Applications: Tools, Use Cases, and Platforms
AI applications span four capability tiers, each with distinct data requirements and evaluation frameworks, and enterprise deployments often stall due to inadequate data infrastructure. Production-grade model development, from prompt engineering to pretraining, is increasingly accessible with open-source LLMs, but requires pre-built governance and monitoring infrastructure for successful deployment at scale.
News01 From AI to Agents| Fundamentals of AI | ML | DL | LLM & GenAI | How LLMs work | What are Agents
The video explains the fundamental concepts of AI, ML, DL, LLMs, and GenAI, illustrating their hierarchical relationship as subsets of each other. It also defines what models are (mathematical formulas trained on data) and how agents combine LLMs with tools and optional memory to perform autonomous tasks.
Are LLM agents good at join order optimization?
LLM agents can improve Databricks join order optimization, achieving 1.3x latency reduction in 80% of cases by reasoning through runtime statistics. This prototype demonstrates LLM agents' potential to act as data-driven DBAs, addressing cardinality misestimation challenges in complex SQL queries.
NewsGenAI - For Data Engineers Agenda & Introduction | LLM & Agentic AI | LangChain & LangGraph | Claude
This video introduces a new course, "GenAI for Data Engineers," designed to teach data engineers how to leverage generative AI, LLMs, and agentic AI. The course covers basics of LLMs, building agents with LangChain and LangGraph, using Cloud Code, and applying agentic AI within Databricks and data engineering workflows.
Introducing MLflow AI Gateway: Governed, Observable Access to LLMs
MLflow AI Gateway provides a single, secure endpoint for all LLM providers, complete with usage tracking and native tracing. This new feature offers governed, observable access to LLMs for Databricks practitioners.
MemAlign: Building Better LLM Judges From Human Feedback With Scalable Memory
MemAlign, a new framework for aligning LLMs with human feedback, is now available, offering competitive or better quality than state-of-the-art prompt optimizers at significantly lower cost and latency. It achieves this through a lightweight dual-memory system, making it a valuable tool for building better LLM judges.
NewsVibe-Engineering LakeFlow Pipelines, the Advancing Analytics Way
Advancing Analytics introduces Lake Forge, an engineering framework that uses LLMs and an agentic workflow to generate standardized LakeFlow pipeline templates from data specifications. This system aims to enable scalable, repeatable, and supportable data pipeline creation by balancing AI-driven "vibe coding" with human-engineered guardrails and validation loops.
NewsAI Agents in Action: Structuring Unstructured Data on Demand With Databricks and Unstructured
TutorialsSponsored by: West Monroe | Disruptive Forces: LLMs and the New Age of Data Engineering
Unity Catalog AI 0.2.0
This release introduces new integrations for Gemini and LiteLLM, enabling Unity Catalog functions as tools for these models. The Databricks client now exclusively supports serverless endpoints, adds new APIs for function wrapping, and includes support for `requirements`, `environment_version`, and `Variant` types.
NewsSponsored: EY | Business Value Unleashed: Real-World Accelerating AI & Data-Centric Transformation
NewsAI Regulation is Coming: The EU AI Act and How Databricks Can Help with Compliance
NewsIFC's MALENA Provides Analytics for ESG Reviews in Emerging Markets Using NLP and LLMs
NewsLive from the Lakehouse: LLMs, LangChain, and analytics engineering workflow with dbt Labs
News
