Lakebase Search: Build AI Retrieval for Agents with Lakebase Postgres

Description

Learn how to build end-to-end AI agent retrieval with Lakebase Search, bringing vector search, full-text search, and hybrid search directly into Lakebase Postgres. In this video, we explore how Lakebase Search enables scalable, low-latency retrieval with pgvector-compatible vector search, BM25 ranking, and hybrid search. Through hands-on demos, you'll see how AI agents can search operational data and memories, and how to build an automated retrieval pipeline using Lakebase CDF, Spark Declarative Pipelines, AI Functions, and Synced Tables to continuously chunk and embed as they change. All powered by the Databricks platform, without managing separate vector databases or complex data synchronization pipelines. Chapters: 0:00 Intro: Lakebase Search for AI agents 0:15 Why AI agents turn search into an OLTP workload 0:40 The limits of pgvector and tsvector in Postgres (BM25, vector databases) 1:33 Introducing Lakebase Search: lakebase_vector and lakebase_text 2:36 Hybrid search: semantic + full-text search in SQL 3:17 Reciprocal Rank Fusion (RRF) explained 3:43 Demo: search-as-you-type with full-text search 4:07 Demo: hybrid search results 4:25 Agentic search: let the agent choose t…

Description from YouTube. Full content on the video page.