How NASDAQ built a governed intelligence layer with dbt and Databricks
Summary
NASDAQ built a governed intelligence layer using dbt and Databricks to process up to a trillion messages daily across 26 business lines. Learn why they chose this combination for their data architecture.
Summary generated by brickster.ai. For the full article, follow the source link above.
More from dbt Labs Blog
Databricks processes your data. dbt defines what it means
Databricks handles compute while dbt governs the transformation logic that defines what the data actually means — yet organizations routinely bundle these as a single approval decision. The post argues executives should treat the platform choice and the transformation-logic choice as separate decisions, not one.
Model for the token, not the table
Modeling Gong call transcripts directly in the warehouse with dbt, instead of hitting Gong's API on every AI call, cut token costs by 20x. The takeaway: for AI workloads, model the data at the token level, not just the table level.
Why agentics projects fail and how to fix them
Why do some Databricks agentic AI deployments succeed while so many fail? The data points to specific, identifiable failure patterns—and this post breaks down what they are and how teams can fix them.