DataFrame caching on serverless compute

Lets df.cache() and df.persist() work on serverless compute: Databricks computes the DataFrame once, materializes the result as a snapshot and reuses it for the rest of the session. It has been in Public Preview since October 23, 2026, on by default for most workspaces but not available with the compliance security profile, and needs serverless environment version 5 or above, Databricks Connect for Python 18.1.8 or above or Databricks Connect for Scala 18.1.5 or above.

Statuses and dates come from public Databricks sources only. We do not see the private roadmap Databricks shares with customers. If something looks wrong, report a correction.