Skip to content

AI Search High QPS

GA
Last seen at this status: 2026-07-15·Jul 2026

Lets you set a target queries per second on a standard AI Search endpoint, and Databricks provisions extra capacity to reach it on a best-effort basis; without it a standard endpoint serves roughly 20 to 200 QPS depending on index size. You set the target under Advanced Settings in the endpoint UI, or with target_qps in the Python SDK or REST API. The extra capacity is billed whether or not traffic uses it, it does not autoscale, storage-optimized endpoints are not supported, and only queries sent to the index URL with service principal OAuth get the higher throughput. It was documented as a Beta and then a Public Preview under the Vector Search name before it became generally available on July 15, 2026.

Status history

  • GA
    2026-07-15 · Jul 2026
    Release notes

    Verified on 2026-10-30 against Databricks sources.

Sources (2)

Status and dates are extracted from public sources only. We don't see the private AE-shared roadmap. If something looks wrong, tell us.