New feature
GA
AI Gateway
AI Gateway is a Databricks ai / ml capability, introduced September 2024.
A centralized governance and monitoring layer for model serving endpoints - permissions, rate limits, payload logging, and safety guardrails for the generative-AI models an organization uses.
- It bolts governance onto model serving without touching the model: flip it on and every request through an endpoint gets rate-limited, guardrailed, and logged to an inference table - and if an external model fails, it can fall back to another one on the same endpoint.
- It entered public preview in September 2024 as "Mosaic AI Gateway," a centralized service that streamlines the usage and management of the generative-AI models an organization uses.
- Category
- AI / ML
- Also known as
- Mosaic AI Gateway, Unity AI Gateway
- Verified
- 2026-07-23