renamed
MLflow AI Gateway
MLflow AI Gateway was renamed - Databricks now calls it External models, as of December 2023.
MLflow AI Gateway External models
A 2023 enterprise API gateway for large language models that let an organization centralize governance, credential management, and rate limits for its model APIs - SaaS LLMs and Databricks Model Serving endpoints alike - behind named Routes.
- Everything hung off an object called a Route - you handed out Routes instead of API keys, so teams could call an LLM without ever seeing its credentials.
- MLflow 2.7's new prompt engineering UI was built on top of it, working with any MLflow AI Gateway route.
- Not to be confused with the Mosaic AI Gateway that arrived in September 2024 - a different product with a very similar name, to which this gateway's own 2023 announcement URL, /blog/announcing-mlflow-ai-gateway, now redirects.
- Category
- AI / ML
- Also known as
- AI Gateway routes, mlflow.gateway
- Verified
- 2026-09-27
Sources
- Official Official Databricks / Microsoft docs
- Official Databricks Blog: Using MLflow AI Gateway and Llama 2 to Build Generative AI Apps (August 24, 2023)
- Official Databricks Blog: Build GenAI Apps Faster with New Foundation Model Capabilities - "External Models (formerly AI Gateway)" (December 11, 2023)
- Community MLflow 2.9.0 docs: MLflow AI Gateway Migration Guide - the gateway is deprecated, Routes become endpoints
- Official Databricks docs: the old AI Gateway docs address, which now redirects to the External models page