Lakeflow Declarative Pipelines

Lakeflow Declarative Pipelines was renamed - Databricks now calls it Lakeflow pipelines, as of November 2025.

Delta Live Tables → Lakeflow Declarative Pipelines → Lakeflow Spark Declarative Pipelines → Lakeflow pipelines

Declarative framework for batch and streaming ETL pipelines.

• You describe the tables you want and it works out the execution order and dependencies for you - and the DLT code written back in 2021 still runs unchanged under the new name. 🔗
• This name lasted about five months, making it one of the shortest-lived labels the product has ever worn. 🔗

⚠ Limitations: A workspace is limited to 1000 concurrent pipeline updates; a pipeline allows at most 100 source files (or 50 folder entries referencing up to 1000 files); pivot() is unsupported, Delta time travel works only on streaming tables not materialized views, and identity columns are incompatible with AUTO CDC processing. 🔗

Category

Data engineering

In use from

June 2025🔗

Renamed

November 2025🔗

Announced at

Data + AI Summit 2025🔗

Also known as

DLT

Verified

2026-08-20