New feature
GA
Databricks Connect (13.3 LTS+)
Databricks Connect (13.3 LTS+) is a Databricks developer experience capability, introduced 2023.
Legacy Databricks Connect Databricks Connect (13.3 LTS+)
The client library for running local DataFrame and Python code against a remote Databricks cluster, rebuilt on Spark Connect.
- It's built on Spark Connect's gRPC client/server split, so ordinary PySpark DataFrame code on your laptop runs on a remote cluster with no code changes between local and remote.
- It requires Databricks Runtime 13.3 LTS or above.
Limitations: Doesn't support the display() API, Databricks Utilities (credentials, library, notebook workflow, widgets), SparkContext and RDDs, distributed ML training, or CREATE TABLE AS SELECT, with version-specific restrictions such as no streaming foreachBatch and no queries over 3600 seconds on Runtime 13.3 LTS and below.
Open in REbricked →- Category
- Developer experience
- Also known as
- Databricks Connect, databricks-connect
- Verified
- 2026-07-18
Sources
- Official Official Databricks / Microsoft docs
- Community Medium: Databricks Connect explained