Compute7 min
Undocumented Databricks: more task slots, not more nodes
CPU sits at 30 percent while the node count climbs, because what ran out is task slots, not cores. SPARK_WORKER_CORES runs more task threads on the same cores. Undocumented on Databricks, and paid for in heap.
August 2026verified August 2026mentions 2 entries