Tableau Heartbeat Kept Databricks Warehouse Running All Weekend, Costing Team $14k
A software team was hit with a $14,000 cloud bill after a newly deployed data pipeline triggered an unexpected cost spike over a single weekend on Databricks Serverless SQL Warehouse. The culprit turned out to be a Tableau BI tool configured to send periodic heartbeat pings to the warehouse every 8 minutes — just under the 10-minute Auto-stop idle threshold. Because Databricks Serverless treated these sub-millisecond system metadata queries as active sessions, the warehouse never registered as idle and never shut down. The team had unknowingly been running a large, high-DBU warehouse around the clock simply to serve low-cost connection keep-alive requests. The fix involved severing the BI connection, splitting workloads across smaller and larger warehouses by use case, and reconfiguring connection strings to prevent the same idle-timer reset from recurring.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in