Azure Serverless GPU Costs Just $13/Month for Idle Speech-Synthesis App
A developer ran a speech-synthesis service on an NVIDIA T4 GPU via Azure Container Apps with serverless scaling for 48 days, tracking all costs through Azure Cost Management. The GPU itself cost only $2–7 per month, as charges appeared on just 12 of 48 days, with the app scaling to zero replicas after five minutes of inactivity. Surprisingly, Azure Container Registry storage at roughly $11 per month was the largest expense, driven by large CUDA images with bundled model weights and accumulated old image tags never being deleted. The main operational risk identified was accidentally leaving min-replicas set to 1 after a debugging session, which keeps a replica running and inflates GPU costs. The developer concluded that serverless GPU is highly cost-effective for internal tools tolerant of a five-minute cold start, but less suitable for customer-facing applications requiring instant availability.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in