SShortSingh.
Back to feed

Autoscaling doesn't save you at 30,000 requests per second — your dependencies do

0
·10 views

There's a comfortable story about peak traffic: load goes up, the autoscaler notices, pods multiply, everyone keeps their evening. I've watched that story hold, and I've watched it fail in a specific and instructive way — the autoscaler worked perfectly and the platform degraded anyway. Running transaction paths at sustained peaks in the tens of thousands of requests per second teaches you that horizontal scaling is the easy half of the problem. The hard half is that everything your new pods talk to did not scale, and now there are more of them asking. Scale-up triggers.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Migrating a Visual FoxPro system to .NET: an order of work that holds up

Over a two-and-a-half-year engagement I migrated 42 financial workflows from a legacy Visual FoxPro system to C# and .NET Core, as the sole engineer. The old system carried two decades of business logic and had no written specification. The domain layer was rebuilt on Entity Framework Core with 42 T-SQL stored procedures against SQL Server, the FoxPro reports were replaced with reporting workflows in a Blazor application, and the old system was retired. This is the order of work I would recommend to anyone facing the same kind of migration. Visual FoxPro mixes data, logic and screens in one pl

0
ProgrammingDEV Community ·

SaathiAI: An Open-Source AI Learning Companion I Built for a Friend

This is a submission for the Hacktoberfest Weekend Challenge: Build for a Friend. I built SaathiAI, an AI-powered learning companion designed to make exam preparation simpler, faster, and more focused. The idea came from a problem I have seen among my friends and classmates: before an exam, students often have large PDF notes and study materials but very limited time to revise them effectively. Finding a particular concept, simplifying a difficult topic, preparing university-style answers, creating practice questions, and revising important material can consume a significant amount of time. I