SShortSingh.
TopTechnologyAI & MLStartupsProgrammingScienceBusinessFinanceCrypto & Web3World
Back to feed
Programming

How a Silent Linux Kernel Bug Nearly Derailed a 1 Million Connection Chat Server

0
·1 views

A engineering team scaling a Java-based chat platform to 1 million concurrent connections discovered that connection failures around the 800,000 mark were caused by a full nf_conntrack kernel table silently dropping packets with no application-level errors or alerts. The only clue was a single line buried in dmesg that no monitoring system was watching. To resolve the issue and reach their target scale, the team tuned several Linux kernel parameters including file descriptor limits, TCP send and receive buffers, and interface queue lengths. Buffer sizes were calculated using the bandwidth-delay product formula, with a 1 Gbps link and 130ms RTT yielding a target of roughly 17.5 MB per buffer. The experience highlighted that beyond a certain connection scale, kernel-level subsystems must be treated as part of the application's failure surface and monitored accordingly.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

OpenTofu Offers Native State Encryption to Secure Infrastructure Secrets at Rest

OpenTofu, the open-source Terraform fork, includes a native state and plan encryption feature that upstream Terraform lacks, addressing a long-standing security gap. Terraform and OpenTofu state files store sensitive data — such as database passwords, API tokens, and private keys — in plaintext JSON, making them vulnerable if accidentally exposed in CI artifacts, S3 buckets, or local commits. OpenTofu's encryption operates at the data layer before state is written anywhere, ensuring it remains encrypted in backends, local copies, and CI pipelines alike. The feature is configured via an encryption block supporting key providers such as PBKDF2 for simple setups or cloud KMS services like AWS KMS for production environments. Losing the encryption passphrase results in permanent loss of state, making secure key management a critical operational requirement alongside the feature.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

Developer builds TabInsights to replace four productivity browser extensions with one

A developer created TabInsights, a Chrome extension that combines a website blocker, Pomodoro timer, tab suspender, and time tracker into a single integrated tool. The frustration of managing four separate extensions that could not communicate with each other prompted the build, with the key feature being a timer that automatically activates and deactivates the website blocker. The extension was built with a strict privacy focus, making no external network requests and processing all data on-device. It is available on the Chrome Web Store for free, with an optional one-time $4.99 Pro upgrade unlocking features like scheduled blocking and cloud sync. The developer notes the project is in its early stages and is actively seeking user feedback.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

How a Telecom Platform Migrated 30M-User Monolith to Microservices With Zero Downtime

A telecom provisioning platform serving over 30 million subscribers successfully broke apart its legacy monolith into microservices without any service outage. The team adopted the Strangler Fig pattern, which involves placing a routing facade in front of the existing system and migrating one capability at a time while keeping the platform fully operational. Rather than attempting a risky full rewrite, each slice was chosen for being self-contained and testable, allowing the product team to continue shipping features throughout the migration. To prevent new services from becoming re-entangled with the old system, the team used an anti-corruption layer as a clean interface between the two architectures. This incremental approach meant the system was never in a broken half-migrated state, and each completed slice built organizational confidence for the next.

0 comments Read more at DEV Community
0
ProgrammingDEV Community ·

GPT, Claude, and DeepSeek tested on regex, refactoring, and SQL: who won?

A developer ran a structured comparison of GPT, Claude, and DeepSeek using identical prompts across three real-world coding tasks: CSV regex parsing, JavaScript refactoring, and a PostgreSQL consecutive-months query. On the regex task, GPT and Claude both produced working solutions, with Claude earning a slight edge for flagging a quadratic performance risk; DeepSeek initially refused and proposed an alternative approach instead. In the refactoring round, Claude delivered the cleanest result with no behavior changes, while GPT silently altered a boundary condition from greater-than to greater-than-or-equal, and DeepSeek played it safe but changed less than needed. The SQL gaps-and-islands problem flipped the standings, with DeepSeek producing the most concise and correct solution on the first attempt, while Claude's multi-step approach was valid but more verbose. Overall, no single model dominated all three tasks, suggesting each has distinct strengths depending on the type of problem.

0 comments Read more at DEV Community