SShortSingh.
Back to feed

Self-taught developer cuts $82 weekly hosting bill by fixing caching and bot traffic flaws

0
·3 views

A first-time developer building a personal movie-discovery website was shocked to find his hosting costs reaching $82 per week despite having only two users. Investigation revealed four main cost drivers: a misconfigured caching system billing in 8 KB chunks, duplicate URL variants being cached separately due to missing URL canonicalization, and movie posters being stored expensively in paid cache despite rarely being accessed. The site was also making unnecessary internal HTTP requests to its own API on every page load, effectively generating self-inflicted traffic that doubled costs. Additionally, aggressive third-party bots — including SEO crawlers and a scraper farm using spoofed browser identities — accounted for a significant share of requests, which were addressed through robots.txt rules, HTTP 410 responses for dead pages, and TLS fingerprint-based firewall blocking.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

DreamLayer lets developers build AR glasses plugins in 25 lines of Python

DreamLayer is an open-source memory layer for AR glasses, released under the Apache-2.0 license, that supports a plugin system called lenses. Developers can build a minimal working lens in roughly 25 lines of Python without any physical hardware. The framework includes CLI tools for validating, previewing, and packaging plugins, as well as a browser-based simulator that runs the real renderer. Each plugin installation goes through an automated validation gate that checks manifest structure, checksum integrity, and capability usage. Completed plugins can be submitted to the public registry via a pull request or sideloaded directly through the control panel.

0
ProgrammingHacker News ·

Stanford Releases Free Online Textbook on Wireless Communication Fundamentals

Stanford University has made a textbook titled 'Fundamentals of Wireless Communication' freely available online. The book is authored by David Tse, a professor at Stanford, and covers core concepts in wireless communication systems. The resource was shared on Hacker News, where it attracted reader attention. Such open-access academic materials provide students and engineers with foundational knowledge in wireless technology without cost barriers.

0
ProgrammingDEV Community ·

Why Copy-Paste Still Breaks Across Operating Systems in 2026

Copying and pasting content across different operating systems — such as Linux, macOS, and Windows — remains a persistent challenge for developers despite decades of computing progress. Each OS stores clipboard data in its own proprietary formats, making rich text, images, and app-specific content difficult to transfer reliably between platforms. Security sandboxing, which isolates operating environments to prevent unauthorized data access, is another intentional barrier that complicates cross-OS clipboard sharing. The absence of a universal, secure network protocol for clipboard synchronization means users must rely on cumbersome workarounds like emailing themselves, using cloud storage, or pasting into messaging apps. While Apple has largely solved this within its own ecosystem through Universal Clipboard, seamless cross-vendor clipboard sync remains an unsolved problem.

0
ProgrammingDEV Community ·

DocuChat offers lawyers a self-hosted, offline AI tool with verified citations

DocuChat is an open-source, locally hosted document chat application built specifically for legal professionals who need to query sensitive files without exposing them to third-party cloud services. The tool runs entirely on a lawyer's own machine using local AI models via Ollama, a FastAPI backend, and a LanceDB vector store, requiring no API keys from providers like OpenAI or Google. A key feature is its citation verification system, which checks whether any source quote proposed by the AI model actually appears in the retrieved document at the claimed location — dropping unverifiable claims rather than displaying them. The app supports contracts, deposition transcripts, pleadings, scanned PDFs, and discovery bundles, with matter-scoped retrieval to prevent data from one client file bleeding into another. The project is available on GitHub, where its developers are seeking community validation to continue development.