How Google's 2003 File System Paper Solved Storage at Planetary Scale

·3 views

Google's 2003 Google File System (GFS) paper established that hardware failures in large-scale infrastructure are routine rather than exceptional, forming the foundation for how the company stores massive volumes of data. YouTube alone receives roughly 1,000 terabytes of video uploads daily, requiring hundreds of thousands of machines where drive failures are constant and inevitable. GFS addressed this by distributing file chunks across many machines — called chunk servers — coordinated by a single master node that tracks file locations, mirroring how a local file system indexes blocks on a single drive. This architecture ensured no data was lost despite continuous hardware failures, and its open-source counterpart, HDFS, became the backbone of the big data industry for over a decade. Modern large-scale storage systems, including those powering YouTube today, are direct descendants of that original GFS design.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

nginx blocks new HTTP QUERY method while Caddy and Traefik pass it through

RFC 10008, which reached Proposed Standard in June 2025, introduces QUERY as a new HTTP method that is safe and idempotent like GET but can carry a request body like POST. A developer tested how major reverse proxies and frameworks handle QUERY requests by setting up a DigitalOcean droplet with FastAPI, Django, nginx 1.24.0, Caddy 2.11.4, and Traefik 3.7.10. Testing revealed that nginx silently rejects QUERY requests rather than forwarding them to the backend, while Caddy and Traefik passed the method through without issue. On the framework side, FastAPI handled QUERY correctly when explicitly configured, but Django's class-based views returned a 405 Method Not Allowed response despite following the same lowercase-dispatch pattern used for GET and POST. The findings highlight that adopting QUERY in production requires verifying compatibility at every layer of the stack, as the RFC itself does not specify how non-compliant intermediaries will behave.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How a Reckless 1958 Mass Card Drop in Fresno Seeded the Visa Network

In September 1958, Bank of America mailed 60,000 unsolicited, pre-activated credit cards to residents of Fresno, California, in a bid to force-start a payment network — an experiment that quickly spiraled into widespread fraud and over 20% delinquency, earning the internal nickname 'the Fresno Drop.' The stunt exposed a fundamental challenge of two-sided networks: cardholders won't adopt a card merchants won't accept, and merchants won't invest in infrastructure for a card customers don't carry. Diners Club had tackled a similar problem in 1950, when Frank McNamara personally persuaded New York restaurants and wealthy diners to join simultaneously, proving that payment intermediation between strangers could be a viable business. By the late 1960s, Bank of America's licensed BankAmericard network had expanded nationally but descended into chaos, with inconsistent fraud controls and chargeback rules threatening its survival. Bank manager Dee Hock resolved the crisis by designing a member-owned cooperative with universal, non-negotiable rules — a structure that became Visa in 1976.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Presibo Builds AI-Powered Continuous Care Loop to Bridge Gaps Between Hospital Visits

Presibo, a healthcare technology startup that began as a prescription management app during COVID-19, is developing an infrastructure designed to provide continuous patient monitoring rather than relying solely on periodic hospital appointments. The platform connects patients, smart medical devices such as blood pressure monitors and glucometers, an AI analysis layer, and healthcare professionals into what the company calls the Presibo Care Loop. Connected devices transmit readings directly into a patient's digital health record, allowing the system to track health trends over time instead of relying on isolated snapshots. An AI layer analyses this data to detect concerning patterns and routes alerts through an intelligent triage system, escalating cases to nurses, doctors, or emergency pathways based on severity. The company emphasises that the AI is intended to support healthcare professionals rather than replace them, keeping clinicians central to all care decisions.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

ChatGPT Surpasses 900 Million Weekly Users as OpenAI Closes $110B Investment Round

OpenAI announced in late February 2026 that ChatGPT has surpassed 900 million weekly active users, making it one of the most widely used AI products globally. The company also reported over 50 million consumer subscribers, more than 9 million paying business users, and 1.6 million weekly users of its coding tool Codex. Alongside the user metrics, OpenAI disclosed a $110 billion investment round backed by partners including Amazon, NVIDIA, and SoftBank to expand computing infrastructure and meet growing demand. OpenAI described ChatGPT as the primary entry point through which people first engage with AI, signaling its shift from a niche tool to a mainstream product. The figures suggest conversational AI has reached a scale where many employees, customers, and business stakeholders already have direct hands-on experience with it.

0 comments Read more at DEV Community