SShortSingh.
Back to feed

Tailscale Traced 19 Database Corruptions Over 6 Months to a 16-Year-Old SQLite Bug

0
·4 views

Tailscale engineer Alex Chan published a postmortem detailing how the company's control plane suffered 19 separate SQLite database corruption incidents over six months, causing repeated downtime for affected tailnet shards. Each shard runs a single Go process with exclusive access to its SQLite database, a design that made the recurring corruption especially puzzling. Early incidents each required over an hour of recovery time, during which users on affected shards lost access to the admin console and API. After months of forensic investigation with no reproducible cause, the team traced the fault to a bug that had existed within SQLite itself for at least 16 years. The postmortem has drawn significant attention in the developer community for its methodical debugging approach, which its author argues is applicable to any team running relational databases in production.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

MgntUtils Cold Filtering Lets Teams Verify AI Token Savings on Their Own Log Data

A follow-up guide from the author of MgntUtils explains how technical and managerial decision-makers can independently verify AI token cost savings before making any production changes. The tool supports 'cold' stacktrace filtering, meaning it can process stacktraces already captured as text from existing logs, rather than only live exceptions. Users can run a small standalone Java program — isolated from their main systems — by adding the MgntUtils jar to a classpath and applying filters using their own company-specific package prefixes. The filtered and original stacktraces can then be compared by line count, byte size, or token count using a model's tokenizer to estimate real cost reductions. The approach is designed to let teams validate the tool's claims on their own data without relying solely on the author's published benchmarks.

0
ProgrammingDEV Community ·

Google AI Overviews Drive Down Clicks, Forcing SEO Teams to Rethink Metrics

Google's AI Overviews are accelerating a shift in search behavior, with users significantly less likely to click through to websites when an AI-generated summary appears, according to a Pew Research Center analysis from March 2025. Pew found that AI Overviews appeared in roughly 18% of searches, and when present, only about 8% of queries led to a click on a traditional result, while just 1% led to a click within the AI summary itself. Overall, approximately two-thirds of all Google searches ended without any click. The trend is forcing SEO and marketing teams to separate 'answer presence' — being cited in an AI summary — from actual audience acquisition, as the two no longer reliably translate into each other. Experts suggest that effective search measurement now requires tracking visibility, downstream engagement, and tangible business value as distinct outcomes rather than treating organic rankings and clicks as interchangeable signals.

0
ProgrammingHacker News ·

UT Austin Offers Free Online Course on Tocharian Ancient Language

The University of Texas at Austin hosts a free online resource called Tocharian Online through its Linguistics Research Center. The course covers Tocharian, an extinct Indo-European language once spoken in Central Asia. It is part of UT Austin's broader Early Indo-European Online series, which provides learning materials for ancient languages. The resource is publicly accessible and aimed at students and researchers interested in historical linguistics.