Facebook's Inbox Search Problem Led to the Cassandra Distributed Database

·4 views

The piece explores how a messaging app's search feature can strain a traditional database as message volume grows into the billions. It notes that PostgreSQL's full-text search and GIN indexes are mature and workable, but scaling them brings added architectural trade-offs around partitioning, replicas, and index maintenance costs. Facebook's 2008 Inbox Search work is highlighted as a case where storing reverse message indexes across many commodity servers motivated the creation of Cassandra. The author stresses that PostgreSQL is not inherently wrong for this use case, but that some workloads favor a storage design built for distribution and high write throughput.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Guide Explains How C2PA and Other Metadata Can Be Removed From Images

A guide published on DEV Community explains the different types of information stored in image files, including C2PA Content Credentials, EXIF, XMP, and invisible pixel watermarks. It notes that C2PA is an open, signed provenance standard, while EXIF and XMP are older metadata formats that record camera, location, and editing details. The article points out that removing metadata does not eliminate pixel-level watermarks such as Google SynthID, and that platforms may use other signals to label AI content. It also outlines legitimate reasons for stripping metadata, such as privacy and file hygiene, and compares lossless removal with re-export methods that can reduce image quality.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Palo Alto Networks Reportedly Eyes $500M Clutch Security Deal Over AI Agent Credentials

Palo Alto Networks is reportedly prepared to pay about $500 million for Clutch Security, a three-year-old startup with roughly $10 million in annual revenue. The deal would target the non-human identities, such as API keys, service accounts, and tokens, that AI agents use inside enterprise systems. The article notes that such identities greatly outnumber human accounts, and that few are under identity-governance oversight. It also cites research showing most enterprise permissions go unused and that only a minority of organizations feel able to control their AI agents. Similar acquisitions by Cyera, Cisco, and CrowdStrike are cited as evidence of a broader industry race for this security category.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Open-source guide shows how to learn programming on an Android phone alone

A developer has released Awesome Mobile Dev, an open-source project aimed at helping people learn programming without a laptop or desktop computer. The curated list covers tools such as Termux, a terminal environment for Android, along with code editors and resources for languages including Python, JavaScript, Rust and Go. It also includes material on Git and GitHub, Android app development, and Linux and SSH tools. The creator says a smartphone should not be a barrier to learning to code or contributing to open-source projects. The project is hosted on GitHub and invites community contributions of additional tools and resources.

0 comments Read more at DEV Community

ProgrammingHacker News ·

Users Report GitHub Outage on Hacker News Thread

A Hacker News post asked whether GitHub is down again, drawing 21 points and 11 comments. The linked item points to the Linux kernel repository on GitHub rather than to any official status report. The source material does not include details on the scope, duration, or cause of any outage. Readers seeking confirmation should check GitHub's official status page or the discussion thread directly.

0 comments Read more at Hacker News