How Google's Protocol Buffers Cuts Payload Size and Latency in Microservices

·28 views

Protocol Buffers (protobuf) is a language-agnostic binary serialization format originally developed by Google, now widely used in infrastructure tools such as gRPC, Kubernetes, and Cloud Spanner. Unlike JSON or XML, protobuf uses a separate schema definition file and compiles it into strongly typed code, enabling backward-compatible API evolution without breaking existing services. The format delivers roughly 3–10 times smaller payload sizes and significantly lower deserialization latency compared to text-based alternatives. In one fintech deployment processing millions of daily transactions, adopting protobuf reduced bandwidth consumption by 35% and improved P99 latency by 240 milliseconds. Protobuf integrates natively with streaming and batch systems like Kafka, Apache Beam, and Spark, and serves as the foundation of gRPC's HTTP/2-based communication layer.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Node.js Backup Uploads: Multipart Handling and Retention Rules for Report Archives

The article argues that an edtech service delivering generated reports should define its deletion procedure before choosing a multipart upload approach. It treats a report's lifecycle as a custody promise, meaning it must stay private while valid, be restorable when published, and be removable under retention or access rules. Using a report containing student work as an example, it asks how cancellations, revoked access, and timed-out deletions should be handled. The piece recommends that a durable application record, rather than storage state or bucket age rules, control authorization and retention, with unfinished uploads aborted and reconciled. It also separates customer-facing report archives from internal database backups, which may follow different schedules.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Building Container-Like Isolation with Linux Namespaces

A DEV Community article explains that containers are not a native Linux concept but are built from kernel namespace features. It lists seven namespaces, including mount, PID, network, IPC, UTS, user, and cgroup, along with chroot. The author outlines the two kernel APIs used to create namespaces: clone for new processes and unshare for moving existing ones. The tutorial takes a hands-on approach, using two terminals and shell scripts to demonstrate how a container system is assembled on Linux.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

DJs Dominate Music's Most-Traveled Rankings, Study and Live Data Show

A 2017 TravelBird study found that the two most-traveled musicians in history are both electronic dance music producers, with Tiësto leading at over 1.55 million career miles. Beyoncé ranked 19th with about 472,443 miles, less than a third of Tiësto's total. The author's live leaderboard, built from announced tour stops for 83 major DJs and measured by great-circle distance, shows the same pattern this season. The gap is attributed to production logistics: pop stadium tours require dozens of trucks and multi-day setups, while a DJ's gear fits in a backpack, allowing far more city visits. The live rankings also reveal different travel strategies, such as Steve Aoki's many short regional legs versus Ferry Corsten's few long intercontinental flights.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Delphi physics lab from 2004 grows into Makarov Suites of simulations

A university student built a physics lab in Delphi 7 and OpenGL in 2004 for classroom use, and that original project still exists publicly on GitHub. The same desktop platform has since evolved into Makarov Suites, developed by the author in Munich. Physics, Math and Astronomy suites are available on Steam for Windows, while Engineering, Earth and Games are still in development. The author presents short recorded demonstrations of the applications, including wave motion in pendulums, cube permutations, black hole light bending, and gearbox mechanics. The applications are designed so users can explore concepts by manipulating the simulated objects themselves.

0 comments Read more at DEV Community