Apache Iceberg Summit 2027 Committee Forms as Data Lakehouse Projects Refine Specs

·1 views

The Apache Iceberg community launched formation of the Iceberg Summit 2027 Selection Committee after PMC approval, with over a dozen volunteers including Ryan Blue, Russell Spitzer and others signing up within days. The 11-member committee will enforce a one-member-per-company cap to prevent any single vendor from influencing the conference agenda, with volunteering open until September 11, 2026. On the specification front, a vote on finer-grained read restrictions for the REST catalog passed, enabling catalogs to return partial table data views rather than forcing all-or-nothing loads. A separate proposal to add optional key-value labels to catalog read responses also closed successfully, with contributors deliberately scoping the change to avoid bundling in write APIs and permissions logic. Across the broader lakehouse ecosystem, Parquet debated the meaning of version numbers in file footers, and the Iceberg Rust–DataFusion integration was moved from the Iceberg project into DataFusion.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

How Distributed Transactions Work in Microservices: 2PC, Saga, and Kafka Explained

When an order spans multiple microservices — such as OrderService, PaymentService, and InventoryService — a standard local ACID transaction is insufficient because each service operates on its own database. Two-Phase Commit (2PC) attempts to enforce atomicity across services via a coordinator, but risks performance bottlenecks due to resource locking. The Saga pattern offers an alternative by breaking the workflow into independent local transactions, using compensating actions to reverse completed steps if a later stage fails. Saga coordination can be implemented via choreography, where services react to events published on a message broker like Kafka, or via orchestration, where a central coordinator directs each step. Because compensations are new business transactions rather than true rollbacks, Sagas provide eventual consistency rather than the strong consistency of a single atomic transaction.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Wrestles With Sharing Achievements Without Appearing Egotistical

A developer on DEV Community has written about the internal conflict of wanting to share professional accomplishments while fearing it may come across as arrogant or hurtful to others. The author describes feeling trapped in a lose-lose situation where sharing achievements risks seeming boastful, but staying silent invites doubt about their abilities. Growing up in an environment where emotions were suppressed has made it harder for them to read how others respond to their posts. Despite wanting to share wins for both portfolio-building and mental health reasons, the author plans to reduce their posting frequency to once a month. They intend to remain active on the platform through commenting and engaging with others' content instead.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How Sharing Project Stats With Context Can Build a Loyal Social Media Following

Developers and creators building in public can grow social media audiences by regularly sharing project metrics alongside meaningful context, not just raw numbers. Explaining what a statistic means, what influenced it, and what will be tested next turns routine data into useful content for other builders. Consistency matters: using the same core metric across updates lets followers track progress over time, including flat periods and failed experiments. Practical details such as labeling chart axes clearly, defining terms like 'active users', and removing sensitive information before posting screenshots help maintain credibility. Ending each update with a specific question invites readers to contribute their own experience, making the content a starting point for conversation rather than a one-way broadcast.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How Browser Simulators Can Teach Database Scaling Better Than Textbooks

A software developer argues that hands-on simulation is more effective than reading for understanding database scaling concepts like indexing, caching, and replication. Three free, browser-based simulators allow users to observe how missing indexes cause slow queries, how cache eviction policies affect hit rates, and how read replicas introduce data consistency challenges. The indexing simulator demonstrates how a B-tree index reduces rows scanned during a query, while also illustrating the write overhead that makes blanket indexing impractical. The caching simulator visualizes the cache-aside pattern and lets users compare LRU, FIFO, and LFU eviction strategies against different access patterns. The tools are disclosed as built by the author and require no signup, serving as a practical supplement to standard system design interview preparation.

0 comments Read more at DEV Community