Apache Iceberg V4 Moves to Ban Equality Deletes; Parquet 1.18.0 Hit by Corruption Bugs
The Apache data lakehouse ecosystem saw significant activity in the week of August 10–18, 2026, with Iceberg's V4 specification work taking center stage. A proposal by Huaxin Gao to forbid writing new equality deletes in V4 tables gained traction, citing their high read-time cost and incompatibility with features like CDC and incremental materialized views, while backward compatibility for existing tables would be preserved. Separately, questions arose over V3-to-V4 upgrade practices, particularly around the lifecycle of legacy manifests and whether the community should publish formal migration guidance. Parquet released version 1.18.0 but quickly faced scrutiny after two data corruption bugs emerged that threatened adoption of the new release. Across Arrow, DataFusion, and Iceberg, a shared governance concern surfaced: how to manage the growing volume of AI-generated pull requests and review comments that are outpacing human reviewers.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in