SShortSingh.
Back to feed

Apache Iceberg V4 Moves to Ban Equality Deletes; Parquet 1.18.0 Hit by Corruption Bugs

0
·1 views

The Apache data lakehouse ecosystem saw significant activity in the week of August 10–18, 2026, with Iceberg's V4 specification work taking center stage. A proposal by Huaxin Gao to forbid writing new equality deletes in V4 tables gained traction, citing their high read-time cost and incompatibility with features like CDC and incremental materialized views, while backward compatibility for existing tables would be preserved. Separately, questions arose over V3-to-V4 upgrade practices, particularly around the lifecycle of legacy manifests and whether the community should publish formal migration guidance. Parquet released version 1.18.0 but quickly faced scrutiny after two data corruption bugs emerged that threatened adoption of the new release. Across Arrow, DataFusion, and Iceberg, a shared governance concern surfaced: how to manage the growing volume of AI-generated pull requests and review comments that are outpacing human reviewers.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Developer Builds AI Insurance Claim Analyzer Using RocketRide Pipeline

A developer created ClaimDesk, an AI-assisted insurance claim intake and analysis application built on the RocketRide framework. The tool allows claims adjusters to upload vehicle damage photos and accident descriptions for automated analysis. Ollama was integrated for local model execution, with a unified startup workflow managing all dependencies and services. Building ClaimDesk reinforced that AI applications demand the same engineering rigor as traditional software, including architecture planning, debugging, and reproducible environments. The project offered the developer practical insight into integrating agentic AI into real-world software rather than using it as a standalone model.

0
ProgrammingDEV Community ·

Epic, GOG, and NVIDIA all confirm native Linux clients are in development

Three major gaming companies signaled a shift toward native Linux support in August 2026. An Epic Games developer confirmed in a Discord AMA that a native Linux version of the Epic Games Store launcher is coming, though not for the platform's upcoming preview release. GOG separately confirmed to GamingOnLinux that a native Linux version of GOG Galaxy is in progress, with no timeline provided. NVIDIA's GeForce NOW app for Linux officially exited beta, adding support for Ubuntu 24.04 and a Flatpak repository for easier installation. Analysts point to Linux surpassing 4% on the Steam Survey since mid-2025 and the success of Valve's Steam Deck as key factors pushing companies to prioritize the platform.

0
ProgrammingHacker News ·

Developer builds 3D desktop fruit fly for macOS using real neural connectome data

A developer has created a macOS desktop application featuring an animated 3D fruit fly powered by the FlyWire connectome, a detailed map of the fly's neural connections. The project is open source and hosted on GitHub under the username DenisSergeevitch. FlyWire is a scientific initiative that has mapped the complete connectome of a Drosophila fruit fly's brain. The application brings real neuroscience data into a visual, interactive desktop experience on Apple's macOS platform. The project was shared on Hacker News, where it received modest early attention.

Apache Iceberg V4 Moves to Ban Equality Deletes; Parquet 1.18.0 Hit by Corruption Bugs · ShortSingh