Apache Iceberg, Parquet, Polaris and Arrow tackle format contracts in busy dev week

·1 views

During the week of July 21–29, 2026, the Apache open lakehouse ecosystem saw intense technical debate across multiple projects, centered on formalizing implicit conventions into written specifications. The most significant discussion involved a proposal to deprecate equality deletes in Iceberg V4, with key contributors arguing the read-time cost should shift to writers via indexing at write time. Separately, Polaris pulled its 1.7.0 release candidate after discovering a licensing gap in 44 staged jars, while Parquet voted in a new floating point encoding and disputed ownership of its core Thrift schema file. Arrow engaged in debate over the precise meaning of its nullable flag, reflecting a broader community push for unambiguous guarantees across format and catalog boundaries.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Top AI Startups Are Pulling Back From Publishing Research

Leading artificial intelligence startups are significantly reducing the amount of research they publish openly, according to a report by Science. This trend marks a shift from the earlier culture of open academic sharing that helped accelerate AI development. Companies appear to be prioritizing competitive advantage and proprietary control over scientific transparency. The move raises concerns among researchers about reduced collaboration and slower progress in the broader scientific community.

0 comments Read more at Hacker News

ProgrammingDEV Community ·

How to Use Hive for Fast Local Storage in Flutter Apps

Hive is a lightweight, NoSQL database written in Dart that allows Flutter developers to store data directly on a user's device without requiring native platform code. It organizes data into 'boxes', each functioning similarly to a table in a traditional database, and supports storing strings, integers, booleans, lists, and maps. Developers can get started by adding the hive and hive_flutter packages to their project and initializing Hive inside the main() function before the app launches. Core operations such as saving, reading, updating, and deleting data are handled through a simple key-value API. A basic demo app demonstrates that data saved via Hive persists across app restarts, making it well-suited for use cases like caching, offline access, and storing user preferences.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

In AI Avatars, Latency Hurts User Experience More Than Voice Quality

Developers and evaluators of AI avatar platforms often focus on voice quality, but response latency is the more critical factor affecting user experience. A naive system that waits for a full LLM response before beginning text-to-speech synthesis can produce 2–4 seconds of silence, making the bot appear broken. Production-grade systems address this by streaming LLM output token by token and synthesizing audio in sentence-level chunks rather than waiting for a complete response. Platforms that advertise real-time avatars but rely on single request-response cycles will feel noticeably slower, even when using the same underlying LLM and TTS providers as streaming-based competitors. Experts recommend testing under realistic network conditions, as architectural differences between platforms become most apparent outside controlled environments.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Conway's Law Shapes Software Architecture Even in Two-Person Startups

Conway's Law, a well-known principle in software development, states that a system's architecture tends to mirror the communication structure of the team that built it. At bundle.social, a two-person startup running a unified social media API, the founders observed this law playing out in an unexpected way: their codebase began reflecting individual mental models rather than any formal org chart. With no dedicated teams for infrastructure, analytics, or product management, the duo found that frictionless communication tempted them to skip formal boundaries, creating fragile 'hero services' only one person fully understood. A 2 AM background job failure made clear that any part of the system needed to be understandable by either developer without lengthy explanation. To counter this, the team intentionally leveraged Conway's Law by adopting a clean modular monolith and enforcing explicit code boundaries instead of drifting into informal, person-specific ownership.

0 comments Read more at DEV Community