Mojibake: A lightweight C library for Unicode with normalization and bidirectional support

·2 views

A developer has released Mojibake, a low-level Unicode library written in C, citing dissatisfaction with existing Unicode libraries as motivation. The project is distributed as just two files — mojibake.h and mojibake.c — making it easy to integrate into other projects. It implements key Unicode algorithms including normalization, case conversion, text segmentation, bidirectional text, collation, and confusable detection. The library has been tested across multiple operating systems, including Linux, macOS, FreeBSD, OpenBSD, NetBSD, and Windows 11. A WebAssembly demo and full API documentation are available online, and the project is open to contributions via its GitHub repository.

Read the full story at Hacker News

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Token Drift: Why AI Agents Slow Down and Cost More Over Long Sessions

A pattern known as token drift causes AI agents to become slower and more expensive as conversations grow longer, because each model call must process an increasingly large context. The effective input includes system prompts, tool definitions, conversation history, retrieved documents, and tool outputs, all of which accumulate across turns. While per-turn input grows roughly linearly, the total tokens processed across an entire session can rise quadratically, making session costs climb far faster than the number of turns suggests. Common culprits include repeated full transcripts, large tool schemas, bulky API responses, and duplicated memory summaries sent on every request. Developers are advised to treat context as a budgeted resource and track token usage per model call rather than per user request to manage costs effectively.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Linux Foundation Launches x402 Foundation for AI Agent Payments, Security Gaps Remain

The Linux Foundation established the x402 Foundation on July 14, 2026, to provide neutral governance for the x402 protocol, which enables AI agents to transact payments over HTTP. The founding membership includes major financial and technology players such as Visa, Mastercard, Stripe, Google, Coinbase, and Cloudflare, among two dozen others. However, the launch notably lacks a conformance suite, security profile, or certification program to verify that executed payments were actually authorized. Researchers warn this mirrors a pattern seen with the MCP protocol, where security testing lagged behind rapid adoption — a concern amplified here by the financial stakes involved. Critics argue that while standardizing payment record formats is necessary, it does not prove that authority claims within those records can withstand adversarial attempts to forge, replay, or manipulate them.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Releases Hyphae 0.1.0, a Rust Data Engine With Offline Result Verification

A developer has released Hyphae 0.1.0, an open-source data engine written in Rust, now available on GitHub, crates.io, and as signed multiplatform archives. The engine is designed to not only answer queries but also generate portable proofs that allow results to be verified offline, byte for byte, against a specific durable state. Hyphae runs as a single binary with one data directory and requires no external database, cache, cloud service, or AI stack to function. Its durable authority is built on an append-only, checksummed, digest-chained log, with embedded indexes treated as rebuildable accelerators rather than sources of truth. The project addresses a gap the developer identified in conventional data engines, where a successful query response is typically just an unverifiable assertion from the system that produced it.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Astro + Cloudflare Pages Outperforms WordPress on Speed, SEO and Security

A 2026 technical comparison highlights why many developer teams are reconsidering WordPress in favour of modern static-site alternatives. Astro, a web framework that generates complete HTML at build time, eliminates the per-request PHP processing and database queries that slow traditional WordPress sites. Paired with Cloudflare Pages, content is served from edge locations worldwide, resulting in page load times of 0.5–1.5 seconds versus 2–5 seconds for typical WordPress setups. Astro pages often weigh under 50KB and ship zero JavaScript by default, enabling near-perfect Lighthouse and Core Web Vitals scores. The article concludes that for developer-managed blogs and marketing sites, the Astro-Cloudflare stack offers measurable advantages in performance, SEO, security, and long-term maintainability.

0 comments Read more at DEV Community