SShortSingh.
Back to feed

Rust rewrite of LF Edge eKuiper hits 425k events/sec on 8MB RAM at edge

0
·1 views

Developers at I-Dacs Labs rewrote the LF Edge eKuiper stream-processing engine in pure Rust, releasing it as rekuiper (v0.421-beta) under MIT/Apache-2.0 licenses. The motivation was to overcome limitations of existing edge engines: JVM-based tools like Apache Flink demand over 1GB RAM and 20+ seconds to boot, while Go-based engines suffered garbage-collection latency and packet loss under burst loads. In head-to-head benchmarks processing 500,000 telemetry records on the same Linux machine, rekuiper achieved 425,308 events per second with zero data drops, compared to 233,209 eps for Flink and 44,287 eps with 14.6% data loss for upstream Go eKuiper. The Rust engine idles at roughly 6–8MB RAM — about 125 times less than Flink — and boots in approximately 13 milliseconds internally. rekuiper maintains full API and SQL compatibility with the original eKuiper, and benchmark reproduction scripts are publicly available on GitHub.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Separating OTP and Order Notification Ownership Improves Seller Login Security

A governance framework for marketplace platforms recommends assigning login OTP templates exclusively to authentication teams, while keeping order notification templates under marketplace team ownership. The approach prevents accidental data crossover — such as seller-supplied product titles leaking into login codes — by enforcing strict template ownership rules in code. Rather than ranking SMS over email universally, the framework advises basing channel selection on which contact detail is already verified for a given seller account. Deliverability metrics like email opens or SMS transport states are flagged as unreliable success signals; only a confirmed verified-code event constitutes a meaningful outcome. The article also cautions that neither SMS nor email OTPs are phishing-resistant, recommending cryptographic authenticators when stronger security is required.

0
ProgrammingDEV Community ·

How AI Orchestration Solves Scaling Challenges for Enterprise .NET Applications

Enterprise .NET applications that connect directly to large language models without a structured orchestration layer often face unpredictable costs, high latency, and hallucinated outputs as user traffic grows. A U.S. retail platform experienced these issues firsthand when a GPT-4-powered price-alert feature hit 10,000 concurrent users, blew past its token budget, and began returning inaccurate prices. The team resolved the problems by introducing an orchestration layer using Redis caching, Cosmos DB for state persistence, Azure Service Bus for long-running workflows, and token usage policies, cutting cold-start latency from 1.2 seconds to 500 milliseconds. Best practices identified from production deployments include prompt caching with Redis, batched inference for bulk workloads, OpenTelemetry instrumentation for observability, and strict tenant isolation to prevent data leakage in multi-tenant systems. Experts warn against common pitfalls such as hard-coded API keys, treating AI services like standard REST APIs, and neglecting per-call monitoring of token usage and latency.

0
ProgrammingDEV Community ·

GitTrends AI v5.0 Launches with Real-Time Star Velocity Tracking and MCP Integration

A developer has released GitTrends AI v5.0, an open-source GitHub repository tracker designed to address discovery gaps for AI coding agent developers. Unlike GitHub's native trending feed, the tool ranks repositories by real-time star velocity, highlighting fast-growing projects regardless of total star count. The platform includes a native Model Context Protocol (MCP) server, allowing coding agents like Claude Code and Cursor to query live GitHub data directly from the terminal or IDE. The registry is organized into curated categories such as MCP Servers, Agent Skills, and a Star Velocity Radar, and is kept current via scheduled GitHub Actions with automated fallback mechanisms. Data is also available in machine-readable JSON and RSS 2.0 formats for integration with tools like Slack, Discord, and Feedly.

0
ProgrammingDEV Community ·

Index Mismatch in Orca Terminal Tool Allowed Retry Limits to Reset Infinitely

A bug in Orca, a desktop tool for managing terminals and AI agent workflows, caused its retry limiter to lose control due to a mismatch between two internal indexes tracking terminal state. When the display cleanup function consulted a different index than the one used for remounting, it could erase a terminal's recovery history even while that terminal remained eligible for further remounts. This allowed the same tab to receive conflicting answers from two separate lookups, effectively resetting the retry budget on each cycle. A reported Windows crash linked to the issue described eight tabs remounting 8,878 times in under two minutes, though researchers worked from the public codebase rather than the original crash data. The proposed fix resolves the inconsistency by ensuring both the remount check and the cleanup predicate rely on the same terminal-row lookup, without altering the retry cap itself.