SShortSingh.
Back to feed

VIDRAFT wins Gemma-4 inference challenge with 510.58 TPS on single A10G GPU

0
·3 views

VIDRAFT claimed first place in 'The First Gemma Challenge', a constrained AI inference competition requiring participants to optimize speed solely through software on a single NVIDIA A10G GPU running Google's Gemma-4-E4B-it model. The winning submission achieved 510.58 tokens per second while maintaining a perplexity score of 2.3930, comfortably within the quality threshold of approximately 2.42. A rival entry recorded a faster raw speed of 535.91 TPS but was disqualified after its perplexity exceeded the limit, making VIDRAFT's result the verified state-of-the-art. Key optimizations included a tuned sliding attention window of 188 tokens, an empirically selected centroid top-k value of 49, and a warm-up routine that absorbed GPU compilation costs before timing began, worth roughly 15 TPS. Speculative decoding with seven draft tokens per pass was also enabled, collectively allowing VIDRAFT to pass a blind re-evaluation against a held-out prompt set the team had never seen.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Event-driven architecture helps AI agents handle real-world production failures

AI agent systems that rely on long synchronous chains are prone to failure when steps are slow, services restart, or human approvals are needed. An event-driven architecture addresses this by letting agents publish facts to an event bus, allowing other components to react independently without being directly wired together. This decoupling means a temporarily unavailable service can still process events once it recovers, and workflows are not lost when a restart occurs. Distinguishing between events, which record facts, and commands, which request actions, is key to keeping such systems predictable and auditable. Standards like CloudEvents can provide a common metadata envelope when events cross team or platform boundaries.

0
ProgrammingDEV Community ·

Developer builds fully browser-based bubble text generator using SVG and Canvas

A developer built a browser-only text-art generator using Next.js, SVG, and Canvas that requires no server, accounts, or file uploads. The tool accepts short phrases and applies one of three font styles across eight visual finishes, including glossy, holographic, chrome, and neon. To ensure consistent rendering across devices, font files are bundled with the app and embedded directly into generated SVGs using base64-encoded data URLs. Text dimensions are calculated using CanvasRenderingContext2D.measureText rather than character count, ensuring accurate layout regardless of font width variation. The pipeline converts React-controlled inputs into a cropped, watermark-free PNG entirely within the browser.

0
ProgrammingDEV Community ·

Developer Builds Angular 20 Pet Management App with Google Gemini AI Integration

A developer created Pet-Wallet, a browser-based pet management app built with Angular 20 that lets users add, edit, and track pets along with their medications and daily care tasks. The app uses Google Gemini AI to extract pet details from uploaded PDF documents, helping users quickly populate new pet profiles. Because the project is a front-end-only application, users must supply their own Gemini API key to use the AI import feature, as the developer chose not to expose credentials in a public repository. Pet-Wallet stores all data locally in the browser and is deployed via GitHub Pages with automated deployments through GitHub Actions. The project was submitted as part of a DEV Community weekend coding challenge and marks the developer's first post on the platform.

0
ProgrammingDEV Community ·

Plaid Alternatives for EU Developers: Key Players, Pricing, and Migration Pitfalls

Developers building fintech products in the EU and UK are increasingly moving away from Plaid due to concerns over per-connection pricing, US data residency, and GDPR compliance pressures. Major European alternatives include GoCardless (formerly Nordigen), TrueLayer, Tink, Enable Banking, and Salt Edge, each with distinct coverage strengths and quote-based pricing models. A critical technical difference in migrating from Plaid to PSD2-based APIs is the consent model: unlike Plaid's stable Items, PSD2 consents typically expire after 90 days, requiring developers to build expiry-aware sync logic to avoid authentication failures. Some teams attempt to bypass aggregators entirely by obtaining their own AISP license, but the cost and operational burden of eIDAS QWAC certificates often drives them back to managed aggregator solutions. The article is written by the maintainer of open-banking.io, a small EU aggregator, offering an integration-focused perspective rather than a vendor-marketing one.