SShortSingh.
Back to feed

ONNX Runtime Web Now Enables Full AI Inference, Background Removal Inside Browser

0
·1 views

Developers can now run complex deep learning models, including background removal and feature extraction, directly in the browser using ONNX Runtime Web (onnxruntime-web). This eliminates the traditional need to send user data to remote servers, addressing latency, bandwidth, and privacy concerns tied to regulations like GDPR and HIPAA. The approach relies on three pillars: the ONNX model format for cross-framework portability, the onnxruntime-web runtime compiled via WebAssembly, and browser-native compute APIs such as WebGL and WebGPU. Models originally trained in PyTorch, TensorFlow, or JAX can be serialized into ONNX and executed locally on the user's device CPU or GPU. The shift effectively turns the browser into an edge-computing node capable of real-time computer vision tasks without any cloud infrastructure.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Uncensored Qwen 3.8 27B Model Released and Put to the Test

An uncensored version of the Qwen 3.8 27B language model has been made available and is undergoing testing. The model is hosted at imageat.com, a platform offering access to various AI models. The release attracted discussion on Hacker News, though engagement remained limited with only 5 points and 2 comments. Uncensored AI models remove safety filters present in standard releases, raising both interest and ethical questions among developers and researchers.

0
ProgrammingDEV Community ·

Git Rebase vs Merge and AWS RDS Snapshot Restore: Key Differences Explained

A developer training exercise on the KodeKloud Engineer platform covered two practical tasks: rebasing a feature branch onto master without a merge commit, and restoring an AWS RDS instance from a snapshot. Unlike git merge, which joins two histories and records the join, git rebase replays commits one at a time onto the new base, rewriting commit hashes and producing a clean linear history. Because history is rewritten, pushing requires the --force-with-lease flag, though its protection can be bypassed if a background process updates the remote-tracking reference before the push. The AWS portion of the exercise focused on snapshotting an RDS instance and restoring it into a new instance, exploring which configurations carry over automatically and which must be explicitly set. A key takeaway emphasized in Git documentation is that rebasing should only be done on unshared branches, as rewriting shared history forces collaborators to manually reconcile their own work.

0
ProgrammingDEV Community ·

Reverse-Skill: Open-Source Framework Brings Structure to AI-Driven Security Audits

A developer known as zhaoxuya520 has released Reverse-Skill, an open-source framework designed to improve how AI coding agents like Claude Code, Cursor, and Cline handle cybersecurity tasks. The tool acts as a deterministic skill router, guiding AI agents through verified, step-by-step workflows for tasks such as binary analysis, decompilation, and network auditing. It includes local indexing scripts that automatically detect and configure installed security tools like Ghidra, Radare2, Frida, and Nmap, eliminating the need for agents to guess command-line arguments. Reverse-Skill also maintains trajectory logs and benchmark tests to help refine the agent's knowledge base over time. The framework is compatible with major AI coding environments and is freely available on GitHub.

0
ProgrammingDEV Community ·

Developer Builds Dizord, a Discord Server Discovery Platform for Niche Communities

A developer has launched Dizord, a Discord server directory platform aimed at making it easier for users to find communities that match their interests. The platform organizes servers using categories and tags rather than presenting a single undifferentiated list, addressing a gap the creator noticed while navigating Discord communities. The backend is built with Laravel and integrates with the Discord API to keep server listings synchronized and up to date. A key focus of the project is improving visibility for smaller servers, so communities do not need large member counts to be discoverable. The platform is live at dizord.com and continues to evolve, with ongoing work on search, categorization, and activity-based discovery features.

ONNX Runtime Web Now Enables Full AI Inference, Background Removal Inside Browser · ShortSingh