Microsoft Foundry Local Brings AI Inference On-Device, Eliminating Cloud Dependency

·26 views

Microsoft has introduced Foundry Local, a tool that allows developers to run AI inference directly inside desktop or mobile applications without relying on cloud-hosted endpoints. The solution targets small, well-scoped tasks such as intent classification, summarization, and voice-to-text, where routing requests to remote servers adds unnecessary latency, cost, and data-privacy risk. Foundry Local leverages quantized small models ranging from 0.5B to 8B parameters and automatically utilizes available hardware accelerators, including NPUs, Apple Silicon GPUs, and commodity laptop GPUs. It maintains compatibility with the same SDKs and API shapes used in Microsoft's cloud-based Foundry offerings, lowering the adoption barrier for existing developers. The release responds to converging trends: improved small-model quality, widespread client-side accelerators, and growing data-residency requirements in regulated industries and consumer applications.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Hoki: Open-source waving lucky cat app adds Windows and Android versions

Hoki, a virtual Chinese lucky cat (招财猫), has released version 3.2.0 with a Windows app featuring a live 3D desktop cat that follows the mouse. An offline Android app and home-screen widget are also available, along with an installable PWA. Tapping the cat gives a luck boost, and lucky numbers trigger a bell and blessing alongside a daily fortune. The Windows app is single-instance, so relaunching hands focus to the running app, and all data stays on the user's device with no account, ads, or tracking. The project is MIT licensed, written mostly in JavaScript, and hosted for free on GitHub Pages.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Docker network clash on integration host cut off carrier traffic after new project deployed

An integration host running partner adapters in Docker Compose lost connectivity to a carrier reached over a VPN after a new project was deployed. Docker automatically assigned the new project a subnet, 172.25.0.0/16, that overlapped with the carrier's address range, which the host's default gateway routed through the tunnel. The new local bridge route redirected the carrier's traffic into an empty network, so bookings timed out until the project was stopped. The team fixed the issue by setting Docker's default address pools to a reserved block, recreating existing projects, and adding a pre-start check that compares bridge subnets with partner ranges.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Why Identical Firewall Rules Behave Differently Across AWS, Azure, Google Cloud and Oracle

Copying a firewall rule between cloud providers can unintentionally widen access, even when the port and intent appear identical. AWS security groups are stateful and allow-only, while Azure relies on priority-ordered rules with explicit denies and built-in defaults. Google Cloud applies an implied egress allow at the lowest priority, which can undermine a deny-everything policy if egress is not handled explicitly. Oracle security lists are stateless by default, so a rule copied from a stateful platform can break return traffic and tempt teams into overly broad fixes. The article warns that translating security group references into broad CIDR ranges and differing logging behaviours can silently expand exposure and hide evidence until an audit or incident.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

What Is a Virtual Phone Number and Which Type Suits Your Needs

A virtual phone number is a genuine telephone number that is not bound to a specific SIM card, handset, or landline. The provider holds the number in software and routes each incoming call to a chosen destination, such as a mobile phone, a team line, a voice menu, or an AI agent. Callers dial it just like any other number, and the owner can change where calls go without changing the number. The article explains that 'free' numbers come in several forms, including trial access, bundled numbers on paid plans, and shared public numbers, with the last carrying a real security risk. It also notes that the best type depends on what callers should see and who pays, and advises verifying identity and checking messaging app support before going live.

0 comments Read more at DEV Community