Developer Runs AI Language Model on 2007 Sony PSP With Just 64MB of RAM

·1 views

A developer successfully ran a working language model on a Sony PSP-2000, a 2007 handheld device with a 333 MHz processor and 64 MB of RAM, generating English text at one to two tokens per second. The model used was Karpathy's stories15M, compressed via int8 quantization to roughly 17 MB and implemented in about 1,100 lines of pure C code. The experiment highlights a broader trend of shrinking hardware requirements for useful AI models, with separate projects demonstrating a 90M-parameter tool-calling model running on smartphones and Raspberry Pi devices. Advances in quantization techniques, such as Unsloth Dynamic 3.0 GGUFs, are also enabling models like Qwen3.8-27B to run at 6.2 GB — 89% smaller than the original — while retaining around 72% accuracy. Practical use cases for these tiny local models include request routing, classification, and constrained code completion, where they can reduce reliance on costly frontier AI APIs.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Six Lessons from Building and Running a Cross-Border Shopping Marketplace for Six Years

Shpper is a two-sided cross-border personal-shopping marketplace where buyers request items and shoppers abroad purchase and ship them, with its CTO managing the entire platform over fourteen major versions. Running such a platform means maintaining two separate apps simultaneously, as both buyer and shopper sides must stay in sync before any feature change can go live. The platform's core product is trust between strangers, enforced through escrow payments and identity verification, which together ensure neither party is exposed to undue financial risk. Bugs involving money are treated as a distinct, more serious category since a double-charge or failed transaction cannot simply be corrected in code — the funds have already moved. Cross-border complexity adds further challenges including currency fluctuation and unpredictable customs duties, requiring the system to handle instability as a default condition rather than an edge case.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Flutter Web 404 Pages Can Crash Silently While Servers Return Wrong Status Codes

A Flutter web developer discovered that their 404 error page had been silently crashing for an extended period, masked by a Firebase Hosting misconfiguration that returned HTTP 200 instead of 404 for missing routes. The catch-all rewrite rule was serving the 404 page with a success status, creating so-called soft 404s that misled search crawlers into indexing non-existent pages. The actual page crash stemmed from a go_router bug where the errorBuilder renders outside any RouteBase context, making GoRouterState.of(context) throw an unconditional error with no nullable fallback available. The fix involved removing the catch-all rewrite rule so the server returns genuine 404 status codes, and falling back to Uri.base.path in a try-catch block when GoRouterState is unavailable. The author notes the two bugs concealed each other — the status-code fix prompted someone to actually visit the page, which is what finally exposed the rendering crash.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Hand-Builds Flutter Treemap for Disk Browser After Packages Fall Short

A developer building Helm, a macOS disk storage tool, chose to write a custom treemap widget from scratch instead of using existing Flutter charting packages. The decision was driven by four requirements that off-the-shelf packages could not handle together: precise hit-testing to identify folders, navigation as a stateful operation with breadcrumb support, adaptive labels based on rectangle size, and layout computed one tree level at a time rather than over a flat list. The implementation uses the squarified treemap algorithm, which keeps rectangles closer to square by sorting values descending and greedily accumulating tiles before closing each row. To handle large volumes with hundreds of thousands of files, scanning runs off the main isolate and layout is computed only for the currently visible level. Helm is released under the MIT licence, with the treemap widget available in its open-source GitHub repository.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developer Finds DNS Field in Sonar App Could Execute Commands as Root

A security review of the open-source network tool Sonar revealed that its custom DNS resolver input field could be exploited to run arbitrary commands with root privileges. The flaw stemmed from passing unvalidated user input directly into a privileged shell call using networksetup, a system utility on macOS. The developer discovered the issue during a pre-release audit ahead of version 2 and fixed it by validating input against an allowlist of IPv4/IPv6 addresses and passing arguments as an array instead of a shell string. Several other vulnerabilities were also found, including CSV formula injection in network exports and insecure credential storage. The developer noted that such flaws arise not from ignorance but from insufficient scrutiny of input boundaries outside the main feature-building process.

0 comments Read more at DEV Community