Developer builds neural network in SQL using relational array database library

·1 views

A software developer implemented a neural network entirely in SQL while exploring the capabilities of Xarray-SQL, an open-source array database library. The project began during a trip to Corfu, Greece, where the developer and a GSoC intern were working on a new feature enabling roundtrip conversion between array and tabular data models. The developer discovered that common geospatial and climate science operations — including matrix multiplication and regridding — could be expressed as standard SQL relational operations. Building further, they implemented automatic differentiation on top of Apache DataFusion, then extended that to construct a functioning neural network in SQL. The work was presented at DataFusion's inaugural showcase, with the developer arguing that SQL's separation of logical and physical layers could make it a viable foundation for distributed machine learning systems.

Read the full story at Hacker News

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

pytest + Docker Cuts Redis Test Suite from 3 Hours to 10 Minutes

A software team repeatedly faced cache pollution in their Redis-backed test environment, with test data from different users and sessions mixing together and corrupting results. The root cause was multiple test cases sharing a single Redis instance, leading to key collisions, residual dirty data, and environment drift between developers. To fix this, the team adopted a pytest-and-Docker approach using the testcontainers-python library, which automatically spins up a fresh, isolated Redis container before each test and destroys it afterwards. This eliminated the need for manual cache flushes or shared test instances, and the solution works regardless of how the underlying memory store is structured. The result was a dramatic reduction in test runtime and the elimination of intermittent, hard-to-debug failures caused by shared state.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Claude Code Gains Image Generation and Editing via NanoBanana MCP Integration

Developers can now integrate image generation and editing directly into Claude Code terminal sessions by connecting the NanoBanana MCP server, eliminating the need to switch between coding and design tools. The integration exposes two core tools — one for text-to-image generation and another for multi-image editing — both powered by Google's Gemini model for visual understanding. Setup involves running a single CLI command with an HTTP endpoint and a Bearer token authorization header, with scope options available for local, user, or shared project configurations. The guide highlights practical developer use cases such as creating empty-state illustrations, removing unwanted text from screenshots, and compositing objects across multiple images. Teams sharing the configuration via project scope are advised to use environment variable placeholders rather than committing real tokens to the repository.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How to Optimize NVIDIA Jetson Orin Nano for Headless ROS 2 and Edge-AI Workloads

Developers running autonomous robots on the NVIDIA Jetson Orin Nano (8GB) face a significant memory challenge, as the CPU and GPU share a unified RAM pool. Out of the box, JetPack 7.2 on Ubuntu 24.04 LTS boots a full GNOME desktop that consumes up to 2GB of RAM at idle, leaving little room for AI models, cameras, and navigation stacks. Switching systemd to a headless multi-user target alone drops idle RAM usage from around 913 MiB to 699 MiB. Further disabling unnecessary background services — such as Samba, Bluetooth, LTTng, and kerneloops — can bring total idle memory consumption down to approximately 600 MiB. The guide also covers headless SSH access over direct Ethernet or USB-C and installing a lightweight ROS 2 Jazzy Jalisco environment to maximize available compute resources.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Why 'Is It Alive?' Is the Wrong Question for Monitoring Your Infrastructure

A home-lab operator running always-on machines and GPU-based AI workloads argues that standard process monitoring fails to catch the most damaging failures. A GPU node sat idle for 16 hours with all health checks showing green, because the only meaningful signal — rising output count — was never being tracked. The author proposes splitting monitoring into three distinct layers: liveness, connectivity, and progress, each revealing different failure modes. He also warns that stale metric values can appear normal on dashboards, masking real errors, and recommends a freshness gate so outdated readings cannot register as healthy. The core takeaway is that observability — confirming work is actually advancing — matters far more than simply confirming a process is running.

0 comments Read more at DEV Community