Building a Resilient Local RAG Backend Engine for Hacktoberfest 2026

·2 views

# Building a Resilient Local RAG Backend Engine For the Hacktoberfest 2026 DEV Challenge, I built a zero-dependency, local-first Retrieval-Augmented Generation (RAG) backend engine designed to run open-weight models completely offline. An asynchronous FastAPI backend paired with PostgreSQL (pgvector) and Ollama (llama3.2). The system allows querying local AI models with vector context retrieval without sending data to third-party APIs. GitHub Repository: https://github.com/AnkanJU/Hacktoberfest2026 Tech Stack: Python 3.13, FastAPI, Uvicorn, AsyncPG, Docker Compose, Ollama. Running open-weight

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

A transformer block is six tensors and a bus: read it like a pipeline

Originally published at cchinchilla.dev. Part 5 of From code to weights, a 12-part series on ML fundamentals for engineers. Part 4 ended on one stage. A decoder is a stack of blocks, twelve in GPT-2 small, and attention is one of two stages in each. This post reads a whole block the way you'd read a pipeline: what flows in, what each stage writes, and where the parameters and the cost end up.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

How I Edit Text That Is Already Baked Into an Image

There's a specific image problem that most tools have no good answer for: the words are already part of the picture, and the original design file is gone. A cafe renames itself, but the sign photo is already printed on the menu. An event moves a week later, but the poster only exists as a JPG. A price goes up and the shelf label is a flat photo from two years ago. In each case, re-shooting costs more than the change is worth.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Fix: 'fatal: refusing to merge unrelated histories' in Git

The Error You run git pull or git merge and see: fatal: refusing to merge unrelated histories Git refuses to merge branches that do not share a common ancestor commit. This typically happens when you created a local repo with git init, created a remote repository on GitHub with a default README.md or .gitignore, and then tried to connect them. Force Git to merge the two independent project histories: git pull origin main --allow-unrelated-histories (Note: Replace main with master if your default branch is named master) If you are merging directly: git merge origin/main --allow-unrelated-histor

0 comments Read more at DEV Community

ProgrammingDEV Community ·

OutingFit Mumbai: Dress for the whole outing, not just the forecast.

This is a submission for the Hacktoberfest Weekend Challenge: Build for a Friend OutingFit Mumbai helps you decide what to wear and what to carry for an outing in Mumbai, based on the actual forecast for when you'll be out. It works by voice or text in English, Hindi or Marathi. OutingFit / OutingFit OutingFit Weather-grounded outfit and packing advice for outings in Mumbai, in English, Hindi and Marathi, by voice or text. speak / dictate / type ──► ElevenLabs (agent · Scribe STT) ──► outing form (visible, editable) │ confirm place + date/times ▼ Open-Meteo forecast for the outing window ──► d

0 comments Read more at DEV Community