Developer builds RAG system in Go using Gemini File Search with no vector database

Software developer Maneshwar built a lightweight retrieval-augmented generation (RAG) tool in Go to help engineering teams surface insights from internal documents like postmortems and design reviews. Instead of using a vector database or embedding pipeline, the system relies on Google Gemini's File Search feature, which handles chunking, embedding, and indexing automatically. The architecture requires just one Go binary, a SQLite database, and two model calls per query against a single hosted document store. Storage and query-time embeddings are free on Gemini's free tier, with costs only incurred at indexing time and for context tokens during generation. The developer also found that proper PDF-to-markdown conversion using pymupdf4llm was critical, as clean headings significantly improved the quality of retrieved chunks.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.


Discussion (0)
Log in to join the discussion and vote.
Log in