Developer adds judgment model Jev to RAG pipeline to filter low-quality code chunks

·12 views

Enrique, developer of Zerikai Memory, integrated TypeSafe's new judgment model Jev into his IDE-focused retrieval-augmented generation pipeline. Zerikai Memory uses Tree-sitter to parse codebases into typed entities stored in a local ChromaDB vector store, retrieving results by L2 distance and lexical re-ranking. The existing pipeline reliably surfaced factual, traceable code chunks but could not distinguish passages that genuinely answered a query from those that merely shared vocabulary with it. Jev, described by TypeSafe as a 'System One' model, returns typed decisions such as probabilities and labels rather than generated text, allowing it to judge whether a chunk truly answers a question or poses an injection risk. Enrique added Jev as an optional layer between retrieval and synthesis to filter out near-miss chunks before they reach the final answering LLM.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Claude Code Action Can Automatically Review GitHub Pull Requests

The anthropics/claude-code-action GitHub Action lets Claude review pull requests and answer @claude mentions in issues without a dedicated server, running on the user's own GitHub runner. It selects its behavior from the workflow context, handling code questions, PR reviews, and simple fixes, and sends API calls to a chosen provider such as Anthropic, Amazon Bedrock, Google Vertex AI, or Microsoft Foundry. Setup is done by running claude /install-github-app from a repo terminal, which requires repository admin rights and is documented for direct Anthropic API users, with other providers covered in the repo's cloud-providers guide. The project's Solutions Guide lists review patterns such as automatic PR review, path-specific checks, and OWASP-aligned security reviews, and the article recommends starting small and limiting tool access. The author stresses that the AI review should be treated as a first pass rather than a replacement for human approval, and notes they did not run the action on a live repository.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

A 65B Local Model Outscored a 501B Model on Identical Eval Questions

A developer reported that a 65-billion-parameter model run locally scored 80.52 on their evaluation suite, higher than a 501-billion-parameter frontier model on the same test. Both models answered the same 200 multiple-choice questions at temperature 0 with no system-prompt changes, using the same scoring script. The local model was quantized to Q4_K_M and ran on a single consumer GPU, while the larger model was accessed through its hosted API with default settings. The smaller model reportedly won 14 of 20 categories. The author noted that verifying the larger model's result costs about twelve dollars per full run, compared with roughly forty minutes of GPU time and electricity for the local run, and shared a short video walkthrough of the setup.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Developers Explore Running Local LLMs in Browsers Using WebGPU and Transformers.js

A technical article from DEV Community describes how WebGPU gives browsers direct access to local GPU compute, enabling quantized open-weight models to run client-side. It names Qwen 2.5, Phi-3.5, and Llama 3.2 as examples of models that can execute within the browser sandbox. The author highlights a code example using the Transformers.js pipeline API and notes challenges such as shader compilation latency during initial load. Caching weights through the browser's Cache Storage API is suggested so models are downloaded only once. The piece argues that keeping prompts on the device avoids server round trips and improves data privacy for sensitive information.

0 comments Read more at DEV Community

ProgrammingDEV Community ·

Deduplizieren einer Kundenliste in Python, wenn keine Zeilen exakt identisch sind

Doppelte Einträge in Kundenlisten sind selten identische Zeilen, weil sich etwa das Bestelldatum, die Stadt oder die Schreibweise der E-Mail unterscheiden. Welche Zeilen als Duplikate gelten, hängt daher vom gewählten Vergleichsschlüssel ab, der bestimmt, wie viele Zeilen entfallen und welche erhalten bleiben. Der Artikel zeigt dies anhand einer Beispielliste mit 412 Zeilen in reinem Python und vergleicht die Ergebnisse mit dem Befehl Remove Duplicates im Spreadsheet Editor von osFoundry. Ein Schlüssel über die ganze Zeile entfernt keine Einträge, die E-Mail allein entfernt alle 38 Wiederholungen, und E-Mail plus Stadt entfernt 25. Zudem behält die übliche Konvention die erste Zeile, was bei den meisten Dubletten nicht die neueste Bestellung ist, weshalb die Sortierung vor dem Deduplizieren wichtig sein kann.

0 comments Read more at DEV Community