SShortSingh.
Back to feed

Developer builds sub-millisecond note search without a search engine or index

0
·1 views

A developer behind vellum MCP, a self-hosted markdown note server, built a search feature that runs entirely as an in-RAM ranked scan with no external search library or index. On a 2,000-note vault running on an Apple M4 Pro, queries complete in under one millisecond, with exact-term searches resolving in roughly 0.38 ms. The approach avoids common overhead such as index synchronization, dependency maintenance, and embedding API calls required by vector search solutions. The custom matcher also supports diacritic folding, typo tolerance scaled to word length, and position-aware ranking tailored to how personal notes are actually structured. The developer acknowledges the method suits small-to-medium vaults and has abstracted search behind an interface so a conventional engine can be swapped in if the corpus grows significantly.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingHacker News ·

Developer Launches Hilo: A Word Game Built Around Binary Search Logic

A developer has released Hilo, a browser-based word game that applies the concept of binary search to gameplay. The game challenges players to guess a target word by narrowing down possibilities using higher/lower style feedback, mimicking how binary search algorithms work. It was shared on Hacker News as a personal project under the 'Show HN' category. The game is accessible at hilogame.cc and appears to be an independent, hobby-driven creation. The post attracted minimal early engagement, with just a few points and no comments at the time of publication.

0
ProgrammingDEV Community ·

SlaveCode Code Execution Platform Earns Spot in Official Judge0 README Showcase

SlaveCode, an online platform that compiles and executes user-submitted code in real time, has been added to the official README showcase of Judge0, a widely used open-source code execution engine. Judge0's creator, Herman Zvonimir Došilović, discovered the project and opened a GitHub issue to express his appreciation before adding it to the showcase. SlaveCode uses Judge0 as its core execution engine, running it on isolated Microsoft Azure VMs that are physically separated from the platform's main API and databases hosted on Google Cloud Platform. This architectural separation is designed to contain any potential security breach within the execution sandbox, keeping user data and core infrastructure secure. The developer credited detailed public documentation of SlaveCode's architecture on Dev.to as the likely reason the project came to Došilović's attention.

0
ProgrammingDEV Community ·

OMR Python Library Replaces Repetitive Data Audit Boilerplate with One Command

A developer has released OMR (Omni Data Refinement), an open-source Python library designed to streamline dataset quality checks that typically require dozens of lines of boilerplate code. The library generates a 0–100 health score across five dimensions — completeness, uniqueness, consistency, validity, and conformity — with a single function call. OMR also supports auto-cleaning with a transformation log, schema validation, statistical analysis, and drift detection using methods like PSI and KS Test. It requires only pandas, numpy, and rich, with no cloud dependencies or large language models involved. The library is available via pip and its source code is publicly hosted on GitHub.

0
ProgrammingDEV Community ·

Five Common Regex Mistakes and How to Catch Them Before Production

Regex patterns often contain subtle flaws that only surface with specific inputs, making debugging a common challenge for developers. Greedy quantifiers, misplaced anchors, and misconfigured flags are among the most frequent causes of unexpected matching behavior. Capture group interference and overly simplistic patterns that fail on real-world edge cases — such as complex email addresses — also trip up many implementations. Syntax errors like unbalanced brackets or invalid lookbehind expressions can cause unhandled runtime exceptions if not caught during development. Using a visual regex tester that highlights matches in real time and displays individual capture group values can significantly speed up the debugging process.