Developer builds sub-millisecond note search without a search engine or index
A developer behind vellum MCP, a self-hosted markdown note server, built a search feature that runs entirely as an in-RAM ranked scan with no external search library or index. On a 2,000-note vault running on an Apple M4 Pro, queries complete in under one millisecond, with exact-term searches resolving in roughly 0.38 ms. The approach avoids common overhead such as index synchronization, dependency maintenance, and embedding API calls required by vector search solutions. The custom matcher also supports diacritic folding, typo tolerance scaled to word length, and position-aware ranking tailored to how personal notes are actually structured. The developer acknowledges the method suits small-to-medium vaults and has abstracted search behind an interface so a conventional engine can be swapped in if the corpus grows significantly.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in