poolprobe: a stdlib-only doctor that health-checks OpenAI-compatible model pools
A new open-source tool called poolprobe checks every model in an OpenAI-compatible pool and labels each failure as ALIVE, TRANSIENT, CREDENTIAL, or PERMANENT. Its design prevents removal of working models, since a model is only declared dead after five independent checks agree. The project is built on the Python standard library alone and is installable via pip under the MIT license. According to the author, the tool only reads the data it is pointed at and sends nothing externally. The author also cautions that its rules can yield false positives, so it is meant to flag candidates for review rather than serve as a definitive judgment.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in