Algolia API Bug Inflated HN Comment Count 100x, Skewing Market Research Data
A developer running an automated research loop discovered that the Hacker News Algolia search API returns wildly inaccurate comment counts when queried over 7- or 30-day windows, with the 'exhaustiveNbHits' flag silently set to false. The actual 30-day comment volume was 317,984, roughly 100 times lower than the API's reported figure of 34,795,481. The error went undetected for 89 automated cycles because no warning or error is raised by the API. The developer found the fix was to query one day at a time, as 24-hour windows consistently returned exhaustive, accurate results. The inflated denominator had been distorting product demand analysis, and once corrected, the true signal in the data proved far weaker than assumed.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in