Hackathon Judges Score Same Project Twice, Show 1.11 Point Average Self-Disagreement

An analysis of hackathon judging data revealed three judges scored the same project twice under different IDs. The judges' scores for the identical project differed by an average of 1.11 points. This self-disagreement exceeds the 0.68-point variation predicted by the authors' statistical noise model. The data came from a sample set for the fictional DOGFOOD 2026 hackathon platform competition. The finding raises questions about the consistency of subjective judging in such competitions.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in