AI Models Show Anchoring Bias; Fast Responders Most Affected, Thinkers Less So

A Kaggle benchmark tested 13 AI models for anchoring bias — a cognitive tendency where irrelevant numbers skew estimates — inspired by Kahneman and Tversky's 1974 wheel-of-fortune experiment. Each model answered 40 estimation questions paired with artificially low or high anchor numbers across five prompt formats. Fast-responding models showed the strongest anchoring, with GPT-4.5 nano scoring 0.52, close to the human benchmark of 0.49. Models that reasoned before answering were largely resistant, scoring between 0.02 and 0.07, though Qwen3 Thinking was a notable exception, anchoring as much as its instant counterpart despite using roughly 2,000 tokens of reasoning. The study highlights a practical concern: AI models embedded in real applications may silently skew outputs like time or cost estimates when unrelated numbers appear nearby in prompts.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.
Discussion (0)
Log in to join the discussion and vote.
Log in