Study finds AI assistants sometimes recommend places that have closed or moved
A test of six AI assistants on 150 everyday questions about real places found that 12 of 900 first answers pointed users to a location that public sources showed had closed, moved or changed its name. The researchers counted a place as closed only when evidence such as a closure notice, licence suspension, dated press report or Google's 'permanently closed' label supported it, and a still-open listing did not override that. Closed places lowered scores most when they were the main recommendation, and less when they appeared as a backup option. The authors suggest a likely cause is that assistants draw on web listings and pages that often lag behind business closures, noting that in a separate check about one in four closed businesses still appeared open on Google Maps or had no listing. The full question set, answer keys and grades are published on GitHub under a CC BY 4.0 licence.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)
Log in to join the discussion and vote.
Log in