GPT-6 Luna Matches Rivals on 204 HoverBot Support Tests at Far Lower Cost
A test of three AI models on a fictional footwear shop's support chatbot ran 68 questions three times each, producing 612 graded answers. GPT-6 Luna was kept as the default because its cost was far lower, it passed every boundary case, and its answer quality was close to GPT-6 Sol's. Luna answered 187 of 204 questions fully correctly or handled boundary cases properly, versus 192 for Sol and 196 for GPT-5.6 Terra. Terra was also the fastest, with lower response times than Luna and Sol. The authors caution that these are their own test counts rather than a general benchmark for chatbots.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.



Discussion (0)
Log in to join the discussion and vote.
Log in