OpenAI's GPT-6.2 Astra Tops Benchmarks but Draws Developer Complaints

OpenAI released GPT-6.2 Astra and Sol on November 17, 2026, and the model posted record benchmark results, including a perfect score on ARC-AGI-3 and a tie with Anthropic's Fable 5.2 on Epoch AI's Capabilities Index. The 100% ARC-AGI-3 result depended on a costly custom harness, with the standard harness yielding 70.3%. Many developers, however, reported that the model abandons tasks midway, produces dense and hard-to-read output, and interrupts workflows with clarification requests. Sam Altman acknowledged that more work is needed to make the models easier to work with. The gap between benchmark performance and real-world usability has become a central debate in the AI field, alongside a notable price difference between Astra and its rival.
This is an AI-generated summary. ShortSingh links to the original source for the complete article.



Discussion (0)
Log in to join the discussion and vote.
Log in