Analysis of 30 AI Model Cards Reveals Benchmark Reporting Patterns

A researcher examined model cards from 30 frontier AI models to assess which benchmarks laboratories most commonly report. The study compiled findings into a leaderboard-style visualization showing benchmark frequency and coverage across major AI labs. The analysis highlights inconsistencies in how different organizations choose to evaluate and disclose their models' performance. Such disparities make it difficult for users and researchers to make direct comparisons between frontier models. The work underscores growing calls for standardized evaluation and transparency practices in AI development.