Artificial Analysis v5 发布 探讨基准测试困境
作者：Nathan Lambert原标题：Artificial Analysis v5 and the benchmarker's dilemma
45AI 研判分
Artificial Analysis 发布 v5 版本，重点讨论独立评估大模型的挑战。文章指出提升分数容易但定义有意义的基准困难，揭示了当前 AI 评测领域的核心矛盾。
报道正文
Housekeeping: I’m on the road so the voiceover will be late.
Hill-climbing is easy, knowing what to hill-climb is hard. Making scores go up is expensive, but we have a much clearer playbook for it than we do for creating meaningful benchmarks at the true frontier of AI today.
Independent evaluation of language models is under-appreciated in how hard of a …