Arena 推出编程指数 评测智能体真实编码能力

原标题:Introducing Arena’s Coding Index: measuring which agents are best at real coding work.
58AI 研判分

Arena.ai 发布 Coding Index,专门衡量智能体在真实编码任务中的表现。OpenAI 的 GPT-6.2 Astra (Max) 在该指数上以 1338 分位列第 3,较上一代提升 50 分,同时单任务中位成本下降 62% 至 4.75 美元,进入成本帕累托前沿。其综合 Agent Arena Index 得分为 1291 分,排名第 6。

报道正文

Arena.ai (@arena) · 2026-11-19 15

Introducing Arena’s Coding Index: measuring which agents are best at real coding work.

For GPT-6.2 Astra (Max) by @OpenAI, coding is a strength. On the Coding Index specifically, it scored 1338 pts at #3!

Its overall Agent Arena Index score landed at 1291 pts at #6.

This Coding Index score of 1338 is +50 pts over its previous variant, GPT-6 Astra (Max), at 62% lower median cost per task ($4.75 vs. $12.55), earning a spot on the cost Pareto frontier for the Coding Index (see placement in thread).

Congrats to the @OpenAI team!

↳ 引用 @arena (Arena.ai): Scores for GPT-6.2 Astra and Sol are on the NEW Agent Arena Index!

  • #6 with 1291 pts: GPT-6.2 Astra (Max), now @OpenAI’s best model
  • #11 with 1241 pts: GPT-6.2 Sol (Max), joining the cost Pareto frontier

The Agent Arena Index is our new headline measure of overall agent performance, built from millions of real-world tasks and traces from our global community. Results for GPT-6.2 Astra and Sol are based on 7.1K+ real agentic sessions.

GPT-6.2 Astra: #6 with 1291 pts

  • +9 pts vs previous variant GPT-6 Astra (Max), currently #7
  • Median cost per task: $2.94 vs. $4.91 for GPT-6 Astra, 40% lower
  • Strongest signal: #5 with 1462 pts in Praise vs Complaint (user satisfaction with agent's outcome)

GPT-6.2 Sol: #11 with 1241 pts

  • Matches #12 GPT-6.1 Sol (Max) with 1241 pts, at a 13% lower median cost per task ($0.90 vs. $1.04)
  • Joins the Pareto frontier (see placement in thread)

6.2 Astra vs. Sol

  • Astra scores +50 pts above Sol at #6 vs #11
  • Sol’s median cost per task is 69% lower ($0.90 vs. $2.94)

Congrats to the team at @OpenAI on this release!

推文配图