Hacker News AIT2·Agents
78 pts
Runta and Baseten released the FrontierHarness v1.1 leaderboard, spanning 22 agent harnesses, 5 models and 62 tasks across 27,280 runs and 83B tokens. The headline finding: switching models should come with switching harnesses, since each model's best value-for-money harness differs and cost rankings shift by a median of 11 of 22 places, with Codex CLI falling from 1st with GLM-5.3 to 16th with Kimi-K3. Notably, 64% of inference spend went to failed runs, and neither tool count nor cache hit rate predicted cost per pass, only step count did.