Toolsslug: codex-cli

Codex CLI

OpenAI's open-source terminal coding agent harness supporting multiple models.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Agents
78 pts
Coding Agent Benchmark Finds 64% of Inference Spend Wasted on Failures

Runta and Baseten released the FrontierHarness v1.1 leaderboard, spanning 22 agent harnesses, 5 models and 62 tasks across 27,280 runs and 83B tokens. The headline finding: switching models should come with switching harnesses, since each model's best value-for-money harness differs and cost rankings shift by a median of 11 of 22 places, with Codex CLI falling from 1st with GLM-5.3 to 16th with Kimi-K3. Notably, 64% of inference spend went to failed runs, and neither tool count nor cache hit rate predicted cost per pass, only step count did.