Termsslug: embodied-first-exam

Embodied First Exam

具身第一考

Unified benchmark framework connecting general coding agents to simulated robots to map task success and failure under physical

Curated Intelligence

1 items · Page 1/1
新智元 (微信公众号)T2·Agents
72 pts
Eight Universities Launch EFE Benchmark for Coding Agents in Robotics

Researchers from Northwestern, Carnegie Mellon and six other universities introduce Embodied First Exam (EFE), a unified framework that plugs general coding agents into simulated robots to test task completion under physical constraints. Fable 5.2 scores 80% in open-book mode but only 47% closed-book, revealing heavy reliance on documentation and external hints. EFE offers a reproducible map of where coding agents break down when moving from software to embodied settings.