新智元 (微信公众号)T2·Agents
72 pts
Researchers from Northwestern, Carnegie Mellon and six other universities introduce Embodied First Exam (EFE), a unified framework that plugs general coding agents into simulated robots to test task completion under physical constraints. Fable 5.2 scores 80% in open-book mode but only 47% closed-book, revealing heavy reliance on documentation and external hints. EFE offers a reproducible map of where coding agents break down when moving from software to embodied settings.