HOT RADAR
agentHEAT 8.9°

AI CURATED HOT STORY · 11/19/2026

Eight Universities Launch EFE Benchmark for Coding Agents in Robotics

1 reports archived1 independent sourcesupdated 11/19/2026, 12:46:00
Synthesis & Latest Updates
1 Sources Cross-Validated

Researchers from Northwestern, Carnegie Mellon and six other universities introduce Embodied First Exam (EFE), a unified framework that plugs general coding agents into simulated robots to test task completion under physical constraints. Fable 5.2 scores 80% in open-book mode but only 47% closed-book, revealing heavy reliance on documentation and external hints. EFE offers a reproducible map of where coding agents break down when moving from software to embodied settings.

LATEST/Researchers from Northwestern, Carnegie Mellon and six other universities introduce Embodied First Exam (EFE), a unified framework that plugs general coding agents into simulated robots to test task completion under physical constraints. Fable 5.2 scores 80% in open-book mode but only 47% closed-book, revealing heavy reliance on documentation and external hints. EFE offers a reproducible map of where coding agents break down when moving from software to embodied settings.

Hourly heat curve

3 fully observed hours
Now
8.9
Peak
9.523:00
24h change
–

The line compares only sources observed throughout; gap hours are interpolated to keep the trend continuous.

Coverage timeline

Total 1 reports · Latest first