New Benchmark Reveals AI Coding Tools Fail in XR Development
A joint paper by Google, UCLA, and CMU introduces GenXR-Bench, revealing that mainstream LLMs struggle to build virtual reality applications. While Claude Opus 5 leads with a 50.9% score, no model exceeds 29.2% on SDK feature tasks, primarily due to coordinate-frame errors and startup race conditions.
Full Report
New Google + UCLA + CMU paper finds that AI coding tools often fail to build virtual and mixed reality apps because they lose track of where things are in 3D space.
Claude Opus 5 led at 50.9%, and no model topped 29.2% on SDK feature tasks. Coordinate-frame mistakes appeared in 64.4% of failed runs, and startup race conditions in 44.9%.
XR apps run in 3D space and react to head motion, hands, and room sensing. Normal coding benchmarks use unit tests or browser clicks, which cannot check whether a virtual button follows your palm.
They built GenXR-Bench, 112 expert-written tasks covering XR feature work, bug fixes, and full app builds. Its tests simulate hands and rooms, and matched blinded XR experts using real headsets 96.5% of the time.
If you use agents for XR apps, test the result with simulated hand and room input, since agent-written unit tests often miss runtime bugs.
