Artificial Analysis has launched the AA-3D benchmark to evaluate large language models' ability to construct interactive three.js scenes from text briefs within an offline sandbox. Moving beyond static code checks, it employs an Elo ranking system derived from over 10,000 human blind votes, directly reflecting user preferences for visual quality and interaction.
Technically, the benchmark allows models to iteratively build web pages using Blender, Rapier physics engine, and Python. Claude Sonnet 5.5 leads with a score of 1194, statistically tied with several other Anthropic and OpenAI models. Notably, performance does not correlate linearly with cost; while GPT-6 Luna is the cheapest, it ranks eighth, highlighting that top-tier models still hold significant advantages in complex spatial logic and rendering fidelity.
This release provides developers with a more realistic evaluation metric, filling gaps in assessing dynamic interaction and visual quality. It encourages the industry to reconsider AI's potential in embodied intelligence and frontend automation, pushing models toward comprehensive agents capable of spatial understanding and real-time rendering, with profound implications for game development, digital twins, and Web 3D ecosystems.