Today for AI
HOT RADAR
llmHEAT 6.1°

AI CURATED HOT STORY · 10/31/2026

New RWE-Bench Reveals AI's Poor Real-World Engineering Design Skills

1 reports archived1 independent sourcesupdated 10/31/2026, 20:32:00
Synthesis & Latest Updates
1 Sources Cross-Validated

Xplore AI released RWE-Bench to evaluate LLMs on real-world engineering tasks like CAD and simulation. Results show even the top model (GPT-6 Astra) achieved only a 37% pass rate, with most models scoring near zero, highlighting significant gaps in handling physical constraints and complex design workflows.

LATEST/Xplore AI released RWE-Bench to evaluate LLMs on real-world engineering tasks like CAD and simulation. Results show even the top model (GPT-6 Astra) achieved only a 37% pass rate, with most models scoring near zero, highlighting significant gaps in handling physical constraints and complex design workflows.

Hourly heat curve

30 fully observed hours
Now
6.1
Peak
11.921:00
24h change
-44%

The line compares only sources observed throughout; gap hours are interpolated to keep the trend continuous.

Coverage timeline

Total 1 reports · Latest first
  1. 新智元 (微信公众号)T2·78 pts

    New RWE-Bench Reveals AI's Poor Real-World Engineering Design Skills

    • RWE-Bench features 20 real-world engineering problems in mechanical, aerospace, and electronics, created and validated by human engineers.
    • Scoring is automated via physics solvers to ensure objective compliance with strict technical metrics like stress limits and fatigue factors.
    • Current mainstream LLMs perform poorly on engineering design tasks requiring multi-step reasoning, tool use, and physical intuition, with a max pass rate of only 37%.