Today for AI
HOT RADAR
llmHEAT 20.0°

AI CURATED HOT STORY · 10/21/2026

MLCR-AA Update: Claude Sonnet 5.5 and GPT-6 Astra Tie for Top Medical Reasoning Score

2 reports archived1 independent sourcesupdated 10/22/2026, 10:04:56
Synthesis & Latest Updates
1 Sources Cross-Validated

Artificial Analysis updated the MLCR-AA leaderboard with refined prompts and a three-model judge panel to better reflect real-world medical record review. Claude Sonnet 5.5 and GPT-6 Astra tied for first place with a 41.7% pass rate, yet results indicate that medical long-context reasoning remains far from solved, with median models passing under 15%. Qwen3.8 2.4T A95B leads among open-weight models.

LATEST/Artificial Analysis updated the MLCR-AA leaderboard with refined prompts and a three-model judge panel to better reflect real-world medical record review. Claude Sonnet 5.5 and GPT-6 Astra tied for first place with a 41.7% pass rate, yet results indicate that medical long-context reasoning remains far from solved, with median models passing under 15%. Qwen3.8 2.4T A95B leads among open-weight models.

HEAT TRENDHourly heat curve

23 fully observed hours
Now
20.0
Peak
26.710-22
24h change
-25%

The line compares only sources observed throughout; gap hours are interpolated to keep the trend continuous.

TIMELINECoverage timeline

Total 2 reports · Latest first
  1. Artificial Analysis (@ArtificialAnlys)T1·68 pts
    • Claude series (Sonnet/Opus/Fable) leads OpenAI models by ~19-23 points in MLCR-AA completeness metrics.
    • OpenAI's GPT-6 Astra tops the length-adjusted score in HealthBench Professional, indicating more concise and accurate responses.
    • Single-dimension scoring is biased; combining completeness and accuracy metrics provides a fairer assessment of long-context medical reasoning capabilities.