Rohan Paul (@rohanpaul_ai)T2·Models
78 pts
OpenAI has published MedChemBench, a medicinal chemistry benchmark built from 117 papers and patents spanning 761 graded molecular structures, with prompts cut off at real decision points and later reported results withheld. The strongest model, GPT-6.2 Astra, scores about 84% overall and is near-perfect at reading chemistry, yet is correct only about half the time on the decision that actually matters, exposing a clear gap in real-world drug design judgment.