Toolsslug: simplebench

SimpleBench

Multiple-choice text benchmark for LLMs covering spatio-temporal reasoning, social intelligence and adversarial trick questions,

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Models
58 pts
SimpleBench Shows Top LLMs Still Trail Ordinary Humans on Common Sense

Researchers released SimpleBench, a 200-plus-question multiple-choice benchmark covering spatio-temporal reasoning, social intelligence and linguistic adversarial trick questions. A non-specialized human baseline of 83.7% from nine participants beat every tested frontier model, with top performer Claude Fable reaching only 81.9%, showing memorized knowledge and approximate retrieval are still insufficient for basic common-sense questions.