Artificial Analysis (@ArtificialAnlys)T1·Agents
72 pts
Google DeepMind, in partnership with Artificial Analysis, launched the Multimodal Knowledge Agent (MKA) evaluation, a benchmark of 200 private real-world visual tasks spanning 10 industries. Agents must interpret dense visual files such as architectural drawings, engineering schematics and clinical scans, then produce deliverables including slide decks, spreadsheets and reports. Scoring uses expert rubrics split into Climb and Regression criteria, averaging about 70 weighted items per task, with Claude Sonnet 5.5 leading in several domains.