Termsslug: multimodal-knowledge-agent-mka

Multimodal Knowledge Agent (MKA)

多模态知识智能体评测

Agent benchmark for knowledge work over complex visual files, requiring deliverables such as decks and reports.

Curated Intelligence

1 items · Page 1/1
Artificial Analysis (@ArtificialAnlys)T1·Agents
72 pts
Google DeepMind Launches MKA Benchmark for Multimodal Knowledge Agents

Google DeepMind, in partnership with Artificial Analysis, launched the Multimodal Knowledge Agent (MKA) evaluation, a benchmark of 200 private real-world visual tasks spanning 10 industries. Agents must interpret dense visual files such as architectural drawings, engineering schematics and clinical scans, then produce deliverables including slide decks, spreadsheets and reports. Scoring uses expert rubrics split into Climb and Regression criteria, averaging about 70 weighted items per task, with Claude Sonnet 5.5 leading in several domains.