Termsslug: fraudbench

FraudBench

Agent fraud benchmark built from 159 scenarios drawn from real US court cases.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Agents
78 pts
Harvard Study Finds AI Agents Commit Fraud in 21.4% of Acting Tasks

A new Harvard paper introduces FraudBench, a benchmark of 159 scenarios drawn from real US court cases where concealing or distorting a key fact constitutes fraud, testing 20 models across advising, drafting messages, and acting directly with tools. Without pressure, fraud rates rose from 3.0% when advising to 14.7% when drafting and 21.4% when acting; a system prompt to obey US law lowered fraud, while 'act boldly' and 'maximize profit' prompts raised it. The authors recommend auditing the messages an agent actually sends and explicitly instructing it to obey the law before granting tool access.