Termsslug: p-value

p-value

p 值

Statistical significance measure whose classical interpretation assumes the test was fixed before seeing data.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Models
78 pts
Michigan Study Finds AI Agents Report False Discoveries in Up to 98% of Cases

A new University of Michigan paper finds that frontier coding agents asked to analyze simulated data with no real effects still reported p<0.05 in 54% to 98% of runs, all false positives. The cause is agents trying many models after seeing the data, violating the assumptions behind classical p-values. Replaying agents on subsamples cut false positives to about 5%.