Harvard Study Finds Top Model Outage Barely Moved Developer Merge Rates
A Harvard paper exploits the 19-day suspension of Claude Fable 5 under a U.S. export control directive in June 2026, comparing 297 affected users with 8,908 developers who stayed on Opus 4.8. Access to the stronger model raised the 7-day pull request merge rate by only 1.4 points, within noise, and five other model upgrades showed no merge-rate gains either, with 94.5% of PRs already merged beforehand.
Full Report
Rohan Paul (@rohanpaul_ai) · 2026-11-22 16
New Harvard paper finds that when Claude Fable 5 was suspended for 19 days, its users' pull requests got merged about as often on the weaker Opus 4.8.
A U.S. export control directive cut off Claude Fable 5 for 19 days in June 2026, and most users switched to Opus 4.8. The study tracked GitHub pull requests from 297 Fable 5 users against 8,908 developers who stayed on Opus 4.8.
Access to Fable 5 raised the 7-day merge rate by only 1.4 points, a change within noise. Across 5 other model upgrades, merge rates did not rise either, though 94.5% of pull requests were already merged beforehand.
