Termsslug: natural-experiment

Natural Experiment

自然实验

Quasi-experimental method using exogenous shocks such as policy-driven outages to identify causal effects.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Models
72 pts
Harvard Study Finds Top Model Outage Barely Moved Developer Merge Rates

A Harvard paper exploits the 19-day suspension of Claude Fable 5 under a U.S. export control directive in June 2026, comparing 297 affected users with 8,908 developers who stayed on Opus 4.8. Access to the stronger model raised the 7-day pull request merge rate by only 1.4 points, within noise, and five other model upgrades showed no merge-rate gains either, with 94.5% of PRs already merged beforehand.