Rohan Paul (@rohanpaul_ai)T2·74 pts
- Saved agent skills silently go stale after environment changes and can underperform no-skill baselines
- On Terminal-Bench 2, a stale skill left Opus 11.4 points below no-skill pass rate
- Model-free replay checks with selective repair lifted Haiku tax-form field accuracy from 30.5% to 97.5%