Rohan Paul (@rohanpaul_ai)T2·85 pts
- RL post-training introduces a 'Sharpening Tax,' narrowing output distributions and reducing the probability of finding correct solutions via multiple attempts.
- Base models (e.g., Gemma-4-31B) may achieve higher final success rates than RL-tuned counterparts in scenarios allowing retries.
- Evaluation of retry-capable agents should focus on 'final resolution rate' rather than just 'first-attempt accuracy.'