Rohan Paul (@rohanpaul_ai)T2·78 pts
- The Double Ratchet framework allows graders to co-evolve with agents without pre-defined complex rubrics.
- Effective rule-based graders can be built from just 10 labeled samples, performing well in code and SQL tasks.
- Experimental data shows the method retains 88% to 110% of the performance gains compared to using ground truth or human rubrics.