Rohan Paul (@rohanpaul_ai)T2·78 pts
- VeriCUA verifies task completion by building requirement checklists and executing code/file-level checks, rejecting agent self-claims.
- On ScienceBoard, VeriCUA achieved a 5.4% false-positive rate, significantly outperforming VLM judges (24.8%) and script verifiers (21.7%).
- For scenarios using agent outputs for training or evals, prioritize checking actual machine state (e.g., saved files) over visual screenshots.