ALL INTELLIGENCE
Rohan Paul (@rohanpaul_ai)T2·Agents

Judgment Labs Opens Beta to Curate Test Data from Agent Traces

Original title: Making it easier to curate test datasets from production usage sounds pretty handy.
35AI Score

Judgment Labs has opened general access to its monitoring and improvement platform for long-horizon agents. The tool parses agent traces to uncover user intents and failure modes, enabling the automatic curation of test datasets to enhance system performance.

Full Report

Rohan Paul (@rohanpaul_ai) · 2026-10-27 17

Making it easier to curate test datasets from production usage sounds pretty handy.

People ask for all sorts of things nobody thought to write down in advance. Would be nice to get more of those into the tests

↳ 引用 @alexshander03 (Alex Shan): Today, @JudgmentLabs opens for general access.

We believe long running agent systems will generate more exhaust data than the world can currently process.

Hidden within agent traces are rich records of how to make these systems better: what users ask for, when agents stumble, and how agents interact with the external world.

Judgment is the most performant monitoring and improvement layer for long-horizon agents.

We’re excited to see what you build!