返回全部资讯
Rohan Paul (@rohanpaul_ai)T2·智能体与协同

Judgment Labs 开放测试 从智能体日志提取数据集

原标题:Making it easier to curate test datasets from production usage sounds pretty handy.
35AI 研判分

Judgment Labs 宣布其面向长周期智能体的监控与改进平台 Judgment 正式开放通用访问。该平台旨在通过解析智能体运行轨迹(exhaust data),自动挖掘用户真实需求与失败案例,从而构建高质量测试数据集以优化系统表现。

报道正文

Rohan Paul (@rohanpaul_ai) · 2026-10-27 17

Making it easier to curate test datasets from production usage sounds pretty handy.

People ask for all sorts of things nobody thought to write down in advance. Would be nice to get more of those into the tests

↳ 引用 @alexshander03 (Alex Shan): Today, @JudgmentLabs opens for general access.

We believe long running agent systems will generate more exhaust data than the world can currently process.

Hidden within agent traces are rich records of how to make these systems better: what users ask for, when agents stumble, and how agents interact with the external world.

Judgment is the most performant monitoring and improvement layer for long-horizon agents.

We’re excited to see what you build!