返回全部资讯
Rohan Paul (@rohanpaul_ai)T2·开发与工程

Voice Arena 发布首个 AI 听写应用开放基准

原标题:If a dictation company says it is the best, I would now ask how it scores on Dictation Bench.
62AI 研判分

Voice Arena 推出 Dictation Bench,这是首个针对 AI 听写应用的开放基准。测试将 87 位说话人的 761 段录音输入 10 款 Mac 真实应用(非 API),由 5 个 LLM 评审判断草稿能否直接发送,Wispr Flow 得分 79%,Apple 仅 35%。该基准公开了参考策略、应用配置与评审指令,为厂商提供了可复现的对比标准。

报道正文

Rohan Paul (@rohanpaul_ai) · 2026-11-11 15

If a dictation company says it is the best, I would now ask how it scores on Dictation Bench. One test does not cover every use case, but that kind of claim should hold up in a shared comparison that anyone can inspect.

@voicearena_ai played the same 761 recordings from 87 speakers into ten dictation apps on a Mac (the real apps, not their APIs). They published the reference policies, the app configurations, the judge instructions, and results that flag which gaps are statistical ties.

So companies now have something concrete to respond to. They can show where their product leads, explain the failures, or show that a different task changes the result. Any of those is more useful than asking users to compare percentages measured under different conditions.

The current test covers US English on macOS only, and the results should be read with that scope. Within it, I would like companies to report against this benchmark routinely. A shared standard makes claims easier to check and improvements easier to prove, and this benchmark is a practical place to start.

↳ 引用 @shobhitbanga (Shobhit Banga): Drop 4/15: Announcing the Voice Arena Dictation Bench - the first open benchmark of AI dictation apps.

Not their APIs: the real apps. We played 761 recordings from 87 speakers into each of 10 apps on a Mac, then 5 LLM judges asked if each draft could be sent as-is.

Wispr Flow: 79%. Apple: 35% 🧵