Voice Arena Launches Real-Call ASR Benchmark Across Five Languages
Voice Arena has released a speech recognition benchmark aimed at real-world voice agent scenarios, with its first dataset, Monsoon, covering two-person conversations in five languages recorded on everyday phones. The benchmark stresses overlapping speech, interruptions, short backchannels and telephony compression, with a public leaderboard and test sets.
Related Entities
Full Report
Rohan Paul (@rohanpaul_ai) · 2026-11-05 21
Speech recognition evalualtion must test where voice agents actually work, which is phone calls between two people.
Voice Arena’s new benchmark tests speech-to-text models on real calls made on everyday phones, in real rooms, with real background sound.
Two speakers make the job much harder for the model. People talk over each other, interrupt, drop in short “yeah” and “okay” replies, and the phone line compresses the audio. A support or sales agent deals with all of this every day.
↳ 引用 @shobhitbanga (Shobhit Banga): Drop 3/15: Introducing the Speech Recognition Benchmark on @voicearena_ai.
One benchmark for every use case of speech recognition, in every language. Tested on real conversations.
Dataset 1 is live: the Monsoon Conversational ASR Test Set, two-person conversations in 5 languages.
Leaderboard and public test sets at Voice Arena.

