Toolsslug: chatbot-arena

Chatbot Arena

Crowdsourced blind pairwise model comparison platform by LMSYS that produces leaderboards from anonymous votes.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Models
71 pts
Study Finds Monthly Rating Decline for Unchanged AI Models

A study of 1.26 million blind votes on Chatbot Arena found that for identical frozen model pairs, the share of "both are bad" votes rose 1.71 percentage points per month against a 17.1% baseline. Yet in 2024 the stronger model won roughly the same share of decisive votes, indicating rankings held steady and the shift reflects user expectations rather than model capability.