AA-PersonalityBench: Open Weights Models Lag Proprietary in Truthfulness and Structure
Artificial Analysis's AA-PersonalityBench compares top open-weights and proprietary LLMs across 30 personality traits. Results show open-weights models rank significantly lower than proprietary ones in truthfulness, pragmatism, and structure (with a 32-point gap in truthfulness), while scoring higher on 'slop' and bottom-line summarization. This highlights current gaps in the open-source ecosystem regarding reasoning rigor and content conciseness.
Full Report
Artificial Analysis (@ArtificialAnlys) · 2026-11-04 01
In AA-PersonalityBench, the top open weights models on average rank lower than the top proprietary models on truthfulness, pragmatism and structure, and higher on slop and summarizing the bottom line
We compared the 10 open weights and 10 proprietary models measured with the highest Artificial Analysis Intelligence Index scores. Each model is percentile ranked from 1 to 100 on each of 30 personality traits. On average, the top open weights models rank 32 points lower than the top proprietary models on Truthful, the largest gap of any trait.
Average rank, top proprietary vs. top open weights:
➤ Open weights rank lower: Truthful (79 vs. 47), Pragmatic (79 vs. 49), Natural Sounding (77 vs. 52), Evidence-Based (76 vs. 47), Structured (73 vs. 45) and Literate (70 vs. 47)
➤ Open weights rank higher: Slop (30 vs. 49), Bottom-Line Summary (47 vs. 62) and Scannable (41 vs. 53)
