- Covers 30 personality traits (e.g., eloquent, pragmatic, sycophantic) and 21 communication characteristics, aggregated into eight personality indexes.
- Uses LLM judges for pairwise comparison of subjective traits while programmatically calculating objective style metrics (e.g., em dash and emoji frequency).
- Addresses the significant difference in 'feel' between models with equal accuracy, aiding scenario-based model selection.
AI CURATED HOT STORY · 10/20/2026
Artificial Analysis Launches AA-PersonalityBench to Quantify AI Personality and Communication Styles
Artificial Analysis has launched AA-PersonalityBench, a new benchmark designed to quantify the personality traits and communication styles of large language models. Covering 30 specific traits (such as eloquence, pragmatism, and sycophancy) and 21 objective communication features, it addresses the gap in traditional capability tests regarding "user experience," helping users select models based on subjective feel rather than just accuracy.
The benchmark employs a hybrid evaluation method: subjective traits are assessed via LLM judges using pairwise comparisons, while objective metrics like punctuation usage, emoji frequency, and response length are calculated programmatically. These granular data points are aggregated into eight core indices, including expressiveness, transparency, and warmth, creating a visual personality profile for each model.
This release marks a shift from pure capability assessment to refined user experience measurement. It provides developers and enterprises with scientific criteria for scenario-based selection—prioritizing transparency for legal tasks or creativity for writing—thereby enhancing human-AI interaction fit and satisfaction.
HEAT TRENDHourly heat curve
2 fully observed hoursTIMELINECoverage timeline
Total 2 reports · Latest first- Artificial Analysis (@ArtificialAnlys)T1·78 pts
- Artificial AnalysisT1·68 pts
- Uses LLM judges for pairwise comparison to evaluate subjective traits
- Aggregates 30 specific traits into 8 core indices such as Expressiveness, Warmth, and Imagination
- Combines programmatic measurement of 21 objective communication features including response length and structure