Termsslug: mmlu

MMLU

General benchmark measuring multidisciplinary knowledge and reasoning of LLMs.

Curated Intelligence

1 items · Page 1/1
Apple Machine Learning ResearchT1·Models
62 pts
LLM Judges Struggle With Personalized Writing Style Evaluation

A NeurIPS 2026 workshop paper systematically evaluates LLM judges on personalized writing style assessment. Judge quality correlates only weakly with general ability measured by MMLU (Pearson's ρ ≤ 0.2) and varies by writing task and evaluation criteria; paired comparisons prove more consistent than independent scoring, and the strongest models are not the most reliable judges.