Apple Machine Learning ResearchT1·Models
62 pts
A NeurIPS 2026 workshop paper systematically evaluates LLM judges on personalized writing style assessment. Judge quality correlates only weakly with general ability measured by MMLU (Pearson's ρ ≤ 0.2) and varies by writing task and evaluation criteria; paired comparisons prove more consistent than independent scoring, and the strongest models are not the most reliable judges.