Termsslug: personalized-writing-style-assessment

Personalized Writing Style Assessment

个性化文风评估

Task of judging whether generated text adheres to a user's specified writing style preferences.

Curated Intelligence

1 items · Page 1/1
Apple Machine Learning ResearchT1·Models
62 pts
LLM Judges Struggle With Personalized Writing Style Evaluation

A NeurIPS 2026 workshop paper systematically evaluates LLM judges on personalized writing style assessment. Judge quality correlates only weakly with general ability measured by MMLU (Pearson's ρ ≤ 0.2) and varies by writing task and evaluation criteria; paired comparisons prove more consistent than independent scoring, and the strongest models are not the most reliable judges.