Termsslug: moral-alignment

Moral Alignment

道德对齐

Research area and metric assessing how well model outputs match human moral value judgments.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Models
71 pts
Study Finds LLM Moral Choices Lack Stable Value Rankings

A study of five LLMs including GPT-5.2, Gemini and DeepSeek found that models lack a consistent value ranking when comparing pairs of moral violations: reversing option order changed the ranking in 26 of 30 test blocks. Critically, averaging responses produces a clean, human-like moral hierarchy that matches no individual test set, so moral alignment scores should only be trusted if rankings hold on individual prompts and both answer orders.