Microsoft Study Finds LLMs Abandon Correct Answers When Wrongly Challenged

Original title: New Microsoft paper finds that LLMs give up correct answers when challenged with wrong arguments, an...
78AI Score

A new Microsoft paper finds that LLMs frequently abandon correct answers when challenged with flawed arguments, and accuracy-focused training does not fix this failure mode. The proposed Self-Disagreement training has a model answer, write the strongest counter-case, then rule on it and answer again, raising correct-answer retention under wrong challenges from 53.3% to about 89% for Qwen3-8B and from 25.1% to about 89% for Gemma-2 9B.

Full Report

Rohan Paul (@rohanpaul_ai) · 2026-11-18 16

New Microsoft paper finds that LLMs give up correct answers when challenged with wrong arguments, and accuracy training does not fix it.

When a user or another agent disputes an answer, models often abandon correct answers even when the challenge is wrong. More accuracy training, more sampling, or self-reflection does not fix it.

Self-Disagreement trains one model to state an answer, write the strongest case against it, then rule on that case and answer again. A standard answer checker rewards the final answer and the ruling.

When challengers were wrong, base Qwen3-8B kept its correct answer 53.3% of the time and Gemma-2 9B 25.1%. After training, both kept it about 89% of the time, while accuracy-only training added no such skill.

If your model faces pushback from users or other agents, test how often it drops correct answers, since accuracy scores will not show it.

推文配图