Termsslug: hidden-states

Hidden States

隐藏状态

Internal layer activations used here to capture the direction separating completed from truncated answers.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Models
78 pts
Stanford-led Study Finds 27B Open Model Can Self-Improve by Editing Its Own Weights

A new paper from Stanford and other top labs shows a 27B open model can improve itself without training or gradients: Qwen3.5-27B was given access to its own weights, graded practice answers and a Python session with gradients blocked, then reasoned over hidden states for completed versus truncated answers and weakened the direction separating them. On 490 held-out problems fixed in advance, accuracy rose from 57.2% to 63.8%, while the 2B model made no edit and the 4B and 9B models degraded themselves.