Rohan Paul (@rohanpaul_ai)T2·Models
78 pts
A new paper from Stanford and other top labs shows a 27B open model can improve itself without training or gradients: Qwen3.5-27B was given access to its own weights, graded practice answers and a Python session with gradients blocked, then reasoned over hidden states for completed versus truncated answers and weakened the direction separating them. On 490 held-out problems fixed in advance, accuracy rose from 57.2% to 63.8%, while the 2B model made no edit and the 4B and 9B models degraded themselves.