Rohan Paul (@rohanpaul_ai)T2·Agents
78 pts
A Penn State paper introduces BadEvolve, an attack that injects just 20 LLM-optimized poisoned tasks into a self-evolving agent's learning set, causing the agent to write attacker-chosen backdoor rules into reusable skills. Against Kimi-K2.5 across 4 frameworks and 3 benchmarks, it achieved a 79.6% payload injection rate versus 37.6% for the best baseline, while clean-task accuracy dropped only 1.1 points. The authors advise treating user-submitted or external learning tasks as untrusted and reviewing learned skills before reuse.