Termsslug: mla-decode-kernel

MLA Decode Kernel

MLA 解码内核

Compute kernel for the multi-head latent attention decode phase, a key target for inference optimization.

Curated Intelligence

1 items · Page 1/1
Rohan Paul (@rohanpaul_ai)T2·Agents
78 pts
UC Berkeley Supervisor Rebuilds Coding Agent Teams to Beat Expert GPU Kernels

A new UC Berkeley paper introduces Evolving Agent Teams, in which a supervisor diagnoses plateaus in coding-agent teams and rebuilds roles such as profiler, debugger, and knowledge integrator, with a shared file system carrying lessons across teams. On the MLA decode kernel it reached 0.74x FlashInfer speed under the same token budget versus 0.31x for a fixed four-role team, and 1.21x with more budget, winning 36 of 47 production workloads.