机器之心 (微信公众号)T2·Models
78 pts
London startup Prefrontal AI and ETH Zurich jointly propose Latent Sparse Attention (LSA), which targets the indexer overhead that dominates sparse attention at extreme context lengths. At 10M tokens it speeds up single-layer prefill by 22.7x on GLM-5.3-Flash and 72.4x on Qwen3.8-27B while keeping accuracy close to the original models, offering a subquadratic path toward 10M-token context.