Qwen 官方博客 (通义)T1·Infra
78 pts
The Qwen team has open-sourced FlashQLA, a high-performance linear attention library built on TileLang and optimized for Gated Delta Networks (GDN). By leveraging gate-driven intra-GPU sequence parallelism and hardware-friendly algebraic rewrites, it achieves 2-3x forward and 2x backward speedups on NVIDIA Hopper GPUs, significantly reducing training and inference costs for long-context models.