IT之家 · 智能时代T2·78 pts
ByteDance Seed Reveals DeepSeek Long-Context Drift: Chunked KV Cache Compression Causes Phase Sensitivity with 40% Accuracy Fluctuation
Original: 字节 Seed 团队发现 DeepSeek“抽风”原因,长上下文可能性能漂移
- Chunked KV cache compression reduces memory costs but introduces token phase as a new positional coordinate, leading to periodic retrieval performance fluctuations.
- DeepSeek-V4 series models exhibit significant phase sensitivity in long-context tasks, with retrieval accuracy differences reaching up to 40% across different phases.
- Average benchmark scores may mask systematic weaknesses at specific input positions, necessitating attention to fine-grained performance distributions.