IT之家 · 智能时代T2·68 pts
- AI inference demand is exploding across task complexity, context length, and request volume, driving a predicted 20x growth in infrastructure performance scale by 2030.
- Expanding KV Cache forces data distribution across HBM, DRAM, and SSD, making data migration a new bottleneck for performance and energy consumption.
- SK Hynix is advancing 3D stacked DRAM and High Bandwidth Flash (HBF) to create new storage tiers, targeting HBF bandwidth at 50% of same-gen HBM with 10x capacity.