量子位 (微信公众号)T2·68 pts
- The Ember inference engine enables lossless execution of 30B LLMs on smartphones by optimizing system overhead rather than compressing model precision.
- Cloud LLM demand has driven DRAM prices up nearly 10x, forcing the industry to accelerate edge AI adoption to resolve storage-compute mismatches.
- With support from upstream technologies like HBF, 100B parameter models are projected to run smoothly on mobile devices next year, boosting agentic phones.