返回全部资讯
OpenAI 官方博客T1·基座大模型

OpenAI 报告:算法优化使算力需求每 16 个月减半

原标题:AI and efficiency
68AI 研判分

OpenAI 发布分析指出,自 2012 年以来,在 ImageNet 分类任务上达到同等性能所需的训练算力每 16 个月减少一半。相比摩尔定律预期的成本下降,算法效率的提升幅度更大(44 倍 vs 11 倍),表明在高投入领域,软件层面的进步比硬件迭代更具决定性。

报道正文

We’re releasing an analysis showing that since 2012 the amount of compute needed to train a neural net to the same performance on ImageNet classification has been decreasing by a factor of 2 every 16 months. Compared to 2012, it now takes 44 times less compute to train a neural network to the level of AlexNet (by contrast, Moore’s Law would yield an 11x cost improvement over this period). Our results suggest that for AI tasks with high levels of recent investment, algorithmic progress has yielded more gains than classical hardware efficiency.