OpenAI: AI Compute Doubles Every 3.4 Months
OpenAI released an analysis showing that since 2012, compute used in the largest AI training runs has grown exponentially with a 3.4-month doubling time, far outpacing Moore's Law. This metric has increased by over 300,000x, highlighting compute as a key driver of AI progress and signaling the need to prepare for systems beyond current capabilities.
Related Entities
Full Report
We’re releasing an analysis showing that since 2012, the amount of compute used in the largest AI training runs has been increasing exponentially with a 3.4-month doubling time (by comparison, Moore’s Law had a 2-year doubling period)[^footnote-correction]. Since 2012, this metric has grown by more than 300,000x (a 2-year doubling period would yield only a 7x increase). Improvements in compute have been a key component of AI progress, so as long as this trend continues, it’s worth preparing for the implications of systems far outside today’s capabilities.