ALL INTELLIGENCE
OpenAI 官方博客T1·Models

OpenAI Introduces Reptile Meta-Learning Algorithm

Original title: Reptile: A scalable meta-learning algorithm
68AI Score

OpenAI researchers introduced Reptile, a simple and scalable meta-learning algorithm. It works by repeatedly sampling tasks, performing stochastic gradient descent, and updating initial parameters towards the final learned parameters. Reptile requires only black-box access to optimizers like SGD or Adam, offering computational efficiency and performance similar to first-order MAML but with greater simplicity.

Full Report

We’ve developed a simple meta-learning algorithm called Reptile which works by repeatedly sampling a task, performing stochastic gradient descent on it, and updating the initial parameters towards the final parameters learned on that task. Reptile is the application of the Shortest Descent algorithm to the meta-learning setting, and is mathematically similar to first-order MAML (which is a version of the well-known MAML algorithm) that only needs black-box access to an optimizer such as SGD or Adam, with similar computational efficiency and performance.