Google DeepMindT1·Infra
78 pts
DeepMind introduces Decoupled DiLoCo, a new distributed architecture designed to overcome synchronization bottlenecks in large-scale LLM training across distant data centers. By dividing compute into asynchronous 'islands,' the approach reduces bandwidth requirements and enhances hardware resilience, offering a scalable path for future frontier models.