Marktechpost (@Marktechpost)T2·Open Source
78 pts
Meta FAIR has open-sourced e-means, a drop-in replacement for k-means that reads small mini-batches and maintains exponential moving averages of cluster sums and counts, with two fitted scaling laws auto-selecting batch and step size. It reaches Lloyd's 25-epoch loss in just 1.4 to 2.6 epochs, delivering 10-45x GPU speedup over Flash-KMeans and 8-15x CPU speedup over Faiss, and clustered 10 billion DINO embeddings into 16.7M clusters in 2.5 epochs. The trade-off is stochastic runs and 64 GiB of float32 accumulators requiring sharding at that scale.