Termsslug: ddp

DDP

分布式数据并行

A training strategy that shards data across devices for parallel gradient computation and synchronization

Curated Intelligence

1 items · Page 1/1
GitHub Trending AIT2·Open Source
68 pts
LLMs-from-scratch Hits 106k Stars: Build GPT from Scratch

Sebastian Raschka's open-source project LLMs-from-scratch has surpassed 106,000 GitHub stars, establishing itself as a benchmark resource for understanding LLM internals. The repository accompanies the book of the same name, providing end-to-end code for data preprocessing, Transformer implementation, pretraining, and fine-tuning to help developers grasp how large language models work by building them from scratch.