Toolsslug: samir-vllm

samir-vllm

Educational project building a small LLM inference engine from scratch in C++ and CUDA.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Tools
58 pts
Handwritten Notes and Six Hours of Video Teach LLM Inference From Scratch

A developer has open-sourced samir-vllm, a teaching project that builds a small LLM inference engine from scratch in C++ and CUDA, covering everything from loading SafeTensor weights to executing each transformer stage on GPU. It ships with 85 pages of handwritten notes and over six hours of video, explicitly written without AI assistance, making it a solid structured resource for engineers who want to understand inference internals.