Hacker News AIT2·Tools
58 pts
A developer has open-sourced samir-vllm, a teaching project that builds a small LLM inference engine from scratch in C++ and CUDA, covering everything from loading SafeTensor weights to executing each transformer stage on GPU. It ships with 85 pages of handwritten notes and over six hours of video, explicitly written without AI assistance, making it a solid structured resource for engineers who want to understand inference internals.