Termsslug: safetensor

SafeTensor

Hugging Face model weight serialization format with metadata and tensor data.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Tools
58 pts
Handwritten Notes and Six Hours of Video Teach LLM Inference From Scratch

A developer has open-sourced samir-vllm, a teaching project that builds a small LLM inference engine from scratch in C++ and CUDA, covering everything from loading SafeTensor weights to executing each transformer stage on GPU. It ships with 85 pages of handwritten notes and over six hours of video, explicitly written without AI assistance, making it a solid structured resource for engineers who want to understand inference internals.