Termsslug: h100

H100

High-performance data center GPU by NVIDIA, widely used for LLM training and inference

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Infra
48 pts
GPU Calculator for Million to Trillion Tokens

This tool estimates GPU requirements for processing millions to trillions of tokens, citing ~367 H100s for 1 trillion monthly tokens on Llama 3.3 70B. It derives results from throughput, utilization, and I/O ratios, highlighting sensitivity to key assumptions.