Hacker News AIT2·Infra
48 pts
This tool estimates GPU requirements for processing millions to trillions of tokens, citing ~367 H100s for 1 trillion monthly tokens on Llama 3.3 70B. It derives results from throughput, utilization, and I/O ratios, highlighting sensitivity to key assumptions.