Time to First Token

Time to First Token (TTFT) measures the latency elapsed between an LLM inference service receiving a request and emitting its very first output token. Dominated by prompt prefill computation, prefix cache hit rates, and queue times, TTFT is the principal metric governing interactive UI responsiveness.