Explore indexBack to Terms
Token Throughput
Number of tokens generated or processed per unit time, a key metric for measuring inference speed
No public content is connected to this entity yet.
Number of tokens generated or processed per unit time, a key metric for measuring inference speed
No public content is connected to this entity yet.