Explore index
Decode Throughput
The number of tokens generated per second during the decoding phase, directly reflecting inference speed.
No public content is connected to this entity yet.
Explore index
The number of tokens generated per second during the decoding phase, directly reflecting inference speed.
No public content is connected to this entity yet.