Bits-Per-Byte

A metric that normalizes language model loss by bytes rather than tokens, often used to compare models across tokenizers.