Explore indexBack to Terms
GQA
An attention mechanism where multiple query heads share a single set of key-value heads, balancing between MHA and MQA.
No public content is connected to this entity yet.
An attention mechanism where multiple query heads share a single set of key-value heads, balancing between MHA and MQA.
No public content is connected to this entity yet.