Attention Head

Independent sub-modules in multi-head attention mechanisms responsible for capturing specific dependencies between input sequenc