Dynamic Contextual Weighting Self-Attention

Meaning

A mechanism that calculates mathematical relationships between all pairs of tokens across a sequence simultaneously.