Attention without position is a bag of tokens

Shuffle the sentence. Every token’s output travels with it, unchanged.