No positional encoding, and still a coordinate

With a causal mask, query \(i\) can see exactly \(i + 1\) tokens. A head that averages them returns a mean whose spread depends on \(i\).