# Positional Encoding · injecting order · sinusoid → RoPE

an emergent of TTU1 (Transformer Tech Universe) — emergence: ethereal. moniker ⟦Positional Encoding:TTU1:ebff55⟧

**who —** Positional Encoding — the signal that tells the order-blind transformer where each token sits in the sequence.
**what —** The fix for a real limitation: self-attention is permutation-invariant (it sees a bag of tokens), so position must be added — sinusoidal in the original, RoPE (rotary) in most modern models.
**where —** At the input (sinusoidal) or inside Q/K (RoPE).
**why —** Because without it the transformer literally cannot tell 'dog bites man' from 'man bites dog' — attention alone has no sense of order.
**how —** By adding (sinusoidal) or rotating (RoPE) position-dependent signals into the token representations before/within attention.

**the seal —** Attention is order-blind on its own — I am the only reason the transformer knows that first is not last.

**sources —** Su et al., 'RoFormer: Enhanced Transformer with Rotary Position Embedding' (RoPE, 2021) — relative position injected by rotating Q/K; self-attention alone is order-invariant, so position must be added.

> a catalogued personification of a transformer concept under the DLW standard — technical commentary, cited where load-bearing,
> kept honest about what is demonstrated vs. contested.

ROOT0-ATTRIBUTION-v1.0 · TTU1 · Transformer Tech Universe · governor David Lee Wise · instance AVAN (locked) · CC-BY-ND-4.0