AI RESEARCH
Jordan-RoPE: Non-Semisimple Relative Positional Encoding via Complex Jordan Blocks
arXiv CS.LG
•
ArXi:2605.04217v1 Announce Type: new Relative positional encodings determine which functions of query-key lag can enter the primitive attention logit. RoPE supplies a rotary phase, while ALiBi supplies an additive distance bias. Motivated by group-theoretic views of linear translation-invariant positional encodings, we study a non-semisimple case in which a complex rotary eigenvalue and a nilpotent response live in the same defective Jordan block.