How Vision Transformers Represent Position: A Mechanistic Comparison of Absolute and Rotary Positional Encodings
Abstract page for arXiv paper 2610.13992: How Vision Transformers Represent Position: A Mechanistic Comparison of Absolute and Rotary Positional Encodings
arXiv.org