Robust Filter Attention: Self-Attention as Precision-Weighted State Estimation

arXiv:2509.04154v5 Announce Type: replace-cross Abstract: We introduce Robust Filter Attention (RFA), a formulation of self-attention as a robust state estimator. Each token is treated as a noisy observation of a latent trajectory governed by a linear stochastic differential equation (SDE), and...