Ordinary Least Squares is a Special Case of Transformer

arXiv:2604.13656v1 Announce Type: cross Abstract: The statistical essence of the Transformer architecture has long remained elusive: Is it a universal approximator, or a neural network version of known computational algorithms? Through rigorous algebraic proof, we show that the latter better...