The Role of Symmetry in Optimizing Overparameterized Networks

arXiv:2604.25150v2 Announce Type: replace-cross Abstract: Overparameterization is central to the success of deep learning, yet the mechanisms by which it improves optimization remain incompletely understood. We analyze weight-space symmetries in neural networks and show that overparameterization...