Optimizer-Induced Mode Connectivity: From AdamW to Muon

arXiv:2605.09991v1 Announce Type: new Abstract: Mode connectivity has been widely studied, yet the role of the optimizer remains underexplored. We revisit it through optimizer-induced implicit regularization, asking how connectivity behaves when restricted to solutions constrained by a given...