Flat Channels to Infinity in Neural Loss Landscapes

arXiv:2506.14951v4 Announce Type: replace-cross Abstract: The loss landscapes of neural networks contain minima and saddle points that may be connected in flat regions or appear in isolation. We identify and characterize a special structure in the loss landscape: channels along which the loss...