Directional Consistency as a Complementary Optimization Signal: The GONO Framework

arXiv:2605.06575v1 Announce Type: cross Abstract: We identify and formalize an underexplored phenomenon in deep learning optimization: directional alignment and loss convergence can be decoupled. An optimizer can exhibit near-perfect directional consistency (cc_t -> 1, measured via consecutive...