ANO: A Principled Approach to Robust Policy Optimization

arXiv:2605.02320v1 Announce Type: new Abstract: Proximal Policy Optimization (PPO) dominates deep RL but faces a fundamental dilemma. Its "hard clipping" mechanism discards valuable gradient information from outliers, leading to sample inefficiency. Conversely, removing clipping (as in SPO) exposes...