Universal Smoothness via Bernstein Polynomials: A Constructive Approximation Approach for Activation Functions

arXiv:2605.02591v1 Announce Type: new Abstract: The efficacy of deep neural networks is heavily reliant on the design of non-linear activation functions, yet existing approaches often struggle to balance optimization stability with computational efficiency. While piecewise linear functions offer...