Y Zhou, Z Zhu, Z Zhong - 2021 IEEE/CVF International Conference on …, 2021 - computer.org
The choice of activation functions is crucial for modern deep neural networks. Popular hand-
designed activation functions like Rectified Linear Unit (ReLU) and its variants show …