Paper

Soft-Root-Sign Activation Function

The choice of activation function in deep networks has a significant effect on the training dynamics and task performance. At present, the most effective and widely-used activation function is ReLU... (read more)

Results in Papers With Code
(↓ scroll down to see all results)