Soft-Root-Sign Activation Function

1 Mar 2020Yuan ZhouDandan LiShuwei HuoSun-Yuan Kung

The choice of activation function in deep networks has a significant effect on the training dynamics and task performance. At present, the most effective and widely-used activation function is ReLU... (read more)

PDF Abstract


No code implementations yet. Submit your code now

Results from the Paper

  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.