Activation Functions
Lecun's Tanh
LeCun's tanh is an activation function of the form $f\left(x\right) = 1.7159\tanh\left(\frac{2}{3}x\right)$. The constants were chosen to keep the variance of the output close to 1.
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tanh Activation
