Activation Functions

# Softplus

Softplus is an activation function $f\left(x\right) = \log\left(1+\exp\left(x\right)\right)$. It can be viewed as a smooth version of ReLU.

#### Papers

Paper Code Results Date Stars