# Tensor Switching Networks

Chuan-Yung TsaiAndrew SaxeDavid Cox

We present a novel neural network algorithm, the Tensor Switching (TS) network, which generalizes the Rectified Linear Unit (ReLU) nonlinearity to tensor-valued hidden units. The TS network copies its entire input vector to different locations in an expanded representation, with the location determined by its hidden unit activity... (read more)

PDF Abstract