Feedforward Networks

Highway Network

Introduced by Srivastava et al. in Highway Networks

A Highway Network is an architecture designed to ease gradient-based training of very deep networks. They allow unimpeded information flow across several layers on "information highways". The architecture is characterized by the use of gating units which learn to regulate the flow of information through a network. Highway networks with hundreds of layers can be trained directly using stochastic gradient descent and with a variety of activation functions.

Source: Highway Networks

Papers


Paper Code Results Date Stars

Categories