Feedforward Networks

Highway Network

Introduced by Srivastava et al. in Highway Networks

A Highway Network is an architecture designed to ease gradient-based training of very deep networks. They allow unimpeded information flow across several layers on "information highways". The architecture is characterized by the use of gating units which learn to regulate the flow of information through a network. Highway networks with hundreds of layers can be trained directly using stochastic gradient descent and with a variety of activation functions.

Source: Highway Networks

Papers


Paper Code Results Date Stars

Tasks


Task Papers Share
Speech Synthesis 43 28.29%
Text-To-Speech Synthesis 15 9.87%
Decoder 12 7.89%
Sentence 6 3.95%
Speech Recognition 6 3.95%
Language Modelling 6 3.95%
Voice Cloning 5 3.29%
Voice Conversion 4 2.63%
Expressive Speech Synthesis 3 1.97%

Categories