Adam Induces Implicit Weight Sparsity in Rectifier Neural Networks

no code implementations • 19 Dec 2018 • Atsushi Yaguchi, Taiji Suzuki, Wataru Asano, Shuhei Nitta, Yukinobu Sakata, Akiyuki Tanizawa

In recent years, deep neural networks (DNNs) have been applied to various machine leaning tasks, including image recognition, speech recognition, and machine translation.

Machine Translation speech-recognition +2