Search Results for author: Tsung-Nan Lin

Found 3 papers, 0 papers with code

Vanishing Nodes: Another Phenomenon That Makes Training Deep Neural Networks Difficult

no code implementations22 Oct 2019 Wen-Yu Chang, Tsung-Nan Lin

The numerical results from the experiments suggest that the degree of vanishing nodes will become more evident during back-propagation training, and that when the VNI is equal to 1, the network cannot learn simple tasks (e. g. the XOR problem) even when the gradients are neither vanishing nor exploding.

Cannot find the paper you are looking for? You can Submit a new open access paper.