The Thirty-Second AAAI Conferenceon Artificial Intelligence 2018

Orthogonal Weight Normalization: Solution to Optimization overMultiple Dependent Stiefel Manifolds in Deep Neural Networks

The Thirty-Second AAAI Conferenceon Artificial Intelligence 2018 huangleiBuaa/OthogonalWN

In this paper, we generalize such square orthogonal matrix to orthogonal rectangular matrix and formulating this problem in feed-forward Neural Networks (FNNs) as Optimization over Multiple Dependent Stiefel Manifolds (OMDSM).