Search Results for author: Vasily Zadorozhnyy

Found 5 papers, 4 papers with code

Breaking Time Invariance: Assorted-Time Normalization for RNNs

1 code implementation28 Sep 2022 Cole Pospisil, Vasily Zadorozhnyy, Qiang Ye

Methods such as Layer Normalization (LN) and Batch Normalization (BN) have proven to be effective in improving the training of Recurrent Neural Networks (RNNs).

Language Modelling

Orthogonal Gated Recurrent Unit with Neumann-Cayley Transformation

1 code implementation12 Aug 2022 Edison Mucllari, Vasily Zadorozhnyy, Cole Pospisil, Duc Nguyen, Qiang Ye

In recent years, using orthogonal matrices has been shown to be a promising approach in improving Recurrent Neural Networks (RNNs) with training, stability, and convergence, particularly, to control gradients.

Symmetry Structured Convolutional Neural Networks

2 code implementations3 Mar 2022 Kehelwala Dewage Gayan Maduranga, Vasily Zadorozhnyy, Qiang Ye

We consider Convolutional Neural Networks (CNNs) with 2D structured features that are symmetric in the spatial dimensions.

Sequential Recommendation

Cannot find the paper you are looking for? You can Submit a new open access paper.