SVD-Softmax: Fast Softmax Approximation on Large Vocabulary Neural Networks

NeurIPS 2017 Kyuhong ShimMinjae LeeIksoo ChoiYoonho BooWonyong Sung

We propose a fast approximation method of a softmax function with a very large vocabulary using singular value decomposition (SVD). SVD-softmax targets fast and accurate probability estimation of the topmost probable words during inference of neural network language models... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper