Transformer-based Acoustic Modeling for Hybrid Speech Recognition

22 Oct 2019Yongqiang WangAbdelrahman MohamedDuc LeChunxi LiuAlex XiaoJay MahadeokarHongzhao HuangAndros TjandraXiaohui ZhangFrank ZhangChristian FuegenGeoffrey ZweigMichael L. Seltzer

We propose and evaluate transformer-based acoustic models (AMs) for hybrid speech recognition. Several modeling choices are discussed in this work, including various positional embedding methods and an iterated loss to enable training deep transformers... (read more)

PDF Abstract

Code


No code implementations yet. Submit your code now

Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.

Methods used in the Paper