no code implementations • 13 Jan 2020 • Seth H. Huang, Xu Lingjie, Jiang Congwei
We present a novel architecture, residual attention net (RAN), which merges a sequence architecture, universal transformer, and a computer vision architecture, residual net, with a high-way architecture for cross-domain sequence modeling.