Supervised Visual Attention for Multimodal Neural Machine Translation

no code implementations • COLING 2020 • Tetsuro Nishihara, Akihiro Tamura, Takashi Ninomiya, Yutaro Omote, Hideki Nakayama

This paper proposed a supervised visual attention mechanism for multimodal neural machine translation (MNMT), trained with constraints based on manual alignments between words in a sentence and their corresponding regions of an image.

Machine Translation Sentence +1