Search Results for author: Timothy Anderson

Found 6 papers, 0 papers with code

Detecting Concrete Visual Tokens for Multimodal Machine Translation

no code implementations5 Mar 2024 Braeden Bowen, Vipin Vijayan, Scott Grigsby, Timothy Anderson, Jeremy Gwinnup

The challenge of visual grounding and masking in multimodal machine translation (MMT) systems has encouraged varying approaches to the detection and selection of visually-grounded text tokens for masking.

Multimodal Machine Translation object-detection +3

Adding Multimodal Capabilities to a Text-only Translation Model

no code implementations5 Mar 2024 Vipin Vijayan, Braeden Bowen, Scott Grigsby, Timothy Anderson, Jeremy Gwinnup

While most current work in multimodal machine translation (MMT) uses the Multi30k dataset for training and evaluation, we find that the resulting models overfit to the Multi30k dataset to an extreme degree.

Multimodal Machine Translation Translation

The Case for Evaluating Multimodal Translation Models on Text Datasets

no code implementations5 Mar 2024 Vipin Vijayan, Braeden Bowen, Scott Grigsby, Timothy Anderson, Jeremy Gwinnup

Therefore, we propose that MMT models be evaluated using 1) the CoMMuTE evaluation framework, which measures the use of visual information by MMT models, 2) the text-only WMT news translation task test sets, which evaluates translation performance against complex sentences, and 3) the Multi30k test sets, for measuring MMT model performance against a real MMT dataset.

Descriptive Image Captioning +2

Cannot find the paper you are looking for? You can Submit a new open access paper.