no code implementations • 29 Sep 2021 • Sethuraman Sankaran, David Yang, Ser-Nam Lim
Tasks that rely on multi-modal information typically include a fusion module that combines information from different modalities.
no code implementations • 8 Apr 2021 • Sethuraman Sankaran, David Yang, Ser-Nam Lim
In this work, we develop a Refiner Fusion Network (ReFNet) that enables fusion modules to combine strong unimodal representation with strong multimodal representations.