Search Results for author: Hanliang Jiang

Found 2 papers, 1 papers with code

Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-training

no code implementations13 May 2023 Ke Zhang, Yan Yang, Jun Yu, Hanliang Jiang, Jianping Fan, Qingming Huang, Weidong Han

To address this limitation, we propose a unified Med-VLP framework based on Multi-task Paired Masking with Alignment (MPMA) to integrate the cross-modal alignment task into the joint image-text reconstruction framework to achieve more comprehensive cross-modal interaction, while a Global and Local Alignment (GLA) module is designed to assist self-supervised paradigm in obtaining semantic representations with rich domain knowledge.

Cannot find the paper you are looking for? You can Submit a new open access paper.