Search Results for author: Pengbo Hu

Found 3 papers, 2 papers with code

Boosting Multi-modal Model Performance with Adaptive Gradient Modulation

1 code implementation ICCV 2023 Hong Li, Xingyu Li, Pengbo Hu, Yinuo Lei, Chunxiao Li, Yi Zhou

In addition, we find that the jointly trained model typically has a preferred modality on which the competition is weaker than other modalities.

Attribute

SHAPE: An Unified Approach to Evaluate the Contribution and Cooperation of Individual Modalities

1 code implementation30 Apr 2022 Pengbo Hu, Xingyu Li, Yi Zhou

Our experiments suggest that for some tasks where different modalities are complementary, the multi-modal models still tend to use the dominant modality alone and ignore the cooperation across modalities.

Cannot find the paper you are looking for? You can Submit a new open access paper.