1 code implementation • 22 Jun 2022 • Zhuofan Ying, Peter Hase, Mohit Bansal
In this paper, we show that model FI supervision can meaningfully improve VQA model accuracy as well as performance on several Right-for-the-Right-Reason (RRR) metrics by optimizing for four key model objectives: (1) accurate predictions given limited but sufficient information (Sufficiency); (2) max-entropy predictions given no important information (Uncertainty); (3) invariance of predictions to changes in unimportant features (Invariance); and (4) alignment between model FI explanations and human FI explanations (Plausibility).
1 code implementation • CVPR 2020 • Vincent Jacquot, Zhuofan Ying, Gabriel Kreiman
Deep Learning has driven recent and exciting progress in computer vision, instilling the belief that these algorithms could solve any visual task.