Perception Matters: Detecting Perception Failures of VQA Models Using Metamorphic Testing

1 code implementation • CVPR 2021 • Yuanyuan Yuan, Shuai Wang, Mingyue Jiang, Tsong Yueh Chen

MetaVQA checks whether the answer to (i, q) satisfies metamorphic relationships (MRs), denoting perception consistency, with the composed answers of transformed questions and images.

Benchmarking DNN Testing +2