no code implementations • 12 Jun 2015 • Harsh Agrawal, Clint Solomon Mathialagan, Yash Goyal, Neelima Chavali, Prakriti Banik, Akrit Mohapatra, Ahmed Osman, Dhruv Batra
We are witnessing a proliferation of massive visual data.
no code implementations • CVPR 2016 • Peng Zhang, Yash Goyal, Douglas Summers-Stay, Dhruv Batra, Devi Parikh
If the concept can be found in the image, the answer to the question is "yes", and otherwise "no".
no code implementations • EMNLP 2016 • Gordon Christie, Ankit Laddha, Aishwarya Agrawal, Stanislaw Antol, Yash Goyal, Kevin Kochersberger, Dhruv Batra
Our approach produces a diverse set of plausible hypotheses for both semantic segmentation and prepositional phrase attachment resolution that are then jointly reranked to select the most consistent pair.
no code implementations • 31 Aug 2016 • Yash Goyal, Akrit Mohapatra, Devi Parikh, Dhruv Batra
In this paper, we address the problem of interpreting Visual Question Answering (VQA) models.
7 code implementations • CVPR 2017 • Yash Goyal, Tejas Khot, Douglas Summers-Stay, Dhruv Batra, Devi Parikh
We propose to counter these language priors for the task of Visual Question Answering (VQA) and make vision (the V in VQA) matter!
1 code implementation • 16 Apr 2019 • Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, Stefan Lee
In this work, we develop a technique to produce counterfactual visual explanations.
no code implementations • 16 Jul 2019 • Yash Goyal, Amir Feder, Uri Shalit, Been Kim
To overcome this problem, we define the Causal Concept Effect (CaCE) as the causal effect of (the presence or absence of) a human-interpretable concept on a deep neural net's predictions.
no code implementations • 14 Nov 2019 • Jingjing Pan, Yash Goyal, Stefan Lee
While Visual Question Answering (VQA) models continue to push the state-of-the-art forward, they largely remain black-boxes - failing to provide insight into how or why an answer is generated.
no code implementations • 26 Jul 2020 • Aayush Surana, Yash Goyal, Manish Shrivastava, Suvi Saarikallio, Vinoo Alluri
Studies have shown musical engagement to be an indirect representation of internal states including internalized symptomatology and depression.
no code implementations • 28 Sep 2020 • Aayush Surana, Yash Goyal, Vinoo Alluri
Music, an integral part of our lives, which is not only a source of entertainment but plays an important role in mental well-being by impacting moods, emotions and other affective states.
1 code implementation • ACL 2022 • Benno Krojer, Vaibhav Adlakha, Vibhav Vineet, Yash Goyal, Edoardo Ponti, Siva Reddy
In particular, models are tasked with retrieving the correct image from a set of 10 minimally contrastive candidates based on a contextual description.
Ranked #1 on Image Retrieval on ImageCoDe
1 code implementation • 13 Oct 2022 • Oscar Mañas, Pau Rodriguez, Saba Ahmadi, Aida Nematzadeh, Yash Goyal, Aishwarya Agrawal
Large pre-trained models have proved to be remarkable zero- and (prompt-based) few-shot learners in unimodal vision and language tasks.