Search Results for author: Vardaan Pahuja

Found 11 papers, 4 papers with code

Bringing Back the Context: Camera Trap Species Identification as Link Prediction on Multimodal Knowledge Graphs

no code implementations31 Dec 2023 Vardaan Pahuja, Weidi Luo, Yu Gu, Cheng-Hao Tu, Hong-You Chen, Tanya Berger-Wolf, Charles Stewart, Song Gao, Wei-Lun Chao, Yu Su

In this work, we leverage the structured context associated with the camera trap images to improve out-of-distribution generalization for the task of species identification in camera traps.

Knowledge Graphs Link Prediction +1

Diversifying Joint Vision-Language Tokenization Learning

no code implementations6 Jun 2023 Vardaan Pahuja, AJ Piergiovanni, Anelia Angelova

Building joint representations across images and text is an essential step for tasks such as Visual Question Answering and Video Question Answering.

Question Answering Representation Learning +2

A Retrieve-and-Read Framework for Knowledge Graph Link Prediction

1 code implementation19 Dec 2022 Vardaan Pahuja, Boshi Wang, Hugo Latapie, Jayanth Srinivasa, Yu Su

To address the limitations of existing KG link prediction frameworks, we propose a novel retrieve-and-read framework, which first retrieves a relevant subgraph context for the query and then jointly reasons over the context and the query with a high-capacity reader.

Knowledge Graph Completion Link Prediction

Knowledge Base Question Answering: A Semantic Parsing Perspective

no code implementations12 Sep 2022 Yu Gu, Vardaan Pahuja, Gong Cheng, Yu Su

In this survey, we situate KBQA in the broader literature of semantic parsing and give a comprehensive account of how existing KBQA approaches attempt to address the unique challenges.

Attribute Knowledge Base Question Answering +2

A Systematic Investigation of KB-Text Embedding Alignment at Scale

1 code implementation ACL 2021 Vardaan Pahuja, Yu Gu, Wenhu Chen, Mehdi Bahrami, Lei Liu, Wei-Peng Chen, Yu Su

Knowledge bases (KBs) and text often contain complementary knowledge: KBs store structured knowledge that can support long range reasoning, while text stores more comprehensive and timely knowledge in an unstructured way.

Link Prediction

Structure Learning for Neural Module Networks

no code implementations WS 2019 Vardaan Pahuja, Jie Fu, Sarath Chandar, Christopher J. Pal

In current formulations of such networks only the parameters of the neural modules and/or the order of their execution is learned.

Question Answering Visual Question Answering

Memory Augmented Self-Play

1 code implementation28 May 2018 Shagun Sodhani, Vardaan Pahuja

Self-play is an unsupervised training procedure which enables the reinforcement learning agents to explore the environment without requiring any external rewards.

reinforcement-learning Reinforcement Learning (RL)

Reproducibility Report for "Learning To Count Objects In Natural Images For Visual Question Answering"

no code implementations21 May 2018 Shagun Sodhani, Vardaan Pahuja

This is the reproducibility report for the paper "Learning To Count Objects In Natural Images For Visual QuestionAnswering"

Question Answering Visual Question Answering

Complex Sequential Question Answering: Towards Learning to Converse Over Linked Question Answer Pairs with a Knowledge Graph

1 code implementation31 Jan 2018 Amrita Saha, Vardaan Pahuja, Mitesh M. Khapra, Karthik Sankaranarayanan, Sarath Chandar

Further, unlike existing large scale QA datasets which contain simple questions that can be answered from a single tuple, the questions in our dialogs require a larger subgraph of the KG.

Knowledge Graphs Question Answering

Cannot find the paper you are looking for? You can Submit a new open access paper.