1 code implementation • EMNLP 2021 • Pengfei Yu, Heng Ji, Prem Natarajan
We focus on lifelong event detection as an exemplar case and propose a new problem formulation that is also generalizable to other IE tasks.
1 code implementation • 26 May 2023 • I-Hung Hsu, Zhiyu Xie, Kuan-Hao Huang, Prem Natarajan, Nanyun Peng
However, existing generation-based EAE models mostly focus on problem re-formulation and prompt design, without incorporating additional information that has been shown to be effective for classification-based models, such as the abstract meaning representation (AMR) of the input passages.
1 code implementation • 2 Mar 2023 • Qiaozi Gao, Govind Thattai, Xiaofeng Gao, Suhaila Shakiah, Shreyas Pansare, Vasu Sharma, Gaurav Sukhatme, Hangjie Shi, Bofei Yang, Desheng Zheng, Lucy Hu, Karthika Arumugam, Shui Hu, Matthew Wen, Dinakar Guthy, Cadence Chung, Rohan Khanna, Osman Ipek, Leslie Ball, Kate Bland, Heather Rocker, Yadunandana Rao, Michael Johnston, Reza Ghanadan, Arindam Mandal, Dilek Hakkani Tur, Prem Natarajan
We introduce Alexa Arena, a user-centric simulation platform for Embodied AI (EAI) research.
1 code implementation • 2 Aug 2022 • Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, Rahul Gupta, Wael Hamza, Haidar Khan, Charith Peris, Stephen Rawls, Andy Rosenbaum, Anna Rumshisky, Chandana Satya Prakash, Mukund Sridhar, Fabian Triefenbach, Apurv Verma, Gokhan Tur, Prem Natarajan
In this work, we demonstrate that multilingual large-scale sequence-to-sequence (seq2seq) models, pre-trained on a mixture of denoising and Causal Language Modeling (CLM) tasks, are more efficient few-shot learners than decoder-only models on various tasks.
Ranked #8 on
Natural Language Inference
on CommitmentBank
no code implementations • 19 Jul 2022 • Ekraam Sabir, Soumyaroop Nandi, Wael AbdAlmageed, Prem Natarajan
Manipulation of biomedical images to misrepresent experimental results has plagued the biomedical community for a while.
no code implementations • 15 Jun 2022 • Jack FitzGerald, Shankar Ananthakrishnan, Konstantine Arkoudas, Davide Bernardi, Abhishek Bhagia, Claudio Delli Bovi, Jin Cao, Rakesh Chada, Amit Chauhan, Luoxin Chen, Anurag Dwarakanath, Satyam Dwivedi, Turan Gojayev, Karthik Gopalakrishnan, Thomas Gueudre, Dilek Hakkani-Tur, Wael Hamza, Jonathan Hueser, Kevin Martin Jose, Haidar Khan, Beiye Liu, Jianhua Lu, Alessandro Manzotti, Pradeep Natarajan, Karolina Owczarzak, Gokmen Oz, Enrico Palumbo, Charith Peris, Chandana Satya Prakash, Stephen Rawls, Andy Rosenbaum, Anjali Shenoy, Saleh Soltan, Mukund Harakere Sridhar, Liz Tan, Fabian Triefenbach, Pan Wei, Haiyang Yu, Shuai Zheng, Gokhan Tur, Prem Natarajan
We present results from a large-scale experiment on pretraining encoders with non-embedding parameter counts ranging from 700M to 9. 3B, their subsequent distillation into smaller models ranging from 17M-170M parameters, and their application to the Natural Language Understanding (NLU) component of a virtual assistant system.
Cross-Lingual Natural Language Inference
intent-classification
+5
4 code implementations • 18 Apr 2022 • Jack FitzGerald, Christopher Hench, Charith Peris, Scott Mackie, Kay Rottmann, Ana Sanchez, Aaron Nash, Liam Urbach, Vishesh Kakarala, Richa Singh, Swetha Ranganath, Laurie Crist, Misha Britan, Wouter Leeuwis, Gokhan Tur, Prem Natarajan
We present the MASSIVE dataset--Multilingual Amazon Slu resource package (SLURP) for Slot-filling, Intent classification, and Virtual assistant Evaluation.
Ranked #1 on
Slot Filling
on MASSIVE
no code implementations • 14 Jan 2022 • Feng Gao, Qing Ping, Govind Thattai, Aishwarya Reganti, Ying Nian Wu, Prem Natarajan
Outside-knowledge visual question answering (OK-VQA) requires the agent to comprehend the image, make use of relevant knowledge from the entire web, and digest all the information to answer the question.
no code implementations • CVPR 2022 • Feng Gao, Qing Ping, Govind Thattai, Aishwarya Reganti, Ying Nian Wu, Prem Natarajan
Most previous works address the problem by first fusing the image and question in the multi-modal space, which is inflexible for further fusion with a vast amount of external knowledge.
Ranked #9 on
Visual Question Answering (VQA)
on OK-VQA
1 code implementation • ICCV 2021 • Ekraam Sabir, Soumyaroop Nandi, Wael AbdAlmageed, Prem Natarajan
Our results and analysis show that existing algorithms developed on common computer vision datasets are not robust when applied to biomedical images, validating that more research is required to address the unique challenges of biomedical image forensics.
1 code implementation • NAACL 2022 • I-Hung Hsu, Kuan-Hao Huang, Elizabeth Boschee, Scott Miller, Prem Natarajan, Kai-Wei Chang, Nanyun Peng
Given a passage and a manually designed prompt, DEGREE learns to summarize the events mentioned in the passage into a natural sentence that follows a predefined pattern.
no code implementations • ICCV 2021 • Jiaxin Cheng, Soumyaroop Nandi, Prem Natarajan, Wael Abd-Almageed
Unlike conventional zero-shot classification, zero-shot semantic segmentation predicts a class label at the pixel level instead of the image level.
no code implementations • NAACL 2021 • Emily Sheng, Kai-Wei Chang, Prem Natarajan, Nanyun Peng
Ad hominem attacks are those that target some feature of a person{'}s character instead of the position the person is maintaining.
1 code implementation • CVPR 2021 • Tao Tu, Qing Ping, Govind Thattai, Gokhan Tur, Prem Natarajan
Most existing work for Guesser encode the dialog history as a whole and train the Guesser models from scratch on the GuessWhat?!
1 code implementation • CVPR 2021 • Jiaxin Cheng, Ayush Jaiswal, Yue Wu, Pradeep Natarajan, Prem Natarajan
Neural Style Transfer (NST) has quickly evolved from single-style to infinite-style models, also known as Arbitrary Style Transfer (AST).
no code implementations • 23 Nov 2020 • Ekraam Sabir, Ayush Jaiswal, Wael AbdAlmageed, Prem Natarajan
The problem setup requires algorithms to perform multimodal semantic forensics to authenticate a query multimedia package using a reference dataset of potentially related packages as evidences.
1 code implementation • 2 May 2019 • Ekraam Sabir, Jiaxin Cheng, Ayush Jaiswal, Wael Abd-Almageed, Iacopo Masi, Prem Natarajan
The spread of misinformation through synthetically generated yet realistic images and videos has become a significant problem, calling for robust manipulation detection methods.
no code implementations • 18 Nov 2018 • Jiaxin Cheng, Yue Wu, Wael Abd-Almageed, Prem Natarajan
The image-to-GPS verification problem asks whether a given image is taken at a claimed GPS location.
no code implementations • 11 Oct 2018 • Dhruva Kartik, Ekraam Sabir, Urbashi Mitra, Prem Natarajan
Deep learning can be used as a tool for designing better heuristics in such problems.
1 code implementation • 22 Sep 2018 • Emily Sheng, Prem Natarajan
In biomedical literature, it is common for entity boundaries to not align with word boundaries.
1 code implementation • ECCV 2018 • Yue Wu, Wael Abd-Almageed, Prem Natarajan
We introduce a novel deep neural architecture for image copy-move forgery detection (CMFD), code-named BusterNet.
1 code implementation • 20 Aug 2018 • Ekraam Sabir, Wael Abd-Almageed, Yue Wu, Prem Natarajan
Nefarious actors on social media and other platforms often spread rumors and falsehoods through images whose metadata (e. g., captions) have been modified to provide visual substantiation of the rumor/falsehood.
1 code implementation • 29 May 2018 • Kuan Liu, Yanen Li, Ning Xu, Prem Natarajan
Combining complementary information from multiple modalities is intuitively appealing for improving the performance of learning-based approaches.
no code implementations • 28 May 2018 • Kuan Liu, Xing Shi, Prem Natarajan
Our ablation experiments demonstrate the effectiveness of the two components to address heterogeneous attribute challenges including variable lengths and attribute sparseness.
1 code implementation • 23 May 2018 • Ekraam Sabir, Stephen Rawls, Prem Natarajan
Neural networks have become the technique of choice for OCR, but many aspects of how and why they deliver superior performance are still unknown.
no code implementations • 10 Nov 2017 • Kuan Liu, Prem Natarajan
We propose a new learning to rank algorithm, named Weighted Margin-Rank Batch loss (WMRB), to extend the popular Weighted Approximate-Rank Pairwise loss (WARP).
1 code implementation • 10 Nov 2017 • Kuan Liu, Prem Natarajan
In designing personalized ranking algorithms, it is desirable to encourage a high precision at the top of the ranked list.
2 code implementations • ICCV 2017 • Yue Wu, Prem Natarajan
In this paper we propose a new solution to the text detection problem via border learning.
no code implementations • WS 2017 • Emily Sheng, Prem Natarajan, Jonathan Gordon, Gully Burns
We refer to this learning utility as the "pedagogical value" of the document to the learner.
no code implementations • 27 May 2017 • Yue Wu, Wael Abd-Almageed, Prem Natarajan
Here the task is to estimate the probability that the donor image has been used to splice the query image, and obtain the splicing masks for both the query and donor images.
1 code implementation • 11 Aug 2016 • Kuan Liu, Xing Shi, Anoop Kumar, Linhong Zhu, Prem Natarajan
We present our solution to the job recommendation task for RecSys Challenge 2016.
no code implementations • 6 Jul 2016 • Tal Hassner, Iacopo Masi, Jungyeon Kim, Jongmoo Choi, Shai Harel, Prem Natarajan, Gerard Medioni
We propose a novel approach to template based face recognition.
no code implementations • CVPR 2016 • Iacopo Masi, Stephen Rawls, Gerard Medioni, Prem Natarajan
We propose a method to push the frontiers of unconstrained face recognition in the wild, focusing on the problem of extreme pose variations.
no code implementations • 23 Mar 2016 • Wael Abd-Almageed, Yue Wua, Stephen Rawlsa, Shai Harel, Tal Hassner, Iacopo Masi, Jongmoo Choi, Jatuporn Toy Leksut, Jungyeon Kim, Prem Natarajan, Ram Nevatia, Gerard Medioni
In our representation, a face image is processed by several pose-specific deep convolutional neural network (CNN) models to generate multiple pose-specific features.
Ranked #14 on
Face Verification
on IJB-A
no code implementations • 12 Nov 2015 • Yue Wu, Tal Hassner, KangGeon Kim, Gerard Medioni, Prem Natarajan
We present a novel convolutional neural network (CNN) design for facial landmark coordinate regression.