Search Results for author: Gaurav Verma

Found 22 papers, 6 papers with code

Mysterious Projections: Multimodal LLMs Gain Domain-Specific Visual Capabilities Without Richer Cross-Modal Projections

no code implementations26 Feb 2024 Gaurav Verma, MinJe Choi, Kartik Sharma, Jamelle Watson-Daniels, Sejoon Oh, Srijan Kumar

It is desirable to understand the roles of these two modules in modeling domain-specific visual attributes to inform the design of future models and streamline the interpretability efforts on the current models.

Language Modelling Large Language Model

MM-Soc: Benchmarking Multimodal Large Language Models in Social Media Platforms

no code implementations21 Feb 2024 Yiqiao Jin, MinJe Choi, Gaurav Verma, Jindong Wang, Srijan Kumar

Social media platforms are hubs for multimodal information exchange, encompassing text, images, and videos, making it challenging for machines to comprehend the information or emotions associated with interactions in online spaces.

Benchmarking Hate Speech Detection +1

Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries

1 code implementation19 Oct 2023 Yiqiao Jin, Mohit Chandra, Gaurav Verma, Yibo Hu, Munmun De Choudhury, Srijan Kumar

Our findings underscore the pressing need to bolster the cross-lingual capacities of these models, and to provide an equitable information ecosystem accessible to all.

Cross-Modal Attribute Insertions for Assessing the Robustness of Vision-and-Language Learning

1 code implementation19 Jun 2023 Shivaen Ramshetty, Gaurav Verma, Srijan Kumar

The robustness of multimodal deep learning models to realistic changes in the input text is critical for their applicability to important tasks such as text-to-image retrieval and cross-modal entailment.

Attribute Image Retrieval +2

Adversarial Robustness of Prompt-based Few-Shot Learning for Natural Language Understanding

1 code implementation19 Jun 2023 Venkata Prabhakara Sarath Nookala, Gaurav Verma, Subhabrata Mukherjee, Srijan Kumar

Our results on six GLUE tasks indicate that compared to fully fine-tuned models, vanilla FSL methods lead to a notable relative drop in task performance (i. e., are less robust) in the face of adversarial perturbations.

Adversarial Robustness Few-Shot Learning +1

Large-Scale Text Analysis Using Generative Language Models: A Case Study in Discovering Public Value Expressions in AI Patents

no code implementations17 May 2023 Sergio Pelaez, Gaurav Verma, Barbara Ribeiro, Philip Shapira

We discuss the implications of our approach for conducting large-scale text analyses with complex and abstract concepts and suggest that, with careful framework design and interactive human oversight, generative language models can offer significant advantages in quality and in reduced time and costs for producing labels and rationales.

Language Modelling text-classification +1

Transfer Learning Across Heterogeneous Features For Efficient Tensor Program Generation

1 code implementation11 Apr 2023 Gaurav Verma, Siddhisanket Raskar, Zhen Xie, Abid M Malik, Murali Emani, Barbara Chapman

Tuning tensor program generation involves searching for various possible program transformation combinations for a given program on target hardware to optimize the tensor program execution.

Transfer Learning

Robustness of Fusion-based Multimodal Classifiers to Cross-Modal Content Dilutions

no code implementations4 Nov 2022 Gaurav Verma, Vishwa Vinay, Ryan A. Rossi, Srijan Kumar

Our work aims to highlight and encourage further research on the robustness of deep multimodal models to realistic variations, especially in human-facing societal applications.

Overcoming Language Disparity in Online Content Classification with Multimodal Learning

1 code implementation19 May 2022 Gaurav Verma, Rohit Mujumdar, Zijie J. Wang, Munmun De Choudhury, Srijan Kumar

Advances in Natural Language Processing (NLP) have revolutionized the way researchers and practitioners address crucial societal problems.

Emotion Recognition Text Detection

Minority Stress Experienced by LGBTQ Online Communities during the COVID-19 Pandemic

no code implementations19 May 2022 Yunhao Yuan, Gaurav Verma, Barbara Keller, Talayeh Aledavood

We find that anger words are strongly associated with minority stress during the COVID-19 pandemic.

Attribute

Characterizing, Detecting, and Predicting Online Ban Evasion

1 code implementation10 Feb 2022 Manoj Niverthi, Gaurav Verma, Srijan Kumar

We find that evasion child accounts demonstrate similarities with respect to their banned parent accounts on several behavioral axes - from similarity in usernames and edited pages to similarity in content added to the platform and its psycholinguistic attributes.

BeautifAI -- A Personalised Occasion-oriented Makeup Recommendation System

no code implementations13 Sep 2021 Kshitij Gulati, Gaurav Verma, Mukesh Mohania, Ashish Kundu

The proposed work's novel contributions, including the incorporation of occasion context, region-wise makeup recommendation, real-time makeup previews and continuous makeup feedback, set our system apart from the current work in makeup recommendation.

DRAG: Director-Generator Language Modelling Framework for Non-Parallel Author Stylized Rewriting

no code implementations EACL 2021 Hrituraj Singh, Gaurav Verma, Aparna Garimella, Balaji Vasan Srinivasan

In this paper, we propose a Director-Generator framework to rewrite content in the target author's style, specifically focusing on certain target attributes.

Denoising Language Modelling

Incorporating Stylistic Lexical Preferences in Generative Language Models

no code implementations Findings of the Association for Computational Linguistics 2020 Hrituraj Singh, Gaurav Verma, Balaji Vasan Srinivasan

While recent advances in language modeling have resulted in powerful generation models, their generation style remains implicitly dependent on the training data and can not emulate a specific target style.

Language Modelling Reinforcement Learning (RL)

"To Target or Not to Target": Identification and Analysis of Abusive Text Using Ensemble of Classifiers

no code implementations5 Jun 2020 Gaurav Verma, Niyati Chhaya, Vishwa Vinay

With rising concern around abusive and hateful behavior on social media platforms, we present an ensemble learning method to identify and analyze the linguistic properties of such content.

BIG-bench Machine Learning Ensemble Learning

Using Image Captions and Multitask Learning for Recommending Query Reformulations

no code implementations2 Mar 2020 Gaurav Verma, Vishwa Vinay, Sahil Bansal, Shashank Oberoi, Makkunda Sharma, Prakhar Gupta

Interactive search sessions often contain multiple queries, where the user submits a reformulated version of the previous query in response to the original results.

Descriptive Image Captioning +1

Adapting Language Models for Non-Parallel Author-Stylized Rewriting

no code implementations22 Sep 2019 Bakhtiyar Syed, Gaurav Verma, Balaji Vasan Srinivasan, Anandhavelu Natarajan, Vasudeva Varma

Given the recent progress in language modeling using Transformer-based neural models and an active interest in generating stylized text, we present an approach to leverage the generalization capabilities of a language model to rewrite an input text in a target author's style.

Denoising Language Modelling

A Lexical, Syntactic, and Semantic Perspective for Understanding Style in Text

no code implementations18 Sep 2019 Gaurav Verma, Balaji Vasan Srinivasan

With a growing interest in modeling inherent subjectivity in natural language, we present a linguistically-motivated process to understand and analyze the writing style of individuals from three perspectives: lexical, syntactic, and semantic.

Authorship Attribution

Learning Affective Correspondence between Music and Image

no code implementations30 Mar 2019 Gaurav Verma, Eeshan Gunesh Dhekane, Tanaya Guha

We introduce the problem of learning affective correspondence between audio (music) and visual data (images).

Binary Classification Emotion Recognition

Cannot find the paper you are looking for? You can Submit a new open access paper.