no code implementations • CONSTRAINT (ACL) 2022 • Shivam Sharma, Tharun Suresh, Atharva Kulkarni, Himanshi Mathur, Preslav Nakov, Md. Shad Akhtar, Tanmoy Chakraborty
We present the findings of the shared task at the CONSTRAINT 2022 Workshop: Hero, Villain, and Victim: Dissecting harmful memes for Semantic role labeling of entities.
1 code implementation • NAACL (DaSH) 2021 • Kayla Duskin, Shivam Sharma, Ji Young Yun, Emily Saldanha, Dustin Arendt
Current methods for evaluation of natural language generation models focus on measuring text quality but fail to probe the model creativity, i. e., its ability to generate novel but coherent text sequences not seen in the training corpus.
1 code implementation • BigScience (ACL) 2022 • Sameera Horawalavithana, Ellyn Ayton, Shivam Sharma, Scott Howland, Megha Subramanian, Scott Vasquez, Robin Cosbey, Maria Glenski, Svitlana Volkova
Foundation models pre-trained on large corpora demonstrate significant gains across many natural language processing tasks and domains e. g., law, healthcare, education, etc.
no code implementations • 10 Jul 2024 • Hung Phan, Anurag Acharya, Sarthak Chaturvedi, Shivam Sharma, Mike Parker, Dan Nally, Ali Jannesari, Karl Pazdernik, Mahantesh Halappanavar, Sai Munikoti, Sameera Horawalavithana
We compare the performance of the long context LLMs and RAG powered models in handling different types of questions (e. g., problem-solving, divergent).
no code implementations • 18 May 2024 • Siddhant Agarwal, Shivam Sharma, Preslav Nakov, Tanmoy Chakraborty
Memes have evolved as a prevalent medium for diverse communication, ranging from humour to propaganda.
no code implementations • 30 Jan 2024 • Ming Shan Hee, Shivam Sharma, Rui Cao, Palash Nandi, Tanmoy Chakraborty, Roy Ka-Wei Lee
In the evolving landscape of online communication, moderating hate speech (HS) presents an intricate challenge, compounded by the multimodal nature of digital content.
no code implementations • 8 Oct 2023 • Isabelle Augenstein, Timothy Baldwin, Meeyoung Cha, Tanmoy Chakraborty, Giovanni Luca Ciampaglia, David Corney, Renee DiResta, Emilio Ferrara, Scott Hale, Alon Halevy, Eduard Hovy, Heng Ji, Filippo Menczer, Ruben Miguez, Preslav Nakov, Dietram Scheufele, Shivam Sharma, Giovanni Zagni
The emergence of tools based on Large Language Models (LLMs), such as OpenAI's ChatGPT, Microsoft's Bing Chat, and Google's Bard, has garnered immense public attention.
no code implementations • 10 Sep 2023 • Shivam Sharma, Suvadeep Maiti, S. Mythirayee, Srijithesh Rajendran, Raju Surampudi Bapi
A distinctive aspect of this study is the adaptation of GradCam for sleep staging, marking the first instance of an explainable DL model in this domain with alignment of its decision-making with sleep expert's insights.
1 code implementation • 25 May 2023 • Shivam Sharma, Ramaneswaran S, Udit Arora, Md. Shad Akhtar, Tanmoy Chakraborty
In this work, we propose a novel task, MEMEX - given a meme and a related document, the aim is to mine the context that succinctly explains the background of the meme.
no code implementations • 26 Jan 2023 • Shivam Sharma, Atharva Kulkarni, Tharun Suresh, Himanshi Mathur, Preslav Nakov, Md. Shad Akhtar, Tanmoy Chakraborty
A common problem associated with meme comprehension lies in detecting the entities referenced and characterizing the role of each of these entities.
no code implementations • 28 Dec 2022 • Raj G. Patel, Chia-Wei Hsing, Serkan Sahin, Samuel Palmer, Saeed S. Jahromi, Shivam Sharma, Tomas Dominguez, Kris Tziritas, Christophe Michel, Vincent Porte, Mustafa Abid, Stephane Aubert, Pierre Castellani, Samuel Mugel, Roman Orus
Recent advances in deep learning have enabled us to address the curse of dimensionality (COD) by solving problems in higher dimensions.
1 code implementation • 1 Dec 2022 • Shivam Sharma, Siddhant Agarwal, Tharun Suresh, Preslav Nakov, Md. Shad Akhtar, Tanmoy Chakraborty
Here, we introduce a novel task - EXCLAIM, generating explanations for visual semantic role labeling in memes.
no code implementations • 29 Sep 2022 • Shivam Sharma, Mohd Khizir Siddiqui, Md. Shad Akhtar, Tanmoy Chakraborty
Existing self-supervised learning strategies are constrained to either a limited set of objectives or generic downstream tasks that predominantly target uni-modal applications.
no code implementations • 3 Aug 2022 • Raj Patel, Chia-Wei Hsing, Serkan Sahin, Saeed S. Jahromi, Samuel Palmer, Shivam Sharma, Christophe Michel, Vincent Porte, Mustafa Abid, Stephane Aubert, Pierre Castellani, Chi-Guhn Lee, Samuel Mugel, Roman Orus
We demonstrate that TNN provide significant parameter savings while attaining the same accuracy as compared to the classical Dense Neural Network (DNN).
1 code implementation • Findings (NAACL) 2022 • Shivam Sharma, Md. Shad Akhtar, Preslav Nakov, Tanmoy Chakraborty
Finally, we show that DISARM is interpretable and comparatively more generalizable and that it can reduce the relative error rate for harmful target identification by up to 9 points absolute over several strong multimodal rivals.
1 code implementation • 9 May 2022 • Shivam Sharma, Firoj Alam, Md. Shad Akhtar, Dimitar Dimitrov, Giovanni Da San Martino, Hamed Firooz, Alon Halevy, Fabrizio Silvestri, Preslav Nakov, Tanmoy Chakraborty
One interesting finding is that many types of harmful memes are not really studied, e. g., such featuring self-harm and extremism, partly due to the lack of suitable datasets.
1 code implementation • 14 Apr 2022 • Sameera Horawalavithana, Ellyn Ayton, Anastasiya Usenko, Shivam Sharma, Jasmine Eshun, Robin Cosbey, Maria Glenski, Svitlana Volkova
Machine learning models that learn from dynamic graphs face nontrivial challenges in learning and inference as both nodes and edges change over time.
no code implementations • Findings (ACL) 2021 • Shraman Pramanick, Dimitar Dimitrov, Rituparna Mukherjee, Shivam Sharma, Md. Shad Akhtar, Preslav Nakov, Tanmoy Chakraborty
In this work, we propose two novel problem formulations: detecting harmful memes and the social entities that these harmful memes target.
1 code implementation • Findings (EMNLP) 2021 • Shraman Pramanick, Shivam Sharma, Dimitar Dimitrov, Md Shad Akhtar, Preslav Nakov, Tanmoy Chakraborty
We focus on two tasks: (i)detecting harmful memes, and (ii)identifying the social entities they target.
2 code implementations • 6 Nov 2020 • Parth Patwa, Shivam Sharma, Srinivas PYKL, Vineeth Guptha, Gitanjali Kumari, Md Shad Akhtar, Asif Ekbal, Amitava Das, Tanmoy Chakraborty
This is further exacerbated at the time of a pandemic.
no code implementations • 21 Jan 2018 • Gaurav Bhatt, Shivam Sharma, Balasubramanian Raman
Further, we use the tensor parameters to introduce a 3-way interaction between question, answer and external features in vector space.
1 code implementation • 11 Dec 2017 • Gaurav Bhatt, Aman Sharma, Shivam Sharma, Ankush Nagpal, Balasubramanian Raman, Ankush Mittal
We present a novel idea that combines the neural, statistical and external features to provide an efficient solution to this problem.
Ranked #3 on Fake News Detection on FNC-1