1 code implementation • 27 Sep 2024 • Saptarshi Sengupta, Wenpeng Yin, Preslav Nakov, Shreya Ghosh, Suhang Wang
In this paper, we investigate Extractive Question Answering (EQA) with Large Language Models (LLMs) under domain drift, i. e., can LLMs generalize to domains that require specific knowledge such as medicine and law in a zero-shot fashion without additional in-domain training?
no code implementations • 11 Sep 2024 • Shreya Ghosh, Zhixi Cai, Abhinav Dhall, Dimitrios Kollias, Roland Goecke, Tom Gedeon
With the rapid advancements in multimodal generative technology, Affective Computing research has provoked discussion about the potential consequences of AI systems equipped with emotional intelligence.
1 code implementation • 11 Sep 2024 • Zhixi Cai, Abhinav Dhall, Shreya Ghosh, Munawar Hayat, Dimitrios Kollias, Kalin Stefanov, Usman Tariq
The detection and localization of deepfake content, particularly when small fake segments are seamlessly mixed with real videos, remains a significant challenge in the field of digital media security.
no code implementations • 10 Sep 2024 • Surbhi Madan, Shreya Ghosh, Lownish Rai Sookha, M. A. Ganaie, Ramanathan Subramanian, Abhinav Dhall, Tom Gedeon
Estimating the Most Important Person (MIP) in any social event setup is a challenging problem mainly due to contextual complexity and scarcity of labeled data.
no code implementations • 4 Jul 2024 • Dimitrios Kollias, Stefanos Zafeiriou, Irene Kotsia, Abhinav Dhall, Shreya Ghosh, Chunchang Shao, Guanyu Hu
s-Aff-Wild2, which is a static version of the A/V Aff-Wild2 database and contains annotations for valence-arousal, expressions and Action Units, is utilized for the purposes of the Multi-Task Learning Challenge; a part of C-EXPR-DB, which is an A/V in-the-wild database with compound expression annotations, is utilized for the purposes of the Compound Expression Recognition Challenge.
no code implementations • 10 May 2024 • Md Jobayer, Md. Mehedi Hasan Shawon, Md Rakibul Hasan, Shreya Ghosh, Tom Gedeon, Md Zakir Hossain
Conclusion: The proposed model offers a deep learning framework for real-time accurate heart murmur detection within limited resources.
no code implementations • 15 Jan 2024 • Saptarshi Sengupta, Shreya Ghosh, Prasenjit Mitra, Tarikul Islam Tamiti
Sentiment Analysis (SA) refers to the task of associating a view polarity (usually, positive, negative, or neutral; or even fine-grained such as slightly angry, sad, etc.)
1 code implementation • 7 Jan 2024 • Shreya Ghosh, Abu Shafin Mohammad Mahdee Jameel, Aly El Gamal
Network Intrusion Detection Systems (IDS) aim to detect the presence of an intruder by analyzing network packets arriving at an internet connected device.
1 code implementation • 17 Dec 2023 • Shreya Ghosh, Abu Shafin Mohammad Mahdee Jameel, Aly El Gamal
In this paper, we explore transferability in learning between different attack classes in a network intrusion detection setup.
1 code implementation • 26 Nov 2023 • Zhixi Cai, Shreya Ghosh, Aman Pankaj Adatia, Munawar Hayat, Abhinav Dhall, Tom Gedeon, Kalin Stefanov
The comprehensive benchmark of the proposed dataset utilizing state-of-the-art deepfake detection and localization methods indicates a significant drop in performance compared to previous datasets.
no code implementations • 30 Oct 2023 • Md Rakibul Hasan, Md Zakir Hossain, Shreya Ghosh, Aneesh Krishna, Tom Gedeon
Empathy indicates an individual's ability to understand others.
1 code implementation • 25 Oct 2023 • Saptarshi Sengupta, Connor Heaton, Shreya Ghosh, Wenpeng Yin, Preslav Nakov, Suhang Wang
We study extractive question-answering in the medical domain (Medical-EQA).
no code implementations • 21 Jul 2023 • Matthew Hines, Gregory Glatzer, Shreya Ghosh, Prasenjit Mitra
The interaction between elephants and their environment has profound implications for both ecology and conservation strategies.
no code implementations • 24 Jun 2023 • Shreya Ghosh, Saptarshi Sengupta, Prasenjit Mitra
In this paper, we lay out a vision for analysing semantic trajectory traces and generating synthetic semantic trajectory data (SSTs) using generative language model.
no code implementations • 5 Jun 2023 • Jakob Hederich, Shreya Ghosh, Zeyu He, Prasenjit Mitra
We introduce NightPulse, an interactive tool for Night-time light (NTL) data visualization and analytics, which enables researchers and stakeholders to explore and analyze NTL data with a user-friendly platform.
1 code implementation • 10 May 2023 • Md Rakibul Hasan, Shreya Ghosh, Pradyumna Agrawal, Zhixi Cai, Abhinav Dhall, Tom Gedeon
This paper proposes a feedback mechanism to change behavioural patterns using the Pavlok device.
1 code implementation • 3 May 2023 • Zhixi Cai, Shreya Ghosh, Abhinav Dhall, Tom Gedeon, Kalin Stefanov, Munawar Hayat
The proposed baseline method, Boundary Aware Temporal Forgery Detection (BA-TFD), is a 3D Convolutional Neural Network-based architecture which effectively captures multimodal manipulations.
Ranked #1 on
Temporal Forgery Localization
on ForgeryNet
1 code implementation • CVPR 2023 • Zhixi Cai, Shreya Ghosh, Kalin Stefanov, Abhinav Dhall, Jianfei Cai, Hamid Rezatofighi, Reza Haffari, Munawar Hayat
This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Attribute Recognition (FAR), Facial Expression Recognition (FER), DeepFake Detection (DFD), and Lip Synchronization (LS).
Ranked #1 on
Emotion Classification
on CMU-MOSEI
no code implementations • 4 Aug 2022 • Neeru Dubey, Shreya Ghosh, Abhinav Dhall
Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction.
1 code implementation • 3 Aug 2022 • Shreya Ghosh, Abhinav Dhall, Jarrod Knibbe, Munawar Hayat
Our proposed method reduces the annotation effort to as low as 2. 67%, with minimal impact on performance; indicating the potential of our model enabling gaze estimation 'in-the-wild' setup.
1 code implementation • 7 Jul 2022 • Shreya Ghosh, Abhinav Dhall, Munawar Hayat, Jarrod Knibbe
In challenging real-life conditions such as extreme head-pose, occlusions, and low-resolution images where the visual information fails to estimate visual attention/gaze direction, audio signals could provide important and complementary information.
no code implementations • 23 Oct 2021 • Shreya Ghosh, Munawar Hayat, Abhinav Dhall, Jarrod Knibbe
Our proposed framework outperforms the unsupervised state-of-the-art on CAVE (by 6. 43%) and even supervised state-of-the-art methods on Gaze360 (by 6. 59%) datasets.
1 code implementation • 12 Aug 2021 • Shreya Ghosh, Abhinav Dhall, Munawar Hayat, Jarrod Knibbe, Qiang Ji
Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction.
no code implementations • 4 Apr 2021 • Shreya Ghosh, Anwesha Mukherjee, Soumya K Ghosh, Rajkumar Buyya
Several researches and evidence show the increasing likelihood of pandemics (large-scale outbreaks of infectious disease) which has far reaching sequels in all aspects of human lives ranging from rapid mortality rates to economic and social disruption across the world.
no code implementations • 7 Jan 2021 • Kai Zhang, Shreya Ghosh, Sunil Saxena, M. V. Gurudev Dutt
We report the nanoscale spin detection and electron paramagnetic resonance (EPR) spectrum of copper (Cu$^{2+}$) ions via double electron-electron resonance with single spins in diamond at room temperature and low magnetic fields.
Quantum Physics Mesoscale and Nanoscale Physics
no code implementations • 2 Jul 2020 • Abhinav Goel, Caleb Tung, Sara Aghajanzadeh, Isha Ghodgaonkar, Shreya Ghosh, George K. Thiruvathukal, Yung-Hsiang Lu
Object counting takes two inputs: an image and an object query and reports the number of occurrences of the queried object.
no code implementations • 13 Apr 2020 • Shreya Ghosh, Abhinav Dhall, Garima Sharma, Sarthak Gupta, Nicu Sebe
In this paper, a fully automatic technique for labelling an image based gaze behavior dataset for driver gaze zone estimation is proposed.
1 code implementation • 4 Apr 2019 • Neeru Dubey, Shreya Ghosh, Abhinav Dhall
Automatic eye gaze estimation has interested researchers for a while now.
no code implementations • 31 Dec 2018 • Shreya Ghosh, Abhinav Dhall, Nicu Sebe, Tom Gedeon
We study the factors that influence the perception of group-level cohesion and propose methods for estimating the human-perceived cohesion on the group cohesiveness scale.