Search Results for author: Shreya Ghosh

Found 29 papers, 13 papers with code

Exploring Language Model Generalization in Low-Resource Extractive QA

1 code implementation27 Sep 2024 Saptarshi Sengupta, Wenpeng Yin, Preslav Nakov, Shreya Ghosh, Suhang Wang

In this paper, we investigate Extractive Question Answering (EQA) with Large Language Models (LLMs) under domain drift, i. e., can LLMs generalize to domains that require specific knowledge such as medicine and law in a zero-shot fashion without additional in-domain training?

Domain Generalization Extractive Question-Answering +3

MRAC Track 1: 2nd Workshop on Multimodal, Generative and Responsible Affective Computing

no code implementations11 Sep 2024 Shreya Ghosh, Zhixi Cai, Abhinav Dhall, Dimitrios Kollias, Roland Goecke, Tom Gedeon

With the rapid advancements in multimodal generative technology, Affective Computing research has provoked discussion about the potential consequences of AI systems equipped with emotional intelligence.

Emotional Intelligence

1M-Deepfakes Detection Challenge

1 code implementation11 Sep 2024 Zhixi Cai, Abhinav Dhall, Shreya Ghosh, Munawar Hayat, Dimitrios Kollias, Kalin Stefanov, Usman Tariq

The detection and localization of deepfake content, particularly when small fake segments are seamlessly mixed with real videos, remains a significant challenge in the field of digital media security.

DeepFake Detection Face Swapping

MIP-GAF: A MLLM-annotated Benchmark for Most Important Person Localization and Group Context Understanding

no code implementations10 Sep 2024 Surbhi Madan, Shreya Ghosh, Lownish Rai Sookha, M. A. Ganaie, Ramanathan Subramanian, Abhinav Dhall, Tom Gedeon

Estimating the Most Important Person (MIP) in any social event setup is a challenging problem mainly due to contextual complexity and scarcity of labeled data.

Benchmarking Language Modeling +3

7th ABAW Competition: Multi-Task Learning and Compound Expression Recognition

no code implementations4 Jul 2024 Dimitrios Kollias, Stefanos Zafeiriou, Irene Kotsia, Abhinav Dhall, Shreya Ghosh, Chunchang Shao, Guanyu Hu

s-Aff-Wild2, which is a static version of the A/V Aff-Wild2 database and contains annotations for valence-arousal, expressions and Action Units, is utilized for the purposes of the Multi-Task Learning Challenge; a part of C-EXPR-DB, which is an A/V in-the-wild database with compound expression annotations, is utilized for the purposes of the Compound Expression Recognition Challenge.

Multi-Task Learning

FunnelNet: An End-to-End Deep Learning Framework to Monitor Digital Heart Murmur in Real-Time

no code implementations10 May 2024 Md Jobayer, Md. Mehedi Hasan Shawon, Md Rakibul Hasan, Shreya Ghosh, Tom Gedeon, Md Zakir Hossain

Conclusion: The proposed model offers a deep learning framework for real-time accurate heart murmur detection within limited resources.

Milestones in Bengali Sentiment Analysis leveraging Transformer-models: Fundamentals, Challenges and Future Directions

no code implementations15 Jan 2024 Saptarshi Sengupta, Shreya Ghosh, Prasenjit Mitra, Tarikul Islam Tamiti

Sentiment Analysis (SA) refers to the task of associating a view polarity (usually, positive, negative, or neutral; or even fine-grained such as slightly angry, sad, etc.)

Sentiment Analysis

Improving Transferability of Network Intrusion Detection in a Federated Learning Setup

1 code implementation7 Jan 2024 Shreya Ghosh, Abu Shafin Mohammad Mahdee Jameel, Aly El Gamal

Network Intrusion Detection Systems (IDS) aim to detect the presence of an intruder by analyzing network packets arriving at an internet connected device.

Federated Learning Network Intrusion Detection

A Study on Transferability of Deep Learning Models for Network Intrusion Detection

1 code implementation17 Dec 2023 Shreya Ghosh, Abu Shafin Mohammad Mahdee Jameel, Aly El Gamal

In this paper, we explore transferability in learning between different attack classes in a network intrusion detection setup.

Data Augmentation Network Intrusion Detection

AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Dataset

1 code implementation26 Nov 2023 Zhixi Cai, Shreya Ghosh, Aman Pankaj Adatia, Munawar Hayat, Abhinav Dhall, Tom Gedeon, Kalin Stefanov

The comprehensive benchmark of the proposed dataset utilizing state-of-the-art deepfake detection and localization methods indicates a significant drop in performance compared to previous datasets.

2k DeepFake Detection +2

Analysis of Elephant Movement in Sub-Saharan Africa: Ecological, Climatic, and Conservation Perspectives

no code implementations21 Jul 2023 Matthew Hines, Gregory Glatzer, Shreya Ghosh, Prasenjit Mitra

The interaction between elephants and their environment has profound implications for both ecology and conservation strategies.

Management

Spatio-temporal Storytelling? Leveraging Generative Models for Semantic Trajectory Analysis

no code implementations24 Jun 2023 Shreya Ghosh, Saptarshi Sengupta, Prasenjit Mitra

In this paper, we lay out a vision for analysing semantic trajectory traces and generating synthetic semantic trajectory data (SSTs) using generative language model.

Language Modeling Language Modelling

Lumos in the Night Sky: AI-enabled Visual Tool for Exploring Night-Time Light Patterns

no code implementations5 Jun 2023 Jakob Hederich, Shreya Ghosh, Zeyu He, Prasenjit Mitra

We introduce NightPulse, an interactive tool for Night-time light (NTL) data visualization and analytics, which enables researchers and stakeholders to explore and analyze NTL data with a user-friendly platform.

Clustering Data Visualization +2

Glitch in the Matrix: A Large Scale Benchmark for Content Driven Audio-Visual Forgery Detection and Localization

1 code implementation3 May 2023 Zhixi Cai, Shreya Ghosh, Abhinav Dhall, Tom Gedeon, Kalin Stefanov, Munawar Hayat

The proposed baseline method, Boundary Aware Temporal Forgery Detection (BA-TFD), is a 3D Convolutional Neural Network-based architecture which effectively captures multimodal manipulations.

Binary Classification DeepFake Detection +2

MARLIN: Masked Autoencoder for facial video Representation LearnINg

1 code implementation CVPR 2023 Zhixi Cai, Shreya Ghosh, Kalin Stefanov, Abhinav Dhall, Jianfei Cai, Hamid Rezatofighi, Reza Haffari, Munawar Hayat

This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Attribute Recognition (FAR), Facial Expression Recognition (FER), DeepFake Detection (DFD), and Lip Synchronization (LS).

Action Classification Attribute +9

RAZE: Region Guided Self-Supervised Gaze Representation Learning

no code implementations4 Aug 2022 Neeru Dubey, Shreya Ghosh, Abhinav Dhall

Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction.

Gaze Estimation Representation Learning +1

'Labelling the Gaps': A Weakly Supervised Automatic Eye Gaze Estimation

1 code implementation3 Aug 2022 Shreya Ghosh, Abhinav Dhall, Jarrod Knibbe, Munawar Hayat

Our proposed method reduces the annotation effort to as low as 2. 67%, with minimal impact on performance; indicating the potential of our model enabling gaze estimation 'in-the-wild' setup.

Gaze Estimation

AV-Gaze: A Study on the Effectiveness of Audio Guided Visual Attention Estimation for Non-Profilic Faces

1 code implementation7 Jul 2022 Shreya Ghosh, Abhinav Dhall, Munawar Hayat, Jarrod Knibbe

In challenging real-life conditions such as extreme head-pose, occlusions, and low-resolution images where the visual information fails to estimate visual attention/gaze direction, audio signals could provide important and complementary information.

MTGLS: Multi-Task Gaze Estimation with Limited Supervision

no code implementations23 Oct 2021 Shreya Ghosh, Munawar Hayat, Abhinav Dhall, Jarrod Knibbe

Our proposed framework outperforms the unsupervised state-of-the-art on CAVE (by 6. 43%) and even supervised state-of-the-art methods on Gaze360 (by 6. 59%) datasets.

Gaze Estimation

Automatic Gaze Analysis: A Survey of Deep Learning based Approaches

1 code implementation12 Aug 2021 Shreya Ghosh, Abhinav Dhall, Munawar Hayat, Jarrod Knibbe, Qiang Ji

Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction.

Deep Learning Gaze Estimation +1

STOPPAGE: Spatio-temporal Data Driven Cloud-Fog-Edge Computing Framework for Pandemic Monitoring and Management

no code implementations4 Apr 2021 Shreya Ghosh, Anwesha Mukherjee, Soumya K Ghosh, Rajkumar Buyya

Several researches and evidence show the increasing likelihood of pandemics (large-scale outbreaks of infectious disease) which has far reaching sequels in all aspects of human lives ranging from rapid mortality rates to economic and social disruption across the world.

Edge-computing Management

Nanoscale spin detection of copper ions using double electron-electron resonance at room temperature

no code implementations7 Jan 2021 Kai Zhang, Shreya Ghosh, Sunil Saxena, M. V. Gurudev Dutt

We report the nanoscale spin detection and electron paramagnetic resonance (EPR) spectrum of copper (Cu$^{2+}$) ions via double electron-electron resonance with single spins in diamond at room temperature and low magnetic fields.

Quantum Physics Mesoscale and Nanoscale Physics

Low-Power Object Counting with Hierarchical Neural Networks

no code implementations2 Jul 2020 Abhinav Goel, Caleb Tung, Sara Aghajanzadeh, Isha Ghodgaonkar, Shreya Ghosh, George K. Thiruvathukal, Yung-Hsiang Lu

Object counting takes two inputs: an image and an object query and reports the number of occurrences of the queried object.

Object Object Counting +1

Speak2Label: Using Domain Knowledge for Creating a Large Scale Driver Gaze Zone Estimation Dataset

no code implementations13 Apr 2020 Shreya Ghosh, Abhinav Dhall, Garima Sharma, Sarthak Gupta, Nicu Sebe

In this paper, a fully automatic technique for labelling an image based gaze behavior dataset for driver gaze zone estimation is proposed.

Gaze Prediction

Predicting Group Cohesiveness in Images

no code implementations31 Dec 2018 Shreya Ghosh, Abhinav Dhall, Nicu Sebe, Tom Gedeon

We study the factors that influence the perception of group-level cohesion and propose methods for estimating the human-perceived cohesion on the group cohesiveness scale.

Attribute

Cannot find the paper you are looking for? You can Submit a new open access paper.