Search Results for author: Hayley Hung

Found 15 papers, 3 papers with code

REWIND Dataset: Privacy-preserving Speaking Status Segmentation from Multimodal Body Movement Signals in the Wild

no code implementations2 Mar 2024 Jose Vargas Quiros, Chirag Raman, Stephanie Tan, Ekin Gedik, Laura Cabrera-Quiros, Hayley Hung

In addition to providing the signals and ground truth necessary to evaluate a wide range of speaking status detection methods, the availability of audio in REWIND makes it suitable for cross-modality studies not feasible with previous mingling datasets.

Privacy Preserving

Impact of annotation modality on label quality and model performance in the automatic assessment of laughter in-the-wild

no code implementations2 Nov 2022 Jose Vargas-Quiros, Laura Cabrera-Quiros, Catharine Oertel, Hayley Hung

Models with video and acceleration inputs had similar performance regardless of training label modality, suggesting that it may be entirely appropriate to train models for laughter detection from body movements using video-acquired labels, despite their lower inter-rater agreement.

Conversation Group Detection With Spatio-Temporal Context

no code implementations2 Jun 2022 Stephanie Tan, David M. J. Tax, Hayley Hung

These affinity values are also continuous in time, since relationships and group membership do not occur instantaneously, even though the ground truths of group membership are binary.

Graph Clustering

Why Did This Model Forecast This Future? Closed-Form Temporal Saliency Towards Causal Explanations of Probabilistic Forecasts

no code implementations1 Jun 2022 Chirag Raman, Hayley Hung, Marco Loog

In this work, we introduce and address the following question: given a probabilistic forecasting model how can we identify observed windows that the model considers salient when making its forecasts?

Attribute valid

ConfLab: A Data Collection Concept, Dataset, and Benchmark for Machine Analysis of Free-Standing Social Interactions in the Wild

1 code implementation10 May 2022 Chirag Raman, Jose Vargas-Quiros, Stephanie Tan, Ashraful Islam, Ekin Gedik, Hayley Hung

Recording the dynamics of unscripted human interactions in the wild is challenging due to the delicate trade-offs between several factors: participant privacy, ecological validity, data fidelity, and logistical overheads.

Privacy Preserving

Social Processes: Self-Supervised Meta-Learning over Conversational Groups for Forecasting Nonverbal Social Cues

1 code implementation NeurIPS 2021 Chirag Raman, Hayley Hung, Marco Loog

In this way, an SP model learns to adapt its forecasts to the unique dynamics of the interacting partners, generalizing to unseen groups in a data-efficient manner.

Social Cue Forecasting

A Blast From the Past: Personalizing Predictions of Video-Induced Emotions using Personal Memories as Context

no code implementations27 Aug 2020 Bernd Dudzik, Joost Broekens, Mark Neerincx, Hayley Hung

A key challenge in the accurate prediction of viewers' emotional responses to video stimuli in real-world applications is accounting for person- and situation-specific variation.

A Modular Approach for Synchronized Wireless Multimodal Multisensor Data Acquisition in Highly Dynamic Social Settings

no code implementations9 Aug 2020 Chirag Raman, Stephanie Tan, Hayley Hung

In this work, we propose a modular and cost-effective wireless approach for synchronized multisensor data acquisition of social human behavior.

Detecting F-formations & Roles in Crowded Social Scenes with Wearables: Combining Proxemics & Dynamics using LSTMs

no code implementations17 Nov 2019 Alessio Rosatelli, Ekin Gedik, Hayley Hung

In this paper, we investigate the use of proxemics and dynamics for automatically identifying conversing groups, or so-called F-formations.

Descriptive

Towards automatic estimation of conversation floors within F-formations

no code implementations19 Jul 2019 Chirag Raman, Hayley Hung

We motivate a metric for the existence of distinct conversation floors based on simultaneous speaker turns, and provide an analysis using this metric to characterize conversations across F-formations of varying cardinality.

Improving Temporal Interpolation of Head and Body Pose using Gaussian Process Regression in a Matrix Completion Setting

no code implementations6 Aug 2018 Stephanie Tan, Hayley Hung

As well as fitting a more flexible model to missing labels in time, we posit that our approach also loosens the head and body coupling constraint, allowing for a more expressive model of the head and body pose typically seen during conversational interaction in groups.

Matrix Completion Missing Labels +1

Beyond F-Formations: Determining Social Involvement in Free Standing Conversing Groups From Static Images

no code implementations CVPR 2016 Lu Zhang, Hayley Hung

In this paper, we present the first attempt to analyse differing levels of social involvement in free standing conversing groups (or the so-called F-formations) from static images.

Cannot find the paper you are looking for? You can Submit a new open access paper.