Search Results for author: Wim Pouw

Found 2 papers, 2 papers with code

Leveraging Speech for Gesture Detection in Multimodal Communication

1 code implementation23 Apr 2024 Esam Ghaleb, Ilya Burenko, Marlou Rasenberg, Wim Pouw, Ivan Toni, Peter Uhrig, Anna Wilson, Judith Holler, Aslı Özyürek, Raquel Fernández

Our findings indicate that expanding the speech buffer beyond visual time segments improves performance and that multimodal integration using cross-modal and early fusion techniques outperforms baseline methods using unimodal and late fusion methods.

Co-Speech Gesture Detection through Multi-Phase Sequence Labeling

1 code implementation21 Aug 2023 Esam Ghaleb, Ilya Burenko, Marlou Rasenberg, Wim Pouw, Peter Uhrig, Judith Holler, Ivan Toni, Aslı Özyürek, Raquel Fernández

Yet, the prevalent approach to automatic gesture detection treats the problem as binary classification, classifying a segment as either containing a gesture or not, thus failing to capture its inherently sequential and contextual nature.

Binary Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.