Multimodal Engagement Analysis from Facial Videos in the Classroom

no code implementations • 11 Jan 2021 • Ömer Sümer, Patricia Goldberg, Sidney D'Mello, Peter Gerjets, Ulrich Trautwein, Enkelejda Kasneci

To best examine student visual engagement in the classroom, we conducted a study utilizing the audiovisual recordings of classes at a secondary school over one and a half month's time, acquired continuous engagement labeling per student (N=15) in repeated sessions, and explored computer vision methods to classify engagement levels from faces in the classroom.

Facial Expression Recognition Facial Expression Recognition (FER) +1

Designing an Interactive Visualization System for Monitoring Participant Compliance in a Large-Scale, Longitudinal Study

no code implementations • 22 Dec 2020 • Poorna Talkad Sukumar, Thomas Breideband, Gonzalo Martinez, Megan Caruso, Sierra Rose, Cooper Steputis, Sidney D'Mello, Gloria Mark, Aaron Striegel

Frequent monitoring of participant compliance is necessary when conducting large-scale, longitudinal studies to ensure that the collected data is of sufficiently high quality.

Human-Computer Interaction

Jointly Predicting Job Performance, Personality, Cognitive Ability, Affect, and Well-Being

no code implementations • 10 Jun 2020 • Pablo Robles-Granda, Suwen Lin, Xian Wu, Sidney D'Mello, Gonzalo J. Martinez, Koustuv Saha, Kari Nies, Gloria Mark, Andrew T. Campbell, Munmun De Choudhury, Anind D. Dey, Julie Gregg, Ted Grover, Stephen M. Mattingly, Shayan Mirjafari, Edward Moskal, Aaron Striegel, Nitesh V. Chawla

In this paper, we create a benchmark for predictive analysis of individuals from a perspective that integrates: physical and physiological behavior, psychological states and traits, and job performance.