Activity Recognition with Moving Cameras and Few Training Examples: Applications for Detection of Autism-Related Headbanging

no code implementations • 10 Jan 2021 • Peter Washington, Aaron Kline, Onur Cezmi Mutlu, Emilie Leblanc, Cathy Hou, Nate Stockham, Kelley Paskov, Brianna Chrisman, Dennis P. Wall

Activity recognition computer vision algorithms can be used to detect the presence of autism-related behaviors, including what are termed "restricted and repetitive behaviors", or stimming, by diagnostic instruments.

Action Detection Activity Detection +1

Training Affective Computer Vision Models by Crowdsourcing Soft-Target Labels

no code implementations • 10 Jan 2021 • Peter Washington, Onur Cezmi Mutlu, Emilie Leblanc, Aaron Kline, Cathy Hou, Brianna Chrisman, Nate Stockham, Kelley Paskov, Catalin Voss, Nick Haber, Dennis Wall

While the F1-score for a one-hot encoded classifier is much higher (94. 33% vs. 78. 68%) with respect to the ground truth CAFE labels, the output probability vector of the crowd-trained classifier more closely resembles the distribution of human labels (t=3. 2827, p=0. 0014).

BIG-bench Machine Learning

Training an Emotion Detection Classifier using Frames from a Mobile Therapeutic Game for Children with Developmental Disorders

no code implementations • 16 Dec 2020 • Peter Washington, Haik Kalantarian, Jack Kent, Arman Husic, Aaron Kline, Emilie Leblanc, Cathy Hou, Cezmi Mutlu, Kaitlyn Dunlap, Yordan Penev, Maya Varma, Nate Stockham, Brianna Chrisman, Kelley Paskov, Min Woo Sun, Jae-Yoon Jung, Catalin Voss, Nick Haber, Dennis P. Wall

The classifier achieved 66. 9% balanced accuracy and 67. 4% F1-score on the entirety of CAFE as well as 79. 1% balanced accuracy and 78. 0% F1-score on CAFE Subset A, a subset containing at least 60% human agreement on emotions labels.

Emotion Classification