Real-time Hand Gesture Detection and Classification Using Convolutional Neural Networks

29 Jan 2019Okan KöpüklüAhmet GunduzNeslihan KoseGerhard Rigoll

Real-time recognition of dynamic hand gestures from video streams is a challenging task since (i) there is no indication when a gesture starts and ends in the video, (ii) performed gestures should only be recognized once, and (iii) the entire architecture should be designed considering the memory and power budget. In this work, we address these challenges by proposing a hierarchical structure enabling offline-working convolutional neural network (CNN) architectures to operate online efficiently by using sliding window approach... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK COMPARE
Hand-Gesture Recognition EgoGesture ResNeXt-101 Accuracy 94.03 # 1
Action Recognition In Videos EgoGesture ResNeXT-101 Accuracy 94.03 # 1