GesturePod: Enabling On-device Gesture-based Interaction for White Cane Users

Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST'19) 2019 Shishir G. PatilDon DennisChirag PabbarajuNadeem ShaheerHarsha Vardhan SimhadriVivek SeshadriManik VarmaPrateek Jain

People using white canes for navigation find it challenging to concurrently access devices such as smartphones. Building on prior research on abandonment of specialized devices, we explore a new touch free mode of interaction wherein a person with visual impairment can perform gestures on their existing white cane to trigger tasks on their smartphone... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK COMPARE
Gesture Recognition GesturePod GesturePod Real World Accuracy 92 # 1