HMD-EgoPose: Head-Mounted Display-Based Egocentric Marker-Less Tool and Hand Pose Estimation for Augmented Surgical Guidance

1 code implementation • 24 Feb 2022 • Mitchell Doughty, Nilesh R. Ghugre

Further, we reveal the capacity of our HMD-EgoPose framework for performant 6DoF pose estimation on a commercially available optical see-through head-mounted display (OST-HMD) through a low-latency streaming approach.

Hand Pose Estimation Pose Tracking

SurgeonAssist-Net: Towards Context-Aware Head-Mounted Display-Based Augmented Reality for Surgical Guidance

1 code implementation • 13 Jul 2021 • Mitchell Doughty, Karan Singh, Nilesh R. Ghugre

On a widely used benchmark dataset for laparoscopic surgical workflow, our implementation competes with state-of-the-art approaches in prediction accuracy for automated task recognition, and yet requires 7. 4x fewer parameters, 10. 2x fewer floating point operations per second (FLOPS), is 7. 0x faster for inference on a CPU, and is capable of near real-time performance on the Microsoft HoloLens 2 OST-HMD.