On the representation and methodology for wide and short range head pose estimation

Head pose estimation (HPE) is a problem of interest in computer vision to improve the performance of face processing tasks in semi-frontal or profile settings. Recent applications require the analysis of faces in the full 360{\deg} rotation range. Traditional approaches to solve the semi-frontal and profile cases are not directly amenable for the full rotation case. In this paper we analyze the methodology for short- and wide-range HPE and discuss which representations and metrics are adequate for each case. We show that the popular Euler angles representation is a good choice for short-range HPE, but not at extreme rotations. However, the Euler angles' gimbal lock problem prevents them from being used as a valid metric in any setting. We also revisit the current cross-data set evaluation methodology and note that the lack of alignment between the reference systems of the training and test data sets negatively biases the results of all articles in the literature. We introduce a procedure to quantify this misalignment and a new methodology for cross-data set HPE that establishes new, more accurate, SOTA for the 300W-LP|Biwi benchmark. We also propose a generalization of the geodesic angular distance metric that enables the construction of a loss that controls the contribution of each training sample to the optimization of the model. Finally, we introduce a wide range HPE benchmark based on the CMU Panoptic data set.

PDF Abstract Pattern Recognition 2024 PDF Pattern Recognition 2024 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Head Pose Estimation AFLW2000 SRHP-Euler MAE 3.25 # 1
Geodesic Error (GE) 5.29 # 1
Head Pose Estimation AFLW2000 SRHP-6D MAE 3.49 # 4
Geodesic Error (GE) 5.37 # 2
Head Pose Estimation BIWI SRHP-6D MAE (trained with other data) 3.98 # 8
Geodesic Error (GE) 7.30 # 2
MAE-aligned (trained with other data) 3.21 # 3
Geodesic Error - aligned (GE) 5.48 # 3
Head Pose Estimation BIWI SRHP-Euler MAE (trained with other data) 4.13 # 10
Geodesic Error (GE) 7.49 # 3
MAE-aligned (trained with other data) 3.16 # 2
Geodesic Error - aligned (GE) 5.42 # 2
Head Pose Estimation Panoptic WRHP-Quaternion Geodesic Error (GE) 9.32 # 4
Head Pose Estimation Panoptic WRHP-Euler Geodesic Error (GE) 10.47 # 5
Head Pose Estimation Panoptic WRHP-6D-Opal Geodesic Error (GE) 7.45 # 1
Head Pose Estimation Panoptic WRHP-6D Geodesic Error (GE) 7.70 # 2

Methods


No methods listed for this paper. Add relevant methods here