HMOR: Hierarchical Multi-Person Ordinal Relations for Monocular Multi-Person 3D Pose Estimation

ECCV 2020  ·  Jiefeng Li, Can Wang, Wentao Liu, Chen Qian, Cewu Lu ·

Remarkable progress has been made in 3D human pose estimation from a monocular RGB camera. However, only a few studies explored 3D multi-person cases. In this paper, we attempt to address the lack of a global perspective of the top-down approaches by introducing a novel form of supervision - Hierarchical Multi-person Ordinal Relations (HMOR). The HMOR encodes interaction information as the ordinal relations of depths and angles hierarchically, which captures the body-part and joint level semantic and maintains global consistency at the same time. In our approach, an integrated top-down model is designed to leverage these ordinal relations in the learning process. The integrated model estimates human bounding boxes, human depths, and root-relative 3D poses simultaneously, with a coarse-to-fine architecture to improve the accuracy of depth estimation. The proposed method significantly outperforms state-of-the-art methods on publicly available multi-person 3D pose datasets. In addition to superior performance, our method costs lower computation complexity and fewer model parameters.

PDF Abstract ECCV 2020 PDF ECCV 2020 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Human Pose Estimation Human3.6M HMOR Average MPJPE (mm) 48.6 # 107
PA-MPJPE 30.5 # 5
3D Multi-Person Pose Estimation (absolute) MuPoTS-3D HMOR 3DPCK 43.8 # 6
3D Multi-Person Pose Estimation (root-relative) MuPoTS-3D HMOR 3DPCK 82.0 # 11
3D Multi-Person Pose Estimation Panoptic HMOR Average MPJPE (mm) 51.6 # 13

Methods


No methods listed for this paper. Add relevant methods here