Lifting from the Deep: Convolutional 3D Pose Estimation from a Single Image

CVPR 2017 Denis TomeChris RussellLourdes Agapito

We propose a unified formulation for the problem of 3D human pose estimation from a single raw RGB image that reasons jointly about 2D joint estimation and 3D pose reconstruction to improve both tasks. We take an integrated approach that fuses probabilistic knowledge of 3D human pose with a multi-stage CNN architecture and uses the knowledge of plausible 3D landmark locations to refine the search for better 2D locations... (read more)

PDF Abstract

Evaluation results from the paper

Task Dataset Model Metric name Metric value Global rank Compare
3D Human Pose Estimation Human3.6M Projected-pose belief maps + 2D fusion layers Average MPJPE (mm) 88.39 # 24