A Dual-Source Approach for 3D Pose Estimation from a Single Image

One major challenge for 3D pose estimation from a single RGB image is the acquisition of sufficient training data. In particular, collecting large amounts of training data that contain unconstrained images and are annotated with accurate 3D poses is infeasible. We therefore propose to use two independent training sources. The first source consists of images with annotated 2D poses and the second source consists of accurate 3D motion capture data. To integrate both sources, we propose a dual-source approach that combines 2D pose estimation with efficient and robust 3D pose retrieval. In our experiments, we show that our approach achieves state-of-the-art results and is even competitive when the skeleton structure of the two sources differ substantially.

PDF Abstract CVPR 2016 PDF CVPR 2016 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Human Pose Estimation Human3.6M Dual-source approach Average MPJPE (mm) 97.39 # 305
Using 2D ground-truth joints Yes # 2
PA-MPJPE 108.3 # 120
3D Human Pose Estimation HumanEva-I Dual-source approach Mean Reconstruction Error (mm) 38.9 # 22

Methods


No methods listed for this paper. Add relevant methods here