VoxelPose: Towards Multi-Camera 3D Human Pose Estimation in Wild Environment

ECCV 2020  ·  Hanyue Tu, Chunyu Wang, Wen-Jun Zeng ·

We present an approach to estimate 3D poses of multiple people from multiple camera views. In contrast to the previous efforts which require to establish cross-view correspondence based on noisy and incomplete 2D pose estimations, we present an end-to-end solution which directly operates in the $3$D space, therefore avoids making incorrect decisions in the 2D space. To achieve this goal, the features in all camera views are warped and aggregated in a common 3D space, and fed into Cuboid Proposal Network (CPN) to coarsely localize all people. Then we propose Pose Regression Network (PRN) to estimate a detailed 3D pose for each proposal. The approach is robust to occlusion which occurs frequently in practice. Without bells and whistles, it outperforms the state-of-the-arts on the public datasets. Code will be released at https://github.com/microsoft/multiperson-pose-estimation-pytorch.

PDF Abstract ECCV 2020 PDF ECCV 2020 Abstract

Datasets


Results from the Paper


Ranked #5 on 3D Multi-Person Pose Estimation on Panoptic (using extra training data)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
3D Multi-Person Pose Estimation Campus VoxelPose PCP3D 96.7 # 7
3D Multi-Person Pose Estimation Panoptic VoxelPose Average MPJPE (mm) 17.68 # 5
3D Multi-Person Pose Estimation Shelf VoxelPose PCP3D 97 # 15

Methods


No methods listed for this paper. Add relevant methods here