Decomposed Human Motion Prior for Video Pose Estimation via Adversarial Training

30 May 2023  ·  Wenshuo Chen, Xiang Zhou, Zhengdi Yu, Weixi Gu, Kai Zhang ·

Estimating human pose from video is a task that receives considerable attention due to its applicability in numerous 3D fields. The complexity of prior knowledge of human body movements poses a challenge to neural network models in the task of regressing keypoints. In this paper, we address this problem by incorporating motion prior in an adversarial way. Different from previous methods, we propose to decompose holistic motion prior to joint motion prior, making it easier for neural networks to learn from prior knowledge thereby boosting the performance on the task. We also utilize a novel regularization loss to balance accuracy and smoothness introduced by motion prior. Our method achieves 9\% lower PA-MPJPE and 29\% lower acceleration error than previous methods tested on 3DPW. The estimator proves its robustness by achieving impressive performance on in-the-wild dataset.

PDF Abstract

Datasets


Results from the Paper


Ranked #61 on 3D Human Pose Estimation on 3DPW (PA-MPJPE metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Human Pose Estimation 3DPW Wenshuo et al. MPVPE 112.6 # 71
3D Human Pose Estimation 3DPW Wenshuo et a;. PA-MPJPE 51.4 # 61
MPJPE 89.4 # 88

Methods


No methods listed for this paper. Add relevant methods here