Intention-based Long-Term Human Motion Anticipation

3DV 2021  ·  Julian Tanke, Chintan Zaveri, Juergen Gall ·

Recently, a few works have been proposed to model the uncertainty of the future human motion. These works do not forecast a single sequence but multiple sequences for the same observation. While these works focused on in- creasing the diversity, this work focuses on keeping a high quality of the forecast sequences even for very long time horizons of up to 30 seconds. In order to achieve this goal, we propose to forecast the intention of the person ahead of time. This has the advantage that the generated human mo- tion remains goal oriented and that the motion transitions between two actions are smooth and highly realistic. We furthermore propose a new quality score for evaluation that correlates better with human perception than other metrics. The results and a user study show that our approach fore- casts multiple sequences that are more plausible compared to the state-of-the-art.

PDF

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Human Pose Forecasting Human3.6M Forecast LSTM MAR, walking, 400ms 0.91 # 7
Average MPJPE (mm) @ 1000 ms 149.2 # 10
APD 3070 # 11
Average MPJPE (mm) @ 400ms 80.8 # 10
Average NDMS at 4s 0.465 # 1

Methods