Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline

16 Jun 2022  ·  Penghao Wu, Xiaosong Jia, Li Chen, Junchi Yan, Hongyang Li, Yu Qiao ·

Current end-to-end autonomous driving methods either run a controller based on a planned trajectory or perform control prediction directly, which have spanned two separately studied lines of research. Seeing their potential mutual benefits to each other, this paper takes the initiative to explore the combination of these two well-developed worlds. Specifically, our integrated approach has two branches for trajectory planning and direct control, respectively. The trajectory branch predicts the future trajectory, while the control branch involves a novel multi-step prediction scheme such that the relationship between current actions and future states can be reasoned. The two branches are connected so that the control branch receives corresponding guidance from the trajectory branch at each time step. The outputs from two branches are then fused to achieve complementary advantages. Our results are evaluated in the closed-loop urban driving setting with challenging scenarios using the CARLA simulator. Even with a monocular camera input, the proposed approach ranks first on the official CARLA Leaderboard, outperforming other complex candidates with multiple sensors or fusion mechanisms by a large margin. The source code is publicly available at https://github.com/OpenPerceptionX/TCP

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
CARLA longest6 CARLA Trajectory-guided Control Prediction (TCP) Driving Score 48 # 10
Route Completion 72 # 15
Infraction Score 0.65 # 8
Autonomous Driving CARLA Leaderboard TCP Driving Score 75.14 # 3
Route Completion 85.63 # 6
Infraction penalty 0.87 # 2
Autonomous Driving CARLA Leaderboard TCP (Reproduced) Driving Score 47.91 # 8
Route Completion 65.73 # 11
Infraction penalty 0.77 # 5

Methods