Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detection

Monocular 3D lane detection is a challenging task due to its lack of depth information. A popular solution is to first transform the front-viewed (FV) images or features into the bird-eye-view (BEV) space with inverse perspective mapping (IPM) and detect lanes from BEV features. However, the reliance of IPM on flat ground assumption and loss of context information make it inaccurate to restore 3D information from BEV representations. An attempt has been made to get rid of BEV and predict 3D lanes from FV representations directly, while it still underperforms other BEV-based methods given its lack of structured representation for 3D lanes. In this paper, we define 3D lane anchors in the 3D space and propose a BEV-free method named Anchor3DLane to predict 3D lanes directly from FV representations. 3D lane anchors are projected to the FV features to extract their features which contain both good structural and context information to make accurate predictions. In addition, we also develop a global optimization method that makes use of the equal-width property between lanes to reduce the lateral error of predictions. Extensive experiments on three popular 3D lane detection benchmarks show that our Anchor3DLane outperforms previous BEV-based methods and achieves state-of-the-art performances. The code is available at: https://github.com/tusen-ai/Anchor3DLane.

PDF Abstract CVPR 2023 PDF CVPR 2023 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Lane Detection Apollo Synthetic 3D Lane Anchor3DLane F1 95.6 # 3
X error near 0.052 # 4
X error far 0.306 # 3
Z error near 0.015 # 5
Z error far 0.223 # 7
3D Lane Detection Apollo Synthetic 3D Lane Anchor3DLane† (iterative regression) F1 95.4 # 4
X error near 0.048 # 2
X error far 0.299 # 2
Z error near 0.013 # 4
Z error far 0.220 # 6
3D Lane Detection OpenLane Anchor3DLane (ResNet-18) F1 (all) 53.1 # 8
Up & Down 45.5 # 8
Curve 56.2 # 9
Extreme Weather 51.9 # 7
Night 47.2 # 9
Intersection 44.2 # 5
Merge & Split 50.5 # 8
3D Lane Detection OpenLane Anchor3DLane† (iterative regression) F1 (all) 53.7 # 7
Up & Down 46.7 # 6
Curve 57.2 # 7
Extreme Weather 52.5 # 6
Night 47.8 # 7
Intersection 45.4 # 4
Merge & Split 51.2 # 6
3D Lane Detection OpenLane Anchor3DLane-T† (multi-frame + iterative regression) F1 (all) 54.3 # 6
Up & Down 47.2 # 5
Curve 58.0 # 6
Extreme Weather 52.7 # 5
Night 48.7 # 6
Intersection 45.8 # 3
Merge & Split 51.7 # 4
FPS (pytorch) - # 2

Methods


No methods listed for this paper. Add relevant methods here