SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation

CVPR 2021  ยท  Siqi Fan, Qiulei Dong, Fenghua Zhu, Yisheng Lv, Peijun Ye, Fei-Yue Wang ยท

How to learn effective features from large-scale point clouds for semantic segmentation has attracted increasing attention in recent years. Addressing this problem, we propose a learnable module that learns Spatial Contextual Features from large-scale point clouds, called SCF in this paper. The proposed module mainly consists of three blocks, including the local polar representation block, the dual-distance attentive pooling block, and the global contextual feature block. For each 3D point, the local polar representation block is firstly explored to construct a spatial representation that is invariant to the z-axis rotation, then the dual-distance attentive pooling block is designed to utilize the representations of its neighbors for learning more discriminative local features according to both the geometric and feature distances among them, and finally, the global contextual feature block is designed to learn a global context for each 3D point by utilizing its spatial location and the volume ratio of the neighborhood to the global point cloud. The proposed module could be easily embedded into various network architectures for point cloud segmentation, naturally resulting in a new 3D semantic segmentation network with an encoder-decoder architecture, called SCF-Net in this work. Extensive experimental results on two public datasets demonstrate that the proposed SCF-Net performs better than several state-of-the-art methods in most cases.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Semantic Segmentation S3DIS SCF-Net Mean IoU 71.6 # 19
mAcc 82.7 # 12
oAcc 88.4 # 21
Number of params N/A # 1
Semantic Segmentation S3DIS Area5 SCF-Net mIoU 63.7 # 39
oAcc 87.2 # 27
mAcc 71.8 # 28
Number of params N/A # 2
Semantic Segmentation Semantic3D SCF-Net mIoU 77.6% # 3
oAcc 94.7% # 3
3D Semantic Segmentation SensatUrban SCF-Net mIoU 55.1 # 4
3D Semantic Segmentation STPLS3D SCF-Net mIOU 50.65 # 2
Semantic Segmentation Toronto-3D L002 SCF-Net oAcc 93.5 # 1
mIoU 71.5 # 2

Methods


No methods listed for this paper. Add relevant methods here