SO-Net: Self-Organizing Network for Point Cloud Analysis

CVPR 2018  ·  Jiaxin Li, Ben M. Chen, Gim Hee Lee ·

This paper presents SO-Net, a permutation invariant architecture for deep learning with orderless point clouds. The SO-Net models the spatial distribution of point cloud by building a Self-Organizing Map (SOM). Based on the SOM, SO-Net performs hierarchical feature extraction on individual points and SOM nodes, and ultimately represents the input point cloud by a single feature vector. The receptive field of the network can be systematically adjusted by conducting point-to-node k nearest neighbor search. In recognition tasks such as point cloud reconstruction, classification, object part segmentation and shape retrieval, our proposed network demonstrates performance that is similar with or better than state-of-the-art approaches. In addition, the training speed is significantly faster than existing point cloud recognition networks because of the parallelizability and simplicity of the proposed architecture. Our code is available at the project website. https://github.com/lijx10/SO-Net

PDF Abstract CVPR 2018 PDF CVPR 2018 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Part Segmentation IntrA SO-Net IoU (V) 94.46 # 3
DSC (V) 97.09 # 3
IoU (A) 81.40 # 2
DSC (A) 88.76 # 2
3D Point Cloud Classification IntrA SO-Net F1 score (5-fold) 0.868 # 9
3D Point Cloud Linear Classification ModelNet40 SO-Net Overall Accuracy 87.5 # 17
3D Point Cloud Classification ModelNet40 SO-Net Overall Accuracy 90.9 # 90
3D Part Segmentation ShapeNet-Part SO-Net Instance Average IoU 84.9 # 53

Methods