Meta Architecture for Point Cloud Analysis

Recent advances in 3D point cloud analysis bring a diverse set of network architectures to the field. However, the lack of a unified framework to interpret those networks makes any systematic comparison, contrast, or analysis challenging, and practically limits healthy development of the field. In this paper, we take the initiative to explore and propose a unified framework called PointMeta, to which the popular 3D point cloud analysis approaches could fit. This brings three benefits. First, it allows us to compare different approaches in a fair manner, and use quick experiments to verify any empirical observations or assumptions summarized from the comparison. Second, the big picture brought by PointMeta enables us to think across different components, and revisit common beliefs and key design decisions made by the popular approaches. Third, based on the learnings from the previous two analyses, by doing simple tweaks on the existing approaches, we are able to derive a basic building block, termed PointMetaBase. It shows very strong performance in efficiency and effectiveness through extensive experiments on challenging benchmarks, and thus verifies the necessity and benefits of high-level interpretation, contrast, and comparison like PointMeta. In particular, PointMetaBase surpasses the previous state-of-the-art method by 0.7%/1.4/%2.1% mIoU with only 2%/11%/13% of the computation cost on the S3DIS datasets.

PDF Abstract CVPR 2023 PDF CVPR 2023 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Semantic Segmentation OpenTrench3D PointMetaBase-XXL mIoU 75.8 # 2
mAcc 84.5 # 1
Model Size 19.7M # 3
Semantic Segmentation S3DIS PointMetaBase-XXL Mean IoU 77.0 # 8
oAcc 91.3 # 7
FLOPs 11.0G # 1
Number of params 19.7M # 48
Params (M) 19.7 # 5
Semantic Segmentation S3DIS Area5 PointMetaBase-XXL mIoU 71.3±0.7 # 21
Number of params N/A # 2

Methods


No methods listed for this paper. Add relevant methods here