Zero-Shot Dual-Path Integration Framework for Open-Vocabulary 3D Instance Segmentation

no code implementations • 16 Aug 2024 • Tri Ton, Ji Woo Hong, SooHwan Eom, Jun Yeop Shim, Junyeong Kim, Chang D. Yoo

3D pathway generates spatially accurate class-agnostic mask proposals of common indoor objects from 3D point cloud data using a pre-trained 3D model, while 2D pathway utilizes pre-trained open-vocabulary instance segmentation model to identify a diverse array of object proposals from multi-view RGB-D images.

3D Instance Segmentation open vocabulary 3d instance segmentation +1