notesum.ai

Published at November 25

Open-Vocabulary Octree-Graph for 3D Scene Understanding

cs.CV

Released Date: November 25, 2024

Authors: Zhigang Wang¹, Yifei Su², Chenhui Li¹, Dong Wang¹, Yan Huang³, Bin Zhao⁴, Xuelong Li⁵

Aff.: ¹Shanghai AI Laboratory; ²School of Artificial Intelligence, UCAS; ³MAIS, Institute of Automation; ⁴Shanghai AI Laboratory, Northwestern Polytechnical University; ⁵Shanghai AI Laboratory, Institute of Artificial Intelligence (TeleAI)

Arxiv: http://arxiv.org/abs/2411.16253v1

Method	AP $\uparrow$	AP50 $\uparrow$	AP25 $\uparrow$
sup. mask + sup. semantic
Mask3D [35]	26.9	36.2	41.4
sup. mask + z.s. semantic
Open3DIS [26]	23.7	29.4	32.8
Open3DIS [26] (3D only)	18.6	23.1	27.3
OpenMask3D [37] (Mask3D)	15.4	19.9	23.1
Ours (Mask3D)	23.2	30.3	33.3
z.s. mask + z.s. semantic
OVIR-3D [24]	9.3	18.7	25.0
SAM3D [47]	9.8	15.2	20.7
SAI3D [48]	12.7	18.8	24.1
Mask-Clustering [45]	12.0	23.3	30.1
Ours	14.3	25.8	33.6