notesum.ai

Published at December 6

SimC3D: A Simple Contrastive 3D Pretraining Framework Using RGB Images

cs.CV

Released Date: December 6, 2024

Authors: Jiahua Dong¹, Tong Wu², Rui Qian, Jiaqi Wang

Aff.: ¹Shanghai AI Laboratory; ²The Chinese University of Hong Kong

Arxiv: http://arxiv.org/pdf/2412.05274v1

Refer to caption

Method	source data type	pretrain dataset	ScanNet mIoU	ScanNet200 mIoU
SparseUNet [35]	-	-	72.2	25
+ PC [9]	Raw Point Cloud	ScanNet	74.1	26.2
+ CSC [10]	Raw Point Cloud	ScanNet	73.8	26.4
+ MSC [29]	Complete Point Cloud	ScanNet	75.0	-
+ GC [37]	Complete Point Cloud	ScanNet	75.7	30.0
+ SimC3D(Ours)	RGB Images	ScanNet	76.2 ^{4.0 $\uparrow$}	30.2 ^{5.2 $\uparrow$}
+ MSC	Complete Point Cloud	ScanNet + ArkitScenes [38]	75.5	28.8
+ PPT (Unsup.) [39]	Complete Point Cloud	ScanNet + ArkitScenes [38]	75.8	30.4
+ SimC3D (Ours)	RGB Images	ScanNet + COCO2014 [40]	76.6 ^{4.2 $\uparrow$}	30.7 ^{5.7 $\uparrow$}