notesum.ai

Published at November 27

ModeDreamer: Mode Guiding Score Distillation for Text-to-3D Generation using Reference Image Prompts

cs.CV

Released Date: November 27, 2024

Authors: Uy Dieu Tran¹, Minh Luu¹, Phong Ha Nguyen, Khoi Nguyen¹, Binh-Son Hua²

Aff.: ¹VinAI Research, Vietnam; ²Trinity College Dublin, Ireland

Arxiv: http://arxiv.org/abs/2411.18135v1

Refer to caption

	Time	Single Object			Single Object with Surr			Multiple Objects
Method	(mins)	Qual. $\uparrow$	Align. $\uparrow$	Avg $\uparrow$	Qual. $\uparrow$	Align. $\uparrow$	Avg $\uparrow$	Qual. $\uparrow$	Align. $\uparrow$	Avg $\uparrow$
Dreamfusion [38]	30	24.9	24.0	24.4	19.3	29.8	24.6	17.3	14.8	16.1
Magic3D [24]	40	38.7	35.3	37.0	29.8	41.0	35.4	26.6	24.8	25.7
LatentNeRF [35]	65	34.2	32.0	33.1	23.7	37.5	30.6	21.7	19.5	20.6
Fantasia3D [2]	45	29.2	23.5	26.4	21.9	32.0	27.0	22.7	14.3	18.5
SJC [51]	25	26.3	23.0	24.7	17.3	22.3	19.8	11.7	5.8	8.7
ProlificDreamer [53]	240	51.1	47.8	49.4	42.5	47.0	44.8	45.7	25.8	35.8
MVDream [46]	30	53.2	42.3	47.8	36.3	48.5	42.4	39.0	28.5	33.8
DreamGaussian [48]	7	19.9	19.8	19.8	10.4	17.8	14.1	12.3	9.5	10.9
GeoDream [32]	400	48.4	33.8	41.1	35.2	34.5	34.9	34.3	16.5	25.4
RichDreamer [39]	70	57.3	40.0	48.6	43.9	42.3	43.1	34.8	22.0	28.4
ISD (ours)	40	55.4	52.6	54.0	45.7	59.0	52.4	43.4	39.4	41.4