notesum.ai

Published at October 30

cs.LG

cs.AI

cs.CV

Released Date: October 30, 2024

Authors: Yanke Song¹, Jonathan Lorraine², Weili Nie³, Karsten Kreis³, James Lucas³

Aff.: ¹Harvard University; ²Vector Institute; ³NVIDIA

Method	NFE ( $\downarrow$ )	FID ( $\downarrow$ )
Multiple Steps
RIN [23]	$1000$	$1.23$
ADM [12]	$250$	$2.07$
DPM Solver [39]	$10$	$7.93$
Multistep CD [17]	$2$	$2.0$
Single Step, w/o GAN
PD [55]	$1$	$15.39$
DSNO [81]	$1$	$7.83$
Diff-Instruct [43]	$1$	$5.57$
iCT-deep [62]	$1$	$3.25$
Moment Matching [56]	$1$	$3.0$
DMD [75]	$1$	$2.62$
MSD (ours): 4 students, DM only	$1$	$2.37$
EMD [69]	$1$	$2.20$
SiD [84]	$1$	$1.52$
Single Step, w/ GAN
MSD (ours): 4, 42% smaller students, ADM	$1$	$2.88$
StyleGAN-XL [57]	$1$	$1.52$
CTM [27]	$1$	$1.92$
DMD2 [74]	$1$	$1.28$
MSD (ours): 4 students, ADM	$1$	$1.20$
teacher
EDM (teacher, ODE) [25]	$511$	$2.32$
EDM (teacher, SDE) [25]	$511$	$1.36$