notesum.ai

Published at December 6

ReF-LDM: A Latent Diffusion Model for Reference-based Face Image Restoration

cs.CV

cs.LG

eess.IV

Released Date: December 6, 2024

Authors: Chi-Wei Hsiao¹, Yu-Lun Liu², Cheng-Kun Yang¹, Sheng-Po Kuo¹, Kevin Jou, Chia-Ping Chen¹

Aff.: ¹MediaTek; ²National Yang Ming Chiao Tung University

Arxiv: http://arxiv.org/pdf/2412.05043v1

Refer to caption

	FFHQ-Ref-Severe				FFHQ-Ref-Moderate				CelebA-Test-Ref
	IDS↑	fLPIPS↓	LPIPS↓	FID↓	IDS↑	fLPIPS↓	LPIPS↓	FID↓	IDS↑	fLPIPS↓	LPIPS↓
CodeFormer [32]	0.323	0.108	0.398	51.51	0.760	0.084	0.301	38.78	0.660	0.092	0.340
VQFR [5]	0.308	0.112	0.415	52.96	0.659	0.089	0.324	36.77	0.558	0.096	0.352
DAEFR [26]	0.294	0.118	0.435	49.08	0.614	0.093	0.333	33.86	0.491	0.101	0.367
LDM	0.231	0.125	0.453	34.40	0.753	0.095	0.344	32.16	0.663	0.093	0.368
DMDNet [16]^†	0.185	0.162	0.511	72.66	0.810	0.096	0.348	36.60	0.752	0.097	0.362
ReF-LDM	0.676	0.110	0.429	37.60	0.840	0.088	0.332	33.05	0.779	0.093	0.368