notesum.ai

Published at November 27

SmileSplat: Generalizable Gaussian Splats for Unconstrained Sparse Images

cs.CV

Released Date: November 27, 2024

Authors: Yanyan Li¹, Yixin Fang², Federico Tombari³, Gim Hee Lee¹

Aff.: ¹National University of Singapore; ²Zhejiang University; ³Technical University of Munich

Arxiv: http://arxiv.org/abs/2411.18072v1

Refer to caption

Method		pixelNeRF [47]	AttnRend [9]	pixelSplat [5]	MVSplat [6]	DUSt3R [38]	MASt3R [21]	Splatt3R [35]	NoPoSplat [45]	SmileSplat
Setting	K	$\checkmark$	$\checkmark$	$\checkmark$	$\checkmark$	$\times$	$\times$	$\times$	$\checkmark$	$\times$
Setting	Pose	$\checkmark$	$\checkmark$	$\checkmark$	$\checkmark$	$\times$	$\times$	$\times$	$\times$	$\times$
Small	PSNR $\uparrow$	18.41	19.15	20.26	20.35	14.10	13.53	14.35	22.51	26.81
	SSIM $\uparrow$	0.601	0.663	0.717	0.724	0.432	0.407	0.475	0.585	0.856
	LPIPS $\downarrow$	0.526	0.368	0.266	0.250	0.468	0.494	0.472	0.462	0.071
Medium	PSNR $\uparrow$	19.93	22.53	23.71	23.77	15.41	14.94	15.52	24.89	26.60
	SSIM $\uparrow$	0.632	0.763	0.809	0.812	0.451	0.436	0.502	0.616	0.843
	LPIPS $\downarrow$	0.480	0.269	0.181	0.173	0.432	0.451	0.425	0.160	0.071
Large	PSNR $\uparrow$	20.86	25.89	27.15	27.40	16.42	16.02	15.81	27.41	27.26
	SSIM $\uparrow$	0.639	0.845	0.879	0.884	0.453	0.444	0.483	0.883	0.850
	LPIPS $\downarrow$	0.458	0.186	0.122	0.116	0.402	0.418	0.421	0.119	0.063