notesum.ai

Published at November 25

Event-boosted Deformable 3D Gaussians for Fast Dynamic Scene Reconstruction

cs.CV

Released Date: November 25, 2024

Authors: Wenhao Xu¹, Wenming Weng¹, Yueyi Zhang¹, Ruikang Xu¹, Zhiwei Xiong¹

Aff.: ¹University of Science and Technology of China

Arxiv: http://arxiv.org/abs/2411.16180v1

[Uncaptioned image]

Method	Lego				Hotdog				Materials				Music box
Method	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$
3D-GS [17]	23.60	0.918	0.088	223	30.01	0.951	0.064	260	28.07	0.967	0.061	262	19.20	0.905	0.122	239
TiNeuVox [7]	22.39	0.891	0.071	0.53	30.81	0.953	0.035	0.49	26.63	0.938	0.054	0.52	20.45	0.831	0.152	0.62
K-Planes [10]	24.55	0.931	0.035	2.34	31.36	0.958	0.016	2.35	30.62	0.976	0.009	2.29	20.77	0.858	0.071	2.39
4D-GS [40]	26.30	0.937	0.072	104	33.48	0.965	0.052	132	30.40	0.979	0.054	111	24.06	0.937	0.071	64
Deformable-3DGS [44]	23.79	0.923	0.053	73	32.91	0.962	0.017	132	34.00	0.986	0.004	91	22.08	0.924	0.052	51
Event-4DGS	28.00	0.943	0.040	54	34.61	0.969	0.019	96	35.60	0.989	0.006	74	28.58	0.950	0.043	42
Ours	31.85	0.967	0.018	189	36.15	0.974	0.013	241	38.02	0.993	0.003	240	30.78	0.963	0.029	92
Method	Celestial globe				Fan				Water wheel				Man
Method	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$	PSNR $\uparrow$	SSIM $\uparrow$	LPIPS $\downarrow$	FPS $\uparrow$
3D-GS [17]	19.05	0.915	0.110	182	21.26	0.891	0.118	270	19.43	0.887	0.109	215	20.79	0.870	0.114	210
TiNeuVox [7]	13.62	0.736	0.290	0.62	19.90	0.889	0.107	0.53	17.03	0.850	0.147	0.56	22.81	0.887	0.071	0.50
K-Planes [10]	15.49	0.857	0.088	2.46	22.10	0.909	0.062	2.38	20.96	0.920	0.046	2.41	21.02	0.857	0.073	2.33
4D-GS [40]	20.97	0.942	0.072	52	25.05	0.936	0.080	108	20.96	0.917	0.077	77	23.80	0.914	0.076	64
Deformable-3DGS [44]	23.07	0.962	0.036	41	24.66	0.929	0.051	90	20.79	0.912	0.051	43	23.06	0.906	0.051	37
Event-4DGS	24.30	0.948	0.045	36	27.66	0.949	0.041	71	26.34	0.932	0.052	30	25.55	0.921	0.063	33
Ours	28.83	0.976	0.020	73	30.18	0.964	0.025	168	28.47	0.950	0.033	112	28.21	0.943	0.037	129