notesum.ai

Published at December 6

Stag-1: Towards Realistic 4D Driving Simulation with Video Generation Model

cs.CV

cs.AI

cs.LG

Released Date: December 6, 2024

Authors: Lening Wang¹, Wenzhao Zheng², Dalong Du³, Yunpeng Zhang¹, Yilong Ren¹, Han Jiang¹, Zhiyong Cui¹, Haiyang Yu¹, Jie Zhou², Jiwen Lu², Shanghang Zhang⁴

Aff.: ¹Beihang University; ²Tsinghua University; ³PhiGent Robotics; ⁴Peking University

Arxiv: http://arxiv.org/pdf/2412.05280v1

Data	Metrics	Scene Reconstruction					Novel View Synthesis
Data	Metrics	3DGS	MARS	ENRF	$S^{3}$ G	Ours	3DGS	MARS	ENRF	$S^{3}$ G	Ours
D32	PSNR↑	28.47	28.24	28.16	31.35	32.91	25.14	26.61	25.14	27.44	28.08
	SSIM↑	0.876	0.866	0.806	0.911	0.934	0.813	0.796	0.747	0.857	0.864
	LPIPS↓	0.136	0.252	0.228	0.106	0.104	0.165	0.305	0.313	0.137	0.129
D32	PSNR*↑	23.26	23.37	24.32	26.02	27.71	20.48	22.21	23.49	22.92	24.98
D32	SSIM*↑	0.716	0.701	0.682	0.783	0.796	0.753	0.697	0.660	0.680	0.644
S32	PSNR↑	29.42	28.31	30.00	30.73	31.03	26.82	27.63	28.89	27.05	28.56
	SSIM↑	0.891	0.879	0.834	0.883	0.897	0.836	0.848	0.814	0.825	0.877
	LPIPS↓	0.118	0.196	0.201	0.116	0.112	0.134	0.193	0.212	0.142	0.132