notesum.ai

Published at November 28

Trajectory Attention for Fine-grained Video Motion Control

cs.CV

Released Date: November 28, 2024

Authors: Zeqi Xiao¹, Wenqi Ouyang¹, Yifan Zhou¹, Shuai Yang², Lei Yang³, Jianlou Si³, Xingang Pan¹

Aff.: ¹S-Lab, Nanyang Technological University; ²Wangxuan Institute of Computer Technology, Peking University; ³Sensetime Research

Arxiv: http://arxiv.org/pdf/2411.19324v1

Refer to caption

Setting	Methods	ATE (m, $\downarrow$ )	RPE trans (m, $\downarrow$ )	RPE Rot (deg, $\downarrow$ )	FID ( $\downarrow$ )
14 frames	MotionCtrl	1.2151	0.5213	1.8372	101.3
14 frames	Ours	0.0212	0.0221	0.1151	104.2
16 frames	MotionI2V*	0.0712	0.0471	0.2853	124.1
16 frames	Ours	0.0413	0.0241	0.1231	108.7
25 frames	CameraCtrl	0.0411	0.0268	0.3480	115.8
	NVS_Solver	0.1216	0.0558	0.4785	108.5
	Ours	0.0396	0.0232	0.1939	103.5