notesum.ai

Published at December 3

Motion Prompting: Controlling Video Generation with Motion Trajectories

cs.CV

Released Date: December 3, 2024

Authors: Daniel Geng¹, Charles Herrmann¹, Junhwa Hur¹, Forrester Cole¹, Serena Zhang¹, Tobias Pfaff¹, Tatiana Lopez-Guevara¹, Carl Doersch¹, Yusuf Aytar¹, Michael Rubinstein¹, Chen Sun¹, Oliver Wang¹, Andrew Owens², Deqing Sun³

Aff.: ¹Google DeepMind; ²University of Michigan; ³Brown University

Arxiv: http://arxiv.org/pdf/2412.02700v1

Method	Motion Adherence	Motion Quality	Visual Quality
Image Conductor	74.3 ( $\pm 1.1$ )	80.5 ( $\pm 1.0$ )	77.3 ( $\pm 1.0$ )
Drag Anything	74.5 ( $\pm 1.1$ )	75.7 ( $\pm 1.1$ )	73.7 ( $\pm 1.0$ )