notesum.ai
Published at November 28Trajectory Attention for Fine-grained Video Motion Control
cs.CV
Released Date: November 28, 2024
Authors: Zeqi Xiao1, Wenqi Ouyang1, Yifan Zhou1, Shuai Yang2, Lei Yang3, Jianlou Si3, Xingang Pan1
Aff.: 1S-Lab, Nanyang Technological University; 2Wangxuan Institute of Computer Technology, Peking University; 3Sensetime Research

| Setting | Methods | ATE (m, ) | RPE trans (m, ) | RPE Rot (deg, ) | FID () |
| 14 frames | MotionCtrl | 1.2151 | 0.5213 | 1.8372 | 101.3 |
| Ours | 0.0212 | 0.0221 | 0.1151 | 104.2 | |
| 16 frames | MotionI2V* | 0.0712 | 0.0471 | 0.2853 | 124.1 |
| Ours | 0.0413 | 0.0241 | 0.1231 | 108.7 | |
| 25 frames | CameraCtrl | 0.0411 | 0.0268 | 0.3480 | 115.8 |
| NVS_Solver | 0.1216 | 0.0558 | 0.4785 | 108.5 | |
| Ours | 0.0396 | 0.0232 | 0.1939 | 103.5 |