notesum.ai

Published at November 7

ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning

cs.CV

cs.AI

cs.GR

cs.LG

Released Date: November 7, 2024

Authors: David Junhao Zhang¹, Roni Paiss², Shiran Zada², Nikhil Karnad², David E. Jacobs², Yael Pritch², Inbar Mosseri², Mike Zheng Shou¹, Neal Wadhwa², Nataniel Ruiz²

Aff.: ¹National University of Singapore; ²Google

Arxiv: http://arxiv.org/abs/2411.05003v1

Models	\CenterstackSubject
Consistency	\CenterstackBackground
Consistency	\CenterstackTemporal
Flickering	\CenterstackMotion
Smoothness	\CenterstackDynamic
Degree	\CenterstackAesthetic
Quality	\CenterstackImaging
Quality	\CenterstackObject
Class
Generative Camera Dolly [82]	83.02%	80.42%	74.64%	82.33%	51.24%	38.67%	58.62%	76.46%
Ours	88.53%	92.02%	91.12%	98.24%	49.03%	57.35%	64.75%	82.07%