notesum.ai
Published at October 21Warped Diffusion: Solving Video Inverse Problems with Image Diffusion Models
cs.CV
cs.AI
cs.LG
Released Date: October 21, 2024
Authors: Giannis Daras1, Weili Nie2, Karsten Kreis2, Alex Dimakis, Morteza Mardani2, Nikola Borislavov Kovachki, Arash Vahdat2
Aff.: 1UT Austin; 2NVIDIA

| Model | FID | Inception | CLIP Txt | CLIP Img | SSIM | LPIPS | MSE |
|---|---|---|---|---|---|---|---|
| Super-resolution GP | 37.514 | 11.917 | 0.2720.042 | 0.9550.029 | 0.7700.106 | 0.2530.076 | 0.0040.004 |
| Super-resolution Indep. | 40.843 | 11.679 | 0.2710.041 | 0.9570.027 | 0.7850.108 | 0.2420.078 | 0.0040.004 |
| Inpainting GP | 58.727 | 11.769 | 0.2760.042 | 0.9290.060 | 0.7980.134 | 0.1810.122 | 0.0560.084 |
| Inpainting Indep. | 61.380 | 11.707 | 0.2750.048 | 0.9130.089 | 0.7780.161 | 0.1980.134 | 0.0570.076 |