notesum.ai

Published at December 10

UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics

cs.CV

Released Date: December 10, 2024

Authors: Xi Chen¹, Zhifei Zhang², He Zhang², Yuqian Zhou², Soo Ye Kim², Qing Liu², Yijun Li², Jianming Zhang², Nanxuan Zhao², Yilin Wang², Hui Ding², Zhe Lin², Hengshuang Zhao¹

Aff.: ¹The University of Hong Kong; ²Adobe Research

Arxiv: http://arxiv.org/pdf/2412.07774v1

	EMU Edit Test set					MagicBrush Test Set
Method	$\text{CLIP}_{dir}\!\uparrow$	$\text{CLIP}_{im}\!\uparrow$	$\text{CLIP}_{out}\!\uparrow$	$\text{L1}\!\downarrow$	DINO $\uparrow$	$\text{CLIP}_{dir}\!\uparrow$	$\text{CLIP}_{im}\!\uparrow$	$\text{CLIP}_{out}\!\uparrow$	$\text{L1}\!\downarrow$	DINO $\uparrow$
InstructPix2Pix [1]	0.078	0.834	0.219	0.121	0.762	0.115	0.837	0.245	0.093	0.767
MagicBrush [69]	0.090	0.838	0.222	0.100	0.776	0.123	0.883	0.261	0.058	0.871
PnP [55]	0.028	0.521	0.089	0.304	0.153	0.025	0.568	0.101	0.289	0.220
Null-Text Inv. [35]	0.101	0.761	0.236	0.075	0.678	0.121	0.752	0.263	0.077	0.664
UltraEdit [72]	0.107	0.793	0.283	0.071	0.844	-	0.868	-	0.088	0.792
EMU Edit [48]	0.109	0.859	0.231	0.094	0.819	0.135	0.897	0.261	0.052	0.879
ACE [15]	0.086	0.895	0.274	0.076	0.862	-	-	0.284	-	-
OmniGen [60]	-	0.836	0.233	-	0.804	-	-	-	-	-
PixWizard [29]	0.104	0.845	0.248	0.069	0.798	0.124	0.884	0.265	0.063	0.876
UniReal (ours)	0.127	0.851	0.285	0.099	0.790	0.151	0.903	0.308	0.081	0.837