notesum.ai
Published at December 5HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing
cs.CV
cs.GR
Released Date: December 5, 2024
Authors: Jinbin Bai1, Wei Chow2, Ling Yang3, Xiangtai Li1, Juncheng Li2, Hanwang Zhang1, Shuicheng Yan1
Aff.: 1Skywork AI; 2National University of Singapore; 3Peking University

| Methods | L1 | L2 | CLIP-I | DINO | CLIP-T |
|---|---|---|---|---|---|
| HumanEdit-full | |||||
| InstructPix2Pix (Brooks et al., 2023) | 0.1601 | 0.0551 | 0.7716 | 0.5335 | 0.2591 |
| MGIE (Fu et al., 2023) | 0.1240 | 0.0535 | 0.8697 | 0.7221 | 0.2661 |
| HIVE SD1.5 (Zhang et al., 2024b) | 0.1014 | 0.0278 | 0.8526 | 0.7726 | 0.2777 |
| MagicBrush (Zhang et al., 2024a) | 0.0807 | 0.0298 | 0.8915 | 0.7963 | 0.2676 |
| HumanEdit-core | |||||
| InstructPix2Pix (Brooks et al., 2023) | 0.1625 | 0.0570 | 0.7627 | 0.5349 | 0.2533 |
| MGIE (Fu et al., 2023) | 0.1294 | 0.0610 | 0.8670 | 0.7359 | 0.2589 |
| HIVE SD1.5 (Zhang et al., 2024b) | 0.1162 | 0.0373 | 0.8441 | 0.7038 | 0.2563 |
| MagicBrush (Zhang et al., 2024a) | 0.0760 | 0.0283 | 0.8946 | 0.8121 | 0.2619 |