notesum.ai
Published at November 6No Culture Left Behind: ArtELingo-28, a Benchmark of WikiArt with Captions in 28 Languages
cs.CL
cs.AI
cs.CY
cs.LG
Released Date: November 6, 2024
Authors: Youssef Mohamed1, Runjia Li2, Ibrahim Said Ahmad3, Kilichbek Haydarov1, Philip Torr2, Kenneth Ward Church3, Mohamed Elhoseiny1
Aff.: 1KAUST; 2University of Oxford; 3Northeastern University

| Models | BLEU-4 | METEOR | ROUGE | CIDEr |
|---|---|---|---|---|
| InstructBlip | 0.54 | 3.03 | 5.83 | 0.05 |
| ClipCap | 0.18 | 0.29 | 0.23 | 0.02 |
| mBlip | 0.23 | 0.32 | 0.73 | 0.04 |
| MiniGPT-4 | 1.09 | 5.8 | 8.47 | 0.33 |
| CCLM | 0.01 | 0.05 | 0.02 | 0.00 |