notesum.ai
Published at November 26Puzzle Similarity: A Perceptually-guided No-Reference Metric for Artifact Detection in 3D Scene Reconstructions
cs.CV
cs.AI
cs.GR
cs.LG
68T07, 68T45, 68T10
I.4; I.3; I.2
Released Date: November 26, 2024
Authors: Nicolai Hermann1, Jorge Condor1, Piotr Didyk1
Aff.: 1USI, Lugano, Switzerland

| bicycle | bonsai | counter | drjohnson | flowers | garden | kitchen | playroom | stump | train | treehill | truck | ||
| Full-Reference | L1 | 0.151 | 0.237 | 0.231 | 0.209 | 0.051 | 0.391 | 0.347 | 0.501 | 0.118 | 0.298 | 0.191 | 0.288 |
| L2 | 0.155 | 0.249 | 0.234 | 0.218 | 0.054 | 0.402 | 0.353 | 0.513 | 0.122 | 0.296 | 0.192 | 0.292 | |
| SSIM [37] | 0.160 | 0.120 | 0.252 | 0.413 | 0.244 | 0.540 | 0.273 | 0.496 | 0.279 | 0.468 | 0.402 | 0.435 | |
|
F |
0.205 | 0.335 | 0.250 | 0.272 | 0.203 | 0.466 | 0.438 | 0.564 | 0.210 | 0.294 | 0.216 | 0.365 | |
| LPIPS (vgg)) [49] | 0.093 | 0.097 | 0.081 | 0.281 | 0.207 | 0.155 | 0.138 | 0.159 | 0.051 | 0.236 | 0.099 | 0.171 | |
| LPIPS (alex)) [49] | 0.027 | 0.093 | 0.169 | 0.091 | 0.106 | 0.238 | 0.168 | 0.094 | 0.048 | 0.240 | 0.233 | 0.132 | |
| LPIPS (squeeze)) [49] | 0.057 | 0.180 | 0.158 | 0.233 | 0.137 | 0.065 | 0.162 | 0.250 | 0.167 | 0.101 | 0.133 | 0.064 | |
| FovVideoVDP [19] | 0.342 | 0.312 | 0.454 | 0.422 | 0.295 | 0.534 | 0.646 | 0.735 | 0.382 | 0.555 | 0.364 | 0.475 | |
| NR | CNNIQA [12] | 0.085 | 0.205 | 0.221 | 0.163 | 0.131 | 0.254 | 0.373 | 0.379 | 0.316 | 0.397 | 0.221 | 0.095 |
| PIQE [26] | 0.208 | 0.409 | 0.292 | 0.182 | 0.459 | 0.229 | 0.620 | 0.195 | 0.376 | 0.225 | 0.277 | 0.173 | |
| PuzzleSim (ours) | 0.468 | 0.392 | 0.382 | 0.501 | 0.428 | 0.428 | 0.658 | 0.603 | 0.306 | 0.541 | 0.548 | 0.441 |