notesum.ai
Published at November 22Evaluating Vision Transformer Models for Visual Quality Control in Industrial Manufacturing
cs.CV
cs.AI
Released Date: November 22, 2024
Authors: Miriam Alber1, Christoph Hönes2, Patrick Baier3
Aff.: 1iteratec GmbH Karlsruhe, Germany; 2Hasso Plattner Institute / University of Potsdam, Germany; 3University of Applied Sciences Karlsruhe, Germany

| architecture | nf i11 | nf i7 | gmm | vt-adl | FastFlow | ||||
| dataclass | ad | al | ad | al | ad | al | al | ad | al(auroc) |
| bottle | 99.84 | 85.95 | 98.57 | 93.64 | 98.49 | 45.24 | 94.90 | 100.00 | 97.70 |
| cable | 94.42 | 94.68 | 81.73 | 84.87 | 61.94 | 78.03 | 77.60 | 100.00 | 98.40 |
| capsule | 92.94 | 93.42 | 92.82 | 95.04 | 82.69 | 93.69 | 67.20 | 100.00 | 99.10 |
| carpet | 96.07 | 95.92 | 87.40 | 87.40 | 97.11 | 97.06 | 77.30 | 100.00 | 99.40 |
| grid | 98.08 | 93.79 | 96.66 | 96.11 | 76.44 | 71.21 | 87.10 | 99.70 | 98.30 |
| hazelnut | 98.46 | 95.81 | 87.18 | 93.06 | 65.43 | 96.86 | 89.70 | 100.00 | 99.10 |
| leather | 100.00 | 88.10 | 99.97 | 98.83 | 98.37 | 98.62 | 72.80 | 100.00 | 99.50 |
| metal nut | 99.71 | 92.98 | 87.93 | 88.69 | 60.95 | 84.54 | 72.60 | 100.00 | 98.50 |
| pill | 92.17 | 94.25 | 81.29 | 90.83 | 69.01 | 91.35 | 70.50 | 99.40 | 99.20 |
| screw | 86.53 | 95.96 | 77.09 | 84.00 | 52.43 | 46.37 | 92.80 | 97.80 | 99.40 |
| tile | 99.96 | 91.43 | 96.03 | 93.47 | 92.50 | 90.38 | 79.60 | 100.00 | 96.30 |
| toothbrush | 90.83 | 93.50 | 88.61 | 95.24 | 95.56 | 95.84 | 90.10 | 94.40 | 98.90 |
| transistor | 95.71 | 96.52 | 88.21 | 93.29 | 76.83 | 92.31 | 79.60 | 99.80 | 97.30 |
| wood | 92.46 | 87.73 | 98.25 | 93.86 | 93.33 | 90.66 | 78.10 | 100.00 | 97.00 |
| zipper | 96.68 | 90.91 | 92.67 | 97.31 | 79.28 | 95.81 | 80.80 | 99.50 | 98.70 |
| mean | 95.59 | 92.73 | 90.29 | 92.38 | 80.02 | 84.53 | 80.71 | 99.37 | 98.45 |
| std | 4.00 | 3.28 | 6.92 | 4.38 | 15.49 | 17.41 | 8.18 | 1.44 | 0.94 |