notesum.ai
Published at December 10Unlocking the Potential of Reverse Distillation for Anomaly Detection
cs.CV
Released Date: December 10, 2024
Authors: Xinyue Liu1, Jianyuan Wang2, Biao Leng1, Shuo Zhang3
Aff.: 1Beihang University; 2University of Science and Technology Beijing; 3Beijing Jiaotong University
| Category | Forward Distillation | Reverse Distillation | |||||||
| STPM | DeSTSeg | HypAD | RD | RD++ | THFR | MemKD | Ours | ||
| Textures | Carpet | 98.8/-/95.8 | 96.1/72.8/93.6 | -/-/92.7 | 99.3/67.2/97.9 | 99.2/63.9/97.7 | 99.2/-/97.7 | 99.1/-/97.5 | 99.6/83.0/98.3 |
| Grid | 99.0/-/96.6 | 99.1/61.5/96.4 | -/-/99.7 | 99.3/50.2/97.7 | 99.3/49.5/97.7 | 99.3/-/97.7 | 99.2/-/96.9 | 99.4/50.1/97.5 | |
| Leather | 99.3/-/98.0 | 99.7/75.6/99.0 | -/-/99.9 | 99.5/52.6/99.2 | 99.4/51.4/99.2 | 99.4/-/99.2 | 99.5/-/99.2 | 99.7/70.0/99.3 | |
| Tile | 97.4/-/92.1 | 98.0/90.0/95.5 | -/-/99.8 | 95.8/53.8/91.1 | 96.4/56.2/92.1 | 95.5/-/90.8 | 95.7/-/91.1 | 99.2/94.8/96.8 | |
| Wood | 97.2/-/93.6 | 97.7/81.9/96.1 | -/-/95.3 | 95.3/51.5/93.2 | 95.7/51.8/93.2 | 95.3/-/93.3 | 95.3/-/91.2 | 98.1/80.2/95.2 | |
| Average | 98.3/-/95.2 | 98.1/76.4/96.1 | -/-/97.5 | 97.8/55.1/95.8 | 98.0/54.6/96.0 | 97.7/-/95.7 | 97.8/-/95.2 | 99.2/75.6/97.4 | |
| Objects | Bottle | 98.8/-/95.1 | 99.2/90.3/96.6 | -/-/100 | 98.8/78.4/96.9 | 98.7/80.0/96.9 | 98.9/-/97.2 | 98.8/-/97.1 | 99.3/91.6/97.9 |
| Cable | 95.5/-/87.7 | 97.3/60.4/86.4 | -/-/93.3 | 97.8/59.6/92.6 | 98.4/63.6/93.9 | 98.5/-/94.8 | 98.3/-/93.4 | 98.7/73.1/94.9 | |
| Capsule | 98.3/-/92.2 | 99.1/56.3/94.2 | -/-/96.9 | 98.8/46.6/96.4 | 98.9/47.4/96.5 | 98.7/-/95.9 | 98.8/-/96.2 | 98.9/50.5/96.8 | |
| Hazelnut | 98.5/-/94.3 | 99.6/88.4/97.6 | -/-/99.7 | 99.2/67.9/96.0 | 99.2/66.5/96.3 | 99.2/-/96.2 | 99.1/-/95.7 | 99.2/68.0/96.1 | |
| Metal_nut | 97.6/-/94.5 | 98.6/93.5/95.0 | -/-/98.0 | 97.5/81.8/93.3 | 98.0/83.9/93.2 | 97.4/-/90.5 | 97.2/-/90.8 | 98.4/83.7/93.7 | |
| Pill | 97.8/-/96.5 | 98.7/83.1/95.3 | -/-/98.4 | 98.4/80.2/96.9 | 98.4/79.6/97.1 | 98.0/-/96.4 | 98.3/-/96.6 | 98.7/83.7/97.5 | |
| Screw | 98.3/-/93.0 | 98.5/58.7/92.5 | -/-/95.6 | 99.6/54.9/98.4 | 99.6/55.5/98.3 | 99.5/-/98.2 | 99.6/-/98.2 | 99.6/48.8/98.3 | |
| Toothbrush | 98.9/-/92.2 | 99.3/75.2/94.0 | -/-/99.9 | 99.1/53.1/94.6 | 99.1/56.3/94.5 | 99.2/-/94.7 | 98.9/-/92.2 | 99.3/68.5/95.5 | |
| Transistor | 82.5/-/69.5 | 89.1/64.8/85.7 | -/-/100 | 93.1/55.9/79.6 | 94.4/58.3/82.8 | 95.9/-/85.9 | 96.4/-/85.3 | 97.5/70.3/90.2 | |
| Zipper | 98.5/-/95.2 | 99.1/85.2/97.4 | -/-/94.7 | 98.9/61.5/96.8 | 98.9/60.5/96.4 | 98.7/-/96.6 | 98.5/-/95.9 | 98.9/69.3/96.8 | |
| Average | 96.5/-/90.9 | 97.9/75.6/93.5 | -/-/97.6 | 98.1/64.0/94.2 | 98.4/65.2/94.6 | 98.4/-/94.6 | 98.4/-/94.1 | 98.9/70.8/95.8 | |
| Total Average | 97.0/-/92.1 | 97.9/75.8/94.4 | 98.0/62.5/97.6 | 98.0/61.0/94.7 | 98.2/61.6/95.1 | 98.2/-/95.0 | 98.2/-/94.5 | 99.0/72.4/96.3 | |