notesum.ai
Published at December 6Decomposed Distribution Matching in Dataset Condensation
cs.CV
Released Date: December 6, 2024
Authors: Sahar Rahimi Malakshan1, Mohammad Saeed Ebrahimi Saadabadi1, Ali Dabouei1, Nasser M. Nasrabadi1
Aff.: 1University

| Dataset | IPC | Ratio% | Resolution | Coreset Selection | Training Set Synthesis | Whole Dataset | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Random | Herding [45] | Forgetting [54] | DD†[58] | DG [68] | DSA [66] | DM [67] | CAFE [57] | Ours | |||||
| CIFAR10 | 1 | 0.02 | 32 | 14.42.0 | 21.5 1.2 | 13.5 1.2 | - | 28.3 0.5 | 28.8 0.7 | 26.00.8 | 31.6 0.8 | 27.9 0.7 | 84.8 0.1 |
| 10 | 0.2 | 32 | 26.0 1.2 | 31.6 0.7 | 23.3 1.0 | 36.8 1.2 | 44.9 0.5 | 52.1 0.5 | 48.9 0.6 | 50.9 0.5 | 53.0 0.2 | ||
| 50 | 1 | 32 | 43.4 1.0 | 40.4 0.6 | 23.3 1.1 | - | 53.9 0.5 | 60.6 0.5 | 63.0 0.4 | 62.3 0.4 | 65.6 0.4 | ||
| CIFAR100 | 1 | 0.2 | 32 | 4.2 0.3 | 8.3 0.3 | 4.5 0.2 | - | 12.8 0.3 | 13.9 0.3 | 11.4 0.3 | 14.0 0.3 | 13.5 0.2 | 56.2 0.3 |
| 10 | 2 | 32 | 14.6 0.5 | 17.3 0.3 | 15.1 0.3 | - | 25.2 0.3 | 32.3 0.3 | 29.7 0.3 | 31.5 0.2 | 33.9 0.2 | ||
| 50 | 10 | 32 | 30.0 0.4 | 33.7 0.5 | - | - | 30.6 0.6 | 42.8 0.4 | 43.6 0.4 | 42.9 0.2 | 45.3 0.3 | ||
| Tiny ImageNet | 1 | 0.2 | 64 | 1.4 0.1 | 2.8 0.2 | 1.6 0.1 | - | 5.3 0.1 | 5.7 0.1 | 3.9 0.2 | - | 4.9 0.1 | 37.6 0.4 |
| 10 | 2 | 64 | 5.0 0.2 | 6.3 0.2 | 5.1 0.2 | - | 12.9 0.1 | 16.3 0.2 | 12.9 0.4 | - | 17.2 0.3 | ||
| 50 | 10 | 64 | 15.0 0.4 | 16.7 0.3 | 15.0 0.3 | - | 12.7 0.4 | 5.1 0.2 | 25.3 0.2 | - | 27.40.1 | ||
| ImageNet-1K | 1 | 0.2 | 64 | 0.50.2 | - | - | - | - | - | 1.30.2 | - | 2.10.1 | 33.8±0.3 |
| 10 | 2 | 64 | 2.90.4 | - | - | - | - | - | 5.50.4 | - | 7.51.2 | ||
| 50 | 10 | 64 | 7.11.5 | - | - | - | - | - | 11.41.2 | - | 15.60.8 | ||