notesum.ai

Published at December 6

Decomposed Distribution Matching in Dataset Condensation

cs.CV

Released Date: December 6, 2024

Authors: Sahar Rahimi Malakshan¹, Mohammad Saeed Ebrahimi Saadabadi¹, Ali Dabouei¹, Nasser M. Nasrabadi¹

Aff.: ¹University

Arxiv: http://arxiv.org/pdf/2412.04748v1

Refer to caption

Dataset	IPC	Ratio%	Resolution	Coreset Selection			Training Set Synthesis						Whole Dataset
Dataset	IPC	Ratio%	Resolution	Random	Herding [45]	Forgetting [54]	DD^†[58]	DG [68]	DSA [66]	DM [67]	CAFE [57]	Ours	Whole Dataset
CIFAR10	1	0.02	32	14.4 $\pm$ 2.0	21.5 $\pm$ 1.2	13.5 $\pm$ 1.2	-	28.3 $\pm$ 0.5	28.8 $\pm$ 0.7	26.0 $\pm$ 0.8	31.6 $\pm$ 0.8	27.9 $\pm$ 0.7	84.8 $\pm$ 0.1
	10	0.2	32	26.0 $\pm$ 1.2	31.6 $\pm$ 0.7	23.3 $\pm$ 1.0	36.8 $\pm$ 1.2	44.9 $\pm$ 0.5	52.1 $\pm$ 0.5	48.9 $\pm$ 0.6	50.9 $\pm$ 0.5	53.0 $\pm$ 0.2
	50	1	32	43.4 $\pm$ 1.0	40.4 $\pm$ 0.6	23.3 $\pm$ 1.1	-	53.9 $\pm$ 0.5	60.6 $\pm$ 0.5	63.0 $\pm$ 0.4	62.3 $\pm$ 0.4	65.6 $\pm$ 0.4
CIFAR100	1	0.2	32	4.2 $\pm$ 0.3	8.3 $\pm$ 0.3	4.5 $\pm$ 0.2	-	12.8 $\pm$ 0.3	13.9 $\pm$ 0.3	11.4 $\pm$ 0.3	14.0 $\pm$ 0.3	13.5 $\pm$ 0.2	56.2 $\pm$ 0.3
	10	2	32	14.6 $\pm$ 0.5	17.3 $\pm$ 0.3	15.1 $\pm$ 0.3	-	25.2 $\pm$ 0.3	32.3 $\pm$ 0.3	29.7 $\pm$ 0.3	31.5 $\pm$ 0.2	33.9 $\pm$ 0.2
	50	10	32	30.0 $\pm$ 0.4	33.7 $\pm$ 0.5	-	-	30.6 $\pm$ 0.6	42.8 $\pm$ 0.4	43.6 $\pm$ 0.4	42.9 $\pm$ 0.2	45.3 $\pm$ 0.3
Tiny ImageNet	1	0.2	64	1.4 $\pm$ 0.1	2.8 $\pm$ 0.2	1.6 $\pm$ 0.1	-	5.3 $\pm$ 0.1	5.7 $\pm$ 0.1	3.9 $\pm$ 0.2	-	4.9 $\pm$ 0.1	37.6 $\pm$ 0.4
	10	2	64	5.0 $\pm$ 0.2	6.3 $\pm$ 0.2	5.1 $\pm$ 0.2	-	12.9 $\pm$ 0.1	16.3 $\pm$ 0.2	12.9 $\pm$ 0.4	-	17.2 $\pm$ 0.3
	50	10	64	15.0 $\pm$ 0.4	16.7 $\pm$ 0.3	15.0 $\pm$ 0.3	-	12.7 $\pm$ 0.4	5.1 $\pm$ 0.2	25.3 $\pm$ 0.2	-	27.4 $\pm$ 0.1
ImageNet-1K	1	0.2	64	0.5 $\pm$ 0.2	-	-	-	-	-	1.3 $\pm$ 0.2	-	2.1 $\pm$ 0.1	33.8±0.3
	10	2	64	2.9 $\pm$ 0.4	-	-	-	-	-	5.5 $\pm$ 0.4	-	7.5 $\pm$ 1.2
	50	10	64	7.1 $\pm$ 1.5	-	-	-	-	-	11.4 $\pm$ 1.2	-	15.6 $\pm$ 0.8