notesum.ai

Published at October 23

Bonsai: Gradient-free Graph Distillation for Node Classification

cs.AI

cs.CV

cs.MA

Released Date: October 23, 2024

Authors: Mridul Gupta¹, Samyak Jain², Vansh Ramani², Hariprasad Kodamana³, Sayan Ranu²

Aff.: ¹Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi; ²Department of Computer Science, Indian Institute of Technology Delhi; ³Department of Chemical Engineering, Indian Institute of Technology Delhi

Arxiv: https://arxiv.org/abs/2410.17579v1

Dataset	$\mathbf{S_{r}(\%)}$	Random	Herding	GCond	GDEM	GCSR	Bonsai	Full
	0.5	$39.90{\scriptstyle\pm 1.46}$	$45.61{\scriptstyle\pm 0.01}$	$77.30{\scriptstyle\pm 0.30}$	$57.49{\scriptstyle\pm 6.87}$	$74.83{\scriptstyle\pm 0.75}$	$83.95{\scriptstyle\pm 0.39}$
Cora	1	$27.75{\scriptstyle\pm 2.05}$	$52.07{\scriptstyle\pm 0.00}$	$77.30{\scriptstyle\pm 0.31}$	$69.32{\scriptstyle\pm 4.71}$	$77.56{\scriptstyle\pm 0.74}$	$85.76{\scriptstyle\pm 0.24}$	$88.56{\scriptstyle\pm 0.18}$
	3	$52.26{\scriptstyle\pm 1.69}$	$67.60{\scriptstyle\pm 0.00}$	$81.73{\scriptstyle\pm 0.48}$	$81.70{\scriptstyle\pm 3.10}$	$77.20{\scriptstyle\pm 0.48}$	$86.38{\scriptstyle\pm 0.22}$
	0.5	$33.90{\scriptstyle\pm 2.16}$	$22.82{\scriptstyle\pm 0.00}$	$74.17{\scriptstyle\pm 0.68}$	$70.05{\scriptstyle\pm 2.40}$	$67.03{\scriptstyle\pm 0.61}$	$77.00{\scriptstyle\pm 0.15}$
CiteSeer	1	$44.90{\scriptstyle\pm 2.32}$	$49.10{\scriptstyle\pm 0.02}$	$77.62{\scriptstyle\pm 0.71}$	$72.48{\scriptstyle\pm 2.13}$	$74.77{\scriptstyle\pm 0.78}$	$77.03{\scriptstyle\pm 0.33}$	$78.53{\scriptstyle\pm 0.15}$
	3	$44.50{\scriptstyle\pm 1.27}$	$67.69{\scriptstyle\pm 0.01}$	$77.02{\scriptstyle\pm 0.22}$	$76.20{\scriptstyle\pm 0.55}$	$77.27{\scriptstyle\pm 0.28}$	$75.89{\scriptstyle\pm 0.26}$
	0.5	$62.58{\scriptstyle\pm 0.25}$	$78.29{\scriptstyle\pm 0.00}$	$80.63{\scriptstyle\pm 1.20}$	$80.72{\scriptstyle\pm 0.92}$	$79.43{\scriptstyle\pm 0.25}$	$87.27{\scriptstyle\pm 0.03}$
Pubmed	1	$79.19{\scriptstyle\pm 0.09}$	$78.59{\scriptstyle\pm 0.00}$	$79.92{\scriptstyle\pm 0.00}$	$80.80{\scriptstyle\pm 1.07}$	$79.11{\scriptstyle\pm 0.15}$	$87.08{\scriptstyle\pm 0.04}$	$87.22{\scriptstyle\pm 0.00}$
	3	$82.50{\scriptstyle\pm 0.09}$	$78.09{\scriptstyle\pm 0.00}$	$77.00{\scriptstyle\pm 0.15}$	$81.07{\scriptstyle\pm 0.90}$	$79.94{\scriptstyle\pm 0.16}$	$87.64{\scriptstyle\pm 0.09}$
	0.5	$44.78{\scriptstyle\pm 0.00}$	$47.98{\scriptstyle\pm 0.01}$	$44.06{\scriptstyle\pm 1.05}$	$46.25{\scriptstyle\pm 1.02}$	$46.41{\scriptstyle\pm 0.00}$	$48.73{\scriptstyle\pm 0.27}$
Flickr	1	$44.21{\scriptstyle\pm 0.03}$	$46.72{\scriptstyle\pm 0.01}$	$39.88{\scriptstyle\pm 5.60}$	$46.99{\scriptstyle\pm 1.38}$	OOT ( $5\,\text{hrs}$ )	$49.05{\scriptstyle\pm 0.17}$	$50.93{\scriptstyle\pm 0.17}$
	3	$46.56{\scriptstyle\pm 0.01}$	$46.54{\scriptstyle\pm 0.01}$	$46.04{\scriptstyle\pm 1.88}$	$47.35{\scriptstyle\pm 0.98}$	OOT	$49.66{\scriptstyle\pm 0.27}$
	0.5	$42.01{\scriptstyle\pm 0.01}$	$53.37{\scriptstyle\pm 0.00}$	$52.63{\scriptstyle\pm 0.63}$	$54.73{\scriptstyle\pm 0.66}$	OOT	$58.49{\scriptstyle\pm 0.17}$
Ogbn-arxiv	1	$49.27{\scriptstyle\pm 0.64}$	$54.91{\scriptstyle\pm 0.00}$	$53.49{\scriptstyle\pm 0.63}$	$51.45{\scriptstyle\pm 1.14}$	OOT	$58.35{\scriptstyle\pm 0.09}$	$68.97{\scriptstyle\pm 0.10}$
	3	$51.11{\scriptstyle\pm 0.19}$	$57.28{\scriptstyle\pm 0.00}$	$53.01{\scriptstyle\pm 0.64}$	$53.37{\scriptstyle\pm 1.04}$	OOT	$64.31{\scriptstyle\pm 0.06}$
	0.5	$36.00{\scriptstyle\pm 4.09}$	OOT	$38.94{\scriptstyle\pm 0.79}$	$90.51{\scriptstyle\pm 0.55}$	OOT	$80.33{\scriptstyle\pm 0.46}$
Reddit	1	$38.55{\scriptstyle\pm 2.00}$	OOT	$43.98{\scriptstyle\pm 0.35}$	$90.63{\scriptstyle\pm 0.84}$	OOT	$85.65{\scriptstyle\pm 0.08}$	$92.14{\scriptstyle\pm 0.04}$
	3	$44.97{\scriptstyle\pm 2.97}$	OOT	$48.78{\scriptstyle\pm 0.83}$	$85.75{\scriptstyle\pm 0.80}$	OOT	$88.90{\scriptstyle\pm 0.07}$