notesum.ai

Published at October 23

cs.CL

cs.AI

stat.ML

Released Date: October 23, 2024

Authors: Katharina Flügel¹, Daniel Coquelin¹, Marie Weiel¹, Achim Streit¹, Markus Götz¹

Aff.: ¹Scientific Computing Center, Karlsruhe Institute of Technology

		ResNet18		VisionTransformer
	$k$	MNIST	CIFAR10	MNIST	CIFAR10
$\nabla f$	–	$0.68$	$47.29$	$2.36$	$46.38$
$g_{v}$	1	$4.13$	$63.63$	$60.53$	$71.10$
\arrayrulecolorlightgray\arrayrulecolorblack $\overline{g_{V}}$	2	$4.32$	$60.77$	$50.73$	$69.49$
$\overline{g_{V}}$	4	$2.98$	$55.87$	$44.57$	$66.98$
$\overline{g_{V}}$	16	$1.86$	$49.35$	$36.06$	$63.68$
\arrayrulecolorlightgray\arrayrulecolorblack $P_{U}$	2	$3.33$	$58.14$	$49.11$	$68.12$
$P_{U}$	4	$3.14$	$55.24$	$44.08$	$65.72$
$P_{U}$	16	$1.84$	$47.24$	$42.60$	$61.07$