notesum.ai

Published at November 11

Slowing Down Forgetting in Continual Learning

cs.LG

cs.AI

cs.CV

Released Date: November 11, 2024

Authors: Pascal Janetzky¹, Tobias Schlagenhauf², Stefan Feuerriegel³

Aff.: ¹Bosch Center for Artificial Intelligence, Munich Center for Machine Learning; ²Bosch Center for Artificial Intelligence; ³Munich Center for Machine Learning & LMU Munich

Arxiv: http://arxiv.org/abs/2411.06916v1

Method	SplitMNIST		SplitCIFAR10
	ACC	BWT	ACC	BWT
Default	$29.35$	$-70.35$	$14.80$	$-66.28$
Default+ReCL	$50.04$	$-41.79$	$15.24$	$-64.45$
Default+ReCL (unsup.)	$52.80$	$-9.51$	$18.25$	$-55.90$
Default+ReCL (sup.)	$53.49$	$-32.63$	$16.25$	$-56.92$
EWC	$41.65$	$-53.35$	$13.85$	$-53.76$
EWC+ReCL	61.61	$-24.44$	16.39	$-41.85$
ER	$71.41$	$-15.66$	$18.85$	$-47.16$
ER+ReCL	71.85	$-11.36$	20.29	$-33.85$
UPGD	$66.71$	$-24.72$	$18.12$	$-48.00$
UPGD+ReCL	68.85	$-20.83$	19.11	$-45.84$