notesum.ai

Published at October 31

cs.LG

cs.AI

cs.NE

q-bio.NC

Released Date: October 31, 2024

Authors: Quentin Guilhot¹, Michał Wójcik, Jascha Achterberg², Rui Ponte Costa²

Aff.: ¹Department of Computer Science, ETH Zurich, Switzerland; ²Centre for Neural Circuits and Behaviour, University of Oxford, UK

METRIC	UNTRAINED	MASTER & FROZEN	PARTIAL PRETRAINING	FULL PRETRAINING & UNFROZEN
DSA	$2.2\times 10^{-7}$	$3.4\times 10^{-3}$	$4.6\times 10^{-2}$	$1.9\times 10^{-1}$
CKA	$9.6\times 10^{-1}$	$9.6\times 10^{-1}$	$9.6\times 10^{-1}$	$9.6\times 10^{-1}$
Procrustes	$8.9\times 10^{-1}$	$8.9\times 10^{-1}$	$8.9\times 10^{-1}$	$8.9\times 10^{-1}$