notesum.ai

Published at October 31

cs.LG

cs.AI

cs.NE

q-bio.NC

Released Date: October 31, 2024

Authors: Quentin Guilhot¹, Jascha Achterberg², Michał Wójcik, Rui Ponte Costa³

Aff.: ¹ETH Zurich; ²CentraleSupelec, University of Oxford; ³University of Oxford

METRIC	UNTRAINED	MASTER & FROZEN	PARTIAL PRETRAINING	FULL PRETRAINING & UNFROZEN
DSA	$2.5\times 10^{-10}$	$3.2\times 10^{-4}$	$1.6\times 10^{-2}$	$1.5\times 10^{-1}$
CKA	$9.2\times 10^{-1}$	$9.2\times 10^{-1}$	$9.2\times 10^{-1}$	$9.6\times 10^{-1}$
Procrustes	$7.1\times 10^{-1}$	$9.3\times 10^{-1}$	$8.7\times 10^{-1}$	$9.3\times 10^{-1}$