notesum.ai

Published at October 30

Decoupling Semantic Similarity from Spatial Alignment for Neural Networks

cs.CV

cs.AI

cs.LG

Released Date: October 30, 2024

Authors: Tassilo Wald¹, Constantin Ulrich¹, Gregor Köhler¹, David Zimmerer¹, Stefan Denner¹, Michael Baumgartner¹, Fabian Isensee¹, Priyank Jaini², Klaus H. Maier-Hein¹

Aff.: ¹German Cancer Research Center (DKFZ), Heidelberg, Germany; ²Google Deepmind

Arxiv: http://arxiv.org/abs/2410.23107v1

	Pearson Correlation $\rho$
Architectures	Cosine Sim.		Inner Product		RBF
	-	(ours) PI	-	(ours) PI	-	(ours) PI
ResNet18	-0.276	-0.326	-0.259	-0.270	-0.176	-0.199
ResNet50	-0.248	-0.291	-0.243	-0.261	0.040	0.029
ResNet101	-0.192	-0.276	-0.174	-0.240	0.091	0.084
ConvNextV2-Base	-0.134	-0.098	-0.132	-0.171	0.117	0.090
ViT-B/16	-0.046	-0.100	-0.045	-0.026	-0.077	-0.122
ViT-L/32	-0.138	-0.188	-0.138	-0.144	-0.134	-0.166
DinoV2-Giant	-0.012	-0.044	-0.013	-0.031	-0.008	-0.048