notesum.ai

Published at April 30

NeurIPS

Released Date: April 30, 2024

Authors: Andrea Schioppa¹

Aff.: ¹Google DeepMind, Amsterdam, the Netherlands

Model	layer	r	eig. err.
GPT-2	Tok. Emb.	0.16	0.72
GPT-2	1	0.75	0.24
GPT-2	2	0.89	0.31
GPT-2	3	0.90	0.19
GPT-2	4	0.89	0.24
GPT-2	5	0.78	0.37
GPT-2	6	0.38	0.40