notesum.ai

Published at November 15

Memorization in Attention-only Transformers

cs.AI

cs.CL

Released Date: November 15, 2024

Authors: Léo Dana¹, Muni Sreenivas Pydi¹, Yann Chevaleyre¹

Aff.: ¹MILES, Paris-Dauphine University

Arxiv: http://arxiv.org/abs/2411.10115v1