notesum.ai

Published at May 3

Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes

NeurIPS

Released Date: May 3, 2024

Authors: Jerry Yao-Chieh Hu¹, Dennis Wu², Han Liu³

Aff.: ¹Center for Foundation Models and Generative AI, Northwestern University; ²Department of Computer Science, Northwestern University; ³Department of Statistics and Data Science, Northwestern University

Arxiv: https://openreview.net/pdf/2eee4be25f04c74ba579dfea968160c3429a3d4d.pdf