notesum.ai

Published at October 30

Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes

stat.ML
cs.AI
cs.LG
cs.NE

Released Date: October 30, 2024

Authors: Jerry Yao-Chieh Hu1, Dennis Wu1, Han Liu1

Aff.: 1Northwestern University

Arxiv: http://arxiv.org/abs/2410.23126v2