notesum.ai
Published at October 30Provably Optimal Memory Capacity for Modern Hopfield Models: Transformer-Compatible Dense Associative Memories as Spherical Codes
stat.ML
cs.AI
cs.LG
cs.NE
Released Date: October 30, 2024
Authors: Jerry Yao-Chieh Hu1, Dennis Wu1, Han Liu1
Aff.: 1Northwestern University

| Method | Tiger | Elephant | Fox | UCSB |
| Modern Hopfield | ||||
| Modern Hopfield + + | ||||
| Sparse Hopfield | ||||
| Sparse Hopfield + + |