notesum.ai
Published at November 3Stochastic Communication Avoidance for Recommendation Systems
cs.DC
cs.AI
cs.CV
cs.IR
cs.LG
Released Date: November 3, 2024
Authors: Lutfi Eren Erdogan1, Vijay Anand Raghava Kanakagiri2, Kurt Keutzer1, Zhen Dong1
Aff.: 1University of California, Berkeley; 2Texas A&M University

| Method | One Iteration (s) | One | |||
| Fwd | Bckwd | Optzn | Total | Epoch(m) | |
| CPU-only | 12.05 | 15.1 | 41.94 | 69.09 | 38.03 |
| CPU-GPU baseline | 20.37 | 19.14 | 54.17 | 93.68 | 46.12 |
| SCARS (ours) | 50.88 | 5.36 | 0.41 | 56.65 | 27.12 |
| Note: Fwd, Bckwd, Optzn means Forward, Backward, Optimization | |||||