notesum.ai

Published at December 9

cs.LG

Released Date: December 9, 2024

Authors: William T. Redman¹, Zhangyang Wang, Alessandro Ingrosso, Sebastian Goldt

Aff.: ¹UC Santa Barbara

Parameters
Architecture	3072:1024:1024:1000
Activation function	ReLU
Batch size	40
Learning rate	0.1
Optimizer	SGD
Training iterations	40,000
Rewind iteration ( $t_{\text{rewind}}$ )	1,000