notesum.ai

Published at December 6

cs.LG

Released Date: December 6, 2024

Authors: Niklas Nolte¹, Ouail Kitouni², Adina Williams, Mike Rabbat, Mark Ibrahim

Aff.: ¹FAIR at Meta; ²Massachusetts Institute of Technology

Maze Navigation	10x10	20x20	30x30
MLM- $\mathcal{U}$ 8M	$\mathbf{98.5}$	$\mathbf{95.2}$	$\mathbf{85.5}$
Next token 15M (Lehnert et al., 2024)	$93.6$	$39.0$	$13.3$
Next token 175M (Lehnert et al., 2024)	$94.9$	$53.5$	$19.3$
+ A* trace supervision
Next token 175M (Lehnert et al., 2024)	$\mathbf{98.5}$	$90.4$	$70.2$