notesum.ai

Published at December 6

Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora

cs.CL

Released Date: December 6, 2024

Authors: Michael Y. Hu¹, Aaron Mueller², Candace Ross³, Adina Williams³, Tal Linzen¹, Chengxu Zhuang⁴, Ryan Cotterell⁵, Leshem Choshen⁶, Alex Warstadt⁷, Ethan Gotlieb Wilcox⁵

Aff.: ¹New York University; ²Northeastern University; ³Meta AI; ⁴MIT; ⁵Georgetown University; ⁶IBM Research; ⁷ETH Zürich

Arxiv: http://arxiv.org/pdf/2412.05149v1

	# Models	# Participants
Multimodal	8	3
Strict-Small	35	18
Strict	19	11
Total	64	31