notesum.ai

Published at November 22

TÜLU 3: Pushing Frontiers in Open Language Model Post-Training

cs.CL

Released Date: November 22, 2024

Authors: Nathan Lambert¹, Jacob Morrison¹, Valentina Pyatkin¹, Shengyi Huang¹, Hamish Ivison¹, Faeze Brahman¹, Lester James V. Miranda¹, Alisa Liu¹, Nouha Dziri¹, Shane Lyu, Yuling Gu¹, Saumya Malik¹, Victoria Graf¹, Jena D. Hwang¹, Jiangjiang Yang¹, Ronan Le Bras¹, Oyvind Tafjord¹, Chris Wilhelm¹, Luca Soldaini¹, Noah A. Smith¹, Yizhong Wang¹, Pradeep Dasigi¹, Hannaneh Hajishirzi¹

Aff.: ¹Allen Institute for AI

Arxiv: http://arxiv.org/abs/2411.15124v1

Model Checkpoints
Stage	Llama 3.1 8B	Llama 3.1 70B
Base Model	meta-llama/Llama-3.1-8B	meta-llama/Llama-3.1-70B
SFT	allenai/Llama-3.1-Tulu-3-8B-SFT	allenai/Llama-3.1-Tulu-3-70B-SFT
DPO	allenai/Llama-3.1-Tulu-3-8B-DPO	allenai/Llama-3.1-Tulu-3-70B-DPO
Final Models
(RLVR)	allenai/Llama-3.1-Tulu-3-8B
RM: allenai/Llama-3.1-Tulu-3-8B-RM	allenai/Llama-3.1-Tulu-3-70B