notesum.ai

Published at November 7

PhoneLM:an Efficient and Capable Small Language Model Family through Principled Pre-training

cs.CL
cs.AI
cs.LG

Released Date: November 7, 2024

Authors: Rongjie Yi1, Xiang Li1, Weikai Xie1, Zhenyan Lu1, Chenghua Wang1, Ao Zhou1, Shangguang Wang1, Xiwen Zhang2, Mengwei Xu1

Aff.: 1Institution 1; 2Institution 2

Arxiv: http://arxiv.org/abs/2411.05046v1