notesum.ai

Published at December 6

Building a Family of Data Augmentation Models for Low-cost LLM Fine-tuning on the Cloud

cs.CL

Released Date: December 6, 2024

Authors: Yuanhao Yue¹, Chengyu Wang², Jun Huang², Peng Wang¹

Aff.: ¹Fudan University; ²Alibaba Cloud Computing

Arxiv: http://arxiv.org/pdf/2412.04871v1

Refer to caption

Model	Math	Impl.
Qwen2-1.5B-Instruct	57.90%	28.96%
+ Qwen2-1.5B-Instruct-Exp	59.15%	31.22%
+ Qwen2-7B-Instruct-Exp	58.32%	39.37%
Qwen2-7B-Instruct	71.40%	28.85%
+ Qwen2-1.5B-Instruct-Exp	73.90%	35.41%
+ Qwen2-7B-Instruct-Exp	72.53%	32.92%