notesum.ai

Published at November 11

PDC & DM-SFT: A Road for LLM SQL Bug-Fix Enhancing

cs.CL

cs.AI

cs.LG

Released Date: November 11, 2024

Authors: Yiwen Duan¹, Yonghong Yu¹, Xiaoming Zhao¹, Yichang Wu¹, Wenbo Liu¹

Aff.: ¹Bytedance Inc.

Arxiv: http://arxiv.org/abs/2411.06767v1

Refer to caption

Method	Model	Size	Acc
Pretrain	gemma	7B	$20.1\%$
	StarCoderBase	7B	$20.8\%$
	StarCoder2	7B	$22.5\%$
	CodeQwen1.5-Chat	7B	$27.8\%$
	DeepSeek-Coder-instruct	6.7B	$28.5\%$
	DeepSeek-Coder-instruct	33B	$29.8\%$
	DeepSeek-Coder-V2-Lite-Instruct(MOE)	16B	$28.8\%$
	WizardCoder-V1.1	33 B	$29.7\%$
	internal code LLM	*	$40.5\%$
SFT	gemma	7B	$29.0\%$
	StarCoderBase	7B	$32.6\%$
	CodeQwen1.5-Chat	7B	$42.6\%$
	DeepSeek-Coder-instruct	6.7B	$43.8\%$
	DeepSeek-Coder-V2-Lite-Instruct(MOE)	16B	$43.9\%$
	internal code LLM	*	$46.6\%$
DM-SFT	CodeQwen1.5-Chat	7B	$49.3\%$
	DeepSeek-Coder-instruct	6.7B	$49.8\%$
	DeepSeek-Coder-V2-Lite-Instruct(MOE)	16B	$49.7\%$