notesum.ai

Published at December 10

cs.IR

cs.AI

Released Date: December 10, 2024

Authors: Weizhen Bian¹, Siyan Liu², Yubo Zhou³, Dezhi Chen³, Yijie Liao³, Zhenzhen Fan², Aobo Wang²

Aff.: ¹Hong Kong University of Science and Technology; ²National University of Singapore; ³Hong Kong Baptist University

Model	Actions	BLEU	ROUGE-1	ROUGE-2	ROUGE-L	METEOR
Llama2-7B	fine-tune	0.0	0.1423	0.0072	0.0983	0.1423
Llama2-13B	fine-tune	0.0919	0.2050	0.0418	0.1430	0.3309
Gemma2-2B	fine-tune	0.1933	0.2821	0.0951	0.2052	0.4720
Mistral-7B	fine-tune	0.0989	0.2079	0.1258	0.1759	0.4352
Gpt-3.5-turbo	zero-shot	0.0	0.2125	0.0287	0.1949	0.1311
Gpt-3.5-turbo	one-shot	0.1562	0.3066	0.0605	0.2252	0.4966
Gpt-3.5-turbo	few-shot	0.4445	0.6058	0.4517	0.5554	0.7155
Gpt-3.5-turbo	fine-tune	0.9269	0.9413	0.9160	0.9355	0.9553