notesum.ai

Published at November 4

cs.CL

cs.AI

Released Date: November 4, 2024

Authors: Sorouralsadat Fatemi¹, Yuheng Hu¹, Maryam Mousavi²

Aff.: ¹University of Illinois at Chicago, USA; ²Arizona State University, USA

Model	# example	FPB		FiQA-SA		Headline-Dir	FOMC
Model	# example	Acc	F1	Acc	F1	F1	F1
Llama3-8B	One-shot	75.5	75.1	72.5	74.8	89.1	52.8
	Five-shot	72.7	73.4	73.3	74.4	88.7	53.2
	ten-shot	68.9	70.5	66.1	74.7	88.1	53.6
Mistral-7B	One-shot	74.8	72.7	48.4	57.3	86.5	59.6
	Five-shot	74.9	71.4	47.9	54.1	85.6	54.1
	ten-shot	68.5	69.9	37.1	53.4	84.5	49.9
Phi-3-mini	One-shot	58.8	58.6	60.4	59.5	88.6	52.9
	Five-shot	49.8	47.7	53.6	47.	87.3	46.1
	ten-shot	26.5	51.2	51.3	49.5	81.1	39.3