notesum.ai

Published at December 9

Integrating Expert Labels into LLM-based Emission Goal Detection: Example Selection vs Automatic Prompt Design

cs.LG

cs.CL

I.2.7

Released Date: December 9, 2024

Authors: Marco Wrzalik¹, Adrian Ulges¹, Anne Uersfeld¹, Florian Faust²

Aff.: ¹RheinMain University of Applied Sciences; ²Sociovestix Labs

Arxiv: http://arxiv.org/pdf/2412.06432v1

	Instruction
	Simple				Expert
Examples	Acc	Prec	Rec	F1	Acc	Prec	Rec	F1
Zero-shot	56.2	52.2	100.0	68.6	81.2	77.1	86.1	81.4
Static	72.3	63.8	97.0	77.0	82.0	90.8	69.4	78.7
Random	66.2	58.9	98.6	73.7	80.5	75.7	89.5	81.5
Similar	69.8	62.3	92.9	74.6	87.0	87.2	85.4	86.3