notesum.ai

Published at December 3

cs.AI

Released Date: December 3, 2024

Authors: Nader Karayanni¹, Aya Awwad², Chein-Lien Hsiao, Surish P Shanmugam²

Aff.: ¹Columbia University; ²Harvard Medical School

	Macro F1-Score	Macro Precision	Macro Recall	Accuracy
Human prompt	0.735	0.753	0.865	0.730
DSPy CoT classifier	0.962	0.953	0.972	0.981
DSPy Optimized	0.980	0.982	0.978	0.991
P₁	0.973	0.961	0.988	0.988
P₂	0.986	0.981	0.990	0.995