notesum.ai

Published at November 11

cs.AI

cs.CE

Released Date: November 11, 2024

Authors: Botao Yu¹, Frazier N. Baker, Ziru Chen¹, Garrett Herb¹, Boyu Gou¹, Daniel Adu-Ampratwum², Xia Ning³, Huan Sun¹

Aff.: ¹Department of Computer Science and Engineering, OSU; ²College of Pharmacy, OSU; ³Department of Biomedical Informatics, OSU

Model	NC-S2I	PP-SIDER	FS	RS
Model	EM	Acc	EM	EM
GPT-4o	$0.0$	$44.0$	$12.0$	$0.0$
Claude-3.5-Sonnet	$2.0$	$62.0$	$22.0$	$0.0$
ChemCrow (GPT)	$2.0$	$36.0$	$72.0$	$8.0$
ChemCrow (Claude)	$2.0$	$32.0$	$70.0$	$22.0$
ChemAgent (GPT)	$70.0$	$70.0$	$78.0$	$42.0$
ChemAgent (Claude)	$70.0$	$68.0$	$80.0$	$42.0$