notesum.ai

Published at November 14

cs.CL

cs.AI

Released Date: November 14, 2024

Authors: Haoran Wang¹, Aman Rangapur¹, Xiongxiao Xu¹, Yueqing Liang¹, Haroon Gharwi¹, Carl Yang², Kai Shu²

Aff.: ¹Illinois Institute of Technology; ²Emory University

Model	Method	1-hop	2-hop	3-hop	4-hop
Gemini 1.5	CoT	78.52	69.66	67.45	70.24
	Self-Ask	75.47	66.58	60.94	70.67
	Symbolic	74.89	63.82	54.61	72.36
GPT4-o	CoT	80.43	83.33	71.20	72.99
	Self-Ask	77.42	80.12	70.52	75.23
	Symbolic	80.56	78.78	68.72	75.67