notesum.ai

Published at November 27

A Pipeline of Neural-Symbolic Integration to Enhance Spatial Reasoning in Large Language Models

cs.AI

cs.CL

Released Date: November 27, 2024

Authors: Rong Wang¹, Kun Sun², Jonas Kuhn¹

Aff.: ¹The Institute of Natural Language Processing, Stuttgart University, Stuttgart, Germany; ²Tübingen, Germany

Arxiv: http://arxiv.org/abs/2411.18564v1

Refer to caption

Question Type	Model	Direct	LLM+ASP	$\Delta$
FR	Deepseek	38.18	58.94	+20.76
	Llama3	26.92	53.12	+26.20
	GPT4.0	45.45	65.32	+19.87
FB	Deepseek	80.56	85.37	+4.81
	Llama3	66.67	83.33	+16.66
	GPT4.0	60.91	80.49	+19.58
YN	Deepseek	78.19	70.90	-7.29
	Llama3	78.19	67.27	-10.92
	GPT4.0	58.18	54.54	-3.64
CO	Deepseek	48.26	42.81	-5.45
	Llama3	55.77	57.15	+1.38
	GPT4.0	57.69	72.72	+15.03