notesum.ai

Published at October 31

Plan-on-Graph: Self-Correcting Adaptive Planning of Large Language Model on Knowledge Graphs

cs.AI

Released Date: October 31, 2024

Authors: Liyi Chen¹, Panrong Tong², Zhongming Jin², Ying Sun³, Jieping Ye², Hui Xiong⁴

Aff.: ¹University of Science and Technology of China; ²Alibaba Cloud Computing; ³Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou); ⁴Department of Computer Science and Engineering, The Hong Kong University of Science and Technology

Arxiv: http://arxiv.org/abs/2410.23875v1

LLM-Only
Method	CWQ	WebQSP
IO Prompt [6]	37.6	63.3
CoT [49]	38.8	62.2
SC [48]	45.4	61.1
Fine-Tuned KG-Augmented LLM
UniKGQA [20]	51.2	79.1
TIARA [34]	-	75.2
RE-KBQA [7]	50.3	74.6
DeCAF [57]	70.4	82.1
RoG [27]	62.6	85.7
Prompting KG-Augmented LLM w/GPT-3.5 or others
KD-CoT [41]	50.5	73.7
KB-BINDER [23]	-	74.4
StructGPT [19]	54.3	72.6
ToG [35]	57.1	76.2
PoG	63.2	82.0
Prompting KG-Augmented LLM w/GPT-4
InteractiveKBQA [52]	59.2	72.5
ToG [35]	67.6	82.6
PoG	75.0	87.3