notesum.ai

Published at November 5

cs.CL

cs.AI

cs.IR

Released Date: November 5, 2024

Authors: Tao Zhang¹, Ning Yan², Masood Mortazavi², Hoang H. Nguyen¹, Zhongfen Deng¹, Philip S. Yu¹

Aff.: ¹University of Illinois at Chicago; ²Futurewei Technologies Inc.

Models	Macro-Rec	Macro-Pre	Macro-F1
ChatGPT	37.31	20.31	26.30
COT (Li et al., 2023)	16.02	17.85	16.88
CODEIE (Li et al., 2023)	8.30	15.45	10.79
Graph-DPEP on Llama2 w. only dec. prompt	58.76	21.34	31.31
Graph-DPEP on Mistral w. only dec. prompt	61.17	25.30	35.79
Graph-DPEP on Llama3 w. only dec. prompt	62.17	30.17	40.62
Graph-DPEP on Llama2	62.49	22.82	33.43
Graph-DPEP on Mistral	64.69	27.99	39.07
Graph-DPEP on Llama3	65.27	31.46	42.45