notesum.ai

Published at November 26

cs.CL

cs.AI

Released Date: November 26, 2024

Authors: Yunyi Liu¹, Yingshu Li¹, Zhanyu Wang¹, Xinyu Liang², Lingqiao Liu³, Lei Wang⁴, Luping Zhou¹

Aff.: ¹The University of Sydney; ²Guangzhou University of Chinese Medicine; ³The University of Adelaide; ⁴The University of Wollongong

Metric	Kendall’s Tau $\uparrow$ (P-Value $\downarrow$ )	Spearman $\uparrow$ (P-Value $\downarrow$ )
BLEU-4 [3]	0.345 (2.2e-12)	0.475 (1.2e-12)
ROUGE-L [17]	0.491 (2.9e-23)	0.663 (1.2e-26)
METEOR [18]	0.464 (8.4e-21)	0.627 (2.8e-23)
CIDEr [24]	0.499 (4.5e-24)	0.664 (8.9e-27)
BertScore [19]	0.507 (4.5e-25)	0.677 (3.9e-28)
RadGraphF1 [7]	0.516 (4.3e-25)	0.702 (4.4e-31)
semb_score [9]	0.494 (1.0e-23)	0.665 (6.2e-27)
RadCliQ-v1 [9]	0.631 (6.9e-38)	0.816 (6.6e-49)
GREEN [16]	0.640	-
ER²Score (Ours)	0.751 (4.0e-52)	0.910 (5.0e-76)