notesum.ai

Published at November 19

Revisiting Fake News Detection: Towards Temporality-aware Evaluation by Leveraging Engagement Earliness

cs.SI

cs.AI

cs.CL

Released Date: November 19, 2024

Authors: Junghoon Kim¹, Junmo Lee¹, Yeonjun In¹, Kanghoon Yoon¹, Chanyoung Park¹

Aff.: ¹KAIST, Daejeon, Republic of Korea

Arxiv: http://arxiv.org/abs/2411.12775v1

Refer to caption

	Method		PolitiFact			GossipCop
	Method		acc.	f1.		acc.	f1.
G1	dEFEND\c (Shu et al., 2019)		81.2	79.6		75.4	68.3
	DualEmo\c (Zhang et al., 2021)		84.0	81.5		77.9	71.9
	BERT (Devlin et al., 2018)		84.2	81.7		76.4	69.1
	GPT3.5		75.7	77.9		62.8	56.6
G2	GCNFN (Monti et al., 2019)		84.8	82.3		85.3	82.9
	UPFD (Dou et al., 2021)		84.6	82.1		82.0	77.8
	FANG (Nguyen et al., 2020)		85.5	82.6		86.1	83.4
	GCN (Kipf and Welling, 2016)		86.4	83.0		87.4	84.7
	GAT (Veličković et al., 2017)		86.7	79.5		86.5	83.6
	GraphSAGE (Hamilton et al., 2017)		85.4	80.9		87.5	85.5
G3	RS-GNN (Dai et al., 2022)		80.8	62.8		85.9	83.6
G3	DECOR (Wu and Hooi, 2023)		87.4	84.7		88.1	85.7
Ours	DAWN		91.9	89.8		93.7	93.0