notesum.ai

Published at November 21

Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling

cs.CL

cs.AI

Released Date: November 21, 2024

Authors: Daehoon Gwak¹, Junwoo Park², Minho Park¹, Chaehun Park¹, Hyunchan Lee³, Edward Choi¹, Jaegul Choo¹

Aff.: ¹KAIST AI; ²KAIST AI, KRAFTON; ³Seoul National University

Arxiv: http://arxiv.org/abs/2411.14042v1

	WORLDREP		GDELT
Models	Accuracy	F1	Accuracy	F1
BERT	0.875	0.817	0.536	0.528
RoBERTa	0.859	0.803	0.480	0.476
ALBERT	0.823	0.719	0.331	0.310
XLNet	0.891	0.850	0.456	0.453
DistilBERT	0.823	0.736	0.540	0.531
ERNIE	0.865	0.823	0.608	0.591
Average	0.854	0.785	0.469	0.459