notesum.ai

Published at November 4

cs.CL

cs.AI

cs.LG

Released Date: November 4, 2024

Authors: Hoang Nguyen¹, Khyati Mahajan², Vikas Yadav², Philip S. Yu¹, Masoud Hashemi², Rishabh Maheshwary²

Aff.: ¹University of Illinois at Chicago; ²ServiceNow

Task	Metrics	Dataset Name
		PAWS-X Yang et al. (2019)
NLU	Accuracy	XNLI Conneau et al. (2018)
		AYA-WIKI Merity et al. (2022)
NLG	BLEU Papineni et al. (2002)	AYA-CNN See et al. (2017); Singh et al. (2024)
MT	chrF Popović (2015)	FLORES Team et al. (2024b)
	F1	AYA-MLQA Lewis et al. (2020); Singh et al. (2024)
		Okapi-MMLU Hendrycks et al. (2021); Lai et al. (2023b)
QA	Accuracy	Okapi-HellaSwag Zellers et al. (2019); Lai et al. (2023b)
		Okapi-ARC Clark et al. (2018); Lai et al. (2023b)