notesum.ai

Published at November 5

Mitigating Metric Bias in Minimum Bayes Risk Decoding

cs.CL

cs.AI

Released Date: November 5, 2024

Authors: Geza Kovacs¹, Daniel Deutsch¹, Markus Freitag¹

Aff.: ¹Google

Arxiv: http://arxiv.org/abs/2411.03524v1

	MetricX-QE	CometKiwi23-XXL	CometKiwi23-XL	CometKiwi22	AfriCOMET-QE (African only)	MetricX	XCOMET-XXL	XCOMET-XL	COMET22	AfriCOMET (African only)	IndicCOMET (Indic only)	BLEURT	YiSi	chrF	chrF++	sentBLEU	TER
all
qe
top
topQe
mxmxqe
noLex
noNC
noNCnoLex
noNCQe
allQE(N)allMBR	1	1	1	1	1	2	2	2	2	2	2	2	2	2	2	2	2
allQE(N)nolexMBR	1	1	1	1	1	2	2	2	2	2	2	2	2
topQE(N)topMBR	1	1	1			2	2	2
noncQE(N)noncMBR	1				1	2			2	2	2	2	2	2	2	2	2
noncQE(N)noncnolexMBR	1				1	2			2	2	2	2	2
mxQE(N)xcMBR	1						2
ckQE(N)xcMBR		1					2
mxQE(N)mxMBR	1					2
ckQE(N)mxMBR		1				2