notesum.ai

Published at December 10

Filipino Benchmarks for Measuring Sexist and Homophobic Bias in Multilingual Language Models from Southeast Asia

cs.CL

Released Date: December 10, 2024

Authors: Lance Calvin Lim Gamboa, Mark Lee¹

Aff.: ¹University of Birmingham

Arxiv: http://arxiv.org/pdf/2412.07303v1

BM	Bias Type	Count	% of BM
CP	gender	131	64.22
CP	sexual orientation	73	35.78
WQ	bias against bakla	1787	26.01
WQ	bias against bading	1787	26.01
WQ	bias against tomboy	1648	23.99
WQ	bias against lesbiyana	1648	23.99