notesum.ai

Published at May 13

Towards Harmless Rawlsian Fairness Regardless of Demographic Prior

NeurIPS

Released Date: May 13, 2024

Authors: Xuanqian Wang¹, Jing Li², Ivor Tsang, Yew-Soon Ong³

Aff.: ¹School of Computer Science and Engineering, Beihang University, China; ²Institute of High-Performance Computing, Agency for Science, Technology and Research, Singapore; ³College of Computing and Data Science, Nanyang Technological University, Singapore

Arxiv: https://openreview.net/pdf/27168faed7e430a0c951400bd7499d517b0541e0.pdf

		Utility $\downarrow$	WU $\downarrow$	MUD $\downarrow$	TUD $\downarrow$	VAR $\downarrow$
Law School	ERM	12.88(0.12)	19.75(0.21)	7.33(0.14)	13.45(0.21)	4.89(0.07)
	DRO	24.85(0.09)	24.98(0.05)	0.14(0.08)	0.23(0.12)	0
	ARL	12.86(0.11)	19.72(0.26)	7.33(0.19)	13.54(0.29)	4.86(0.13)
	BPF	18.75(0.50)	43.25(3.44)	26.33(3.20)	47.33(5.16)	3.98(0.29)
	MPFR	13.88	29.39	16.68	32.07	7.15
	FKL	13.10	19.37	6.77	13.42	5.01
	VFair(Ours)	12.95(0.11)	19.08(0.22)	6.63(0.18)	12.53(0.25)	3.66(0.12)
	Improved	-0.07	+0.67	+0.7	+0.92	+1.23
COMPAS	ERM	23.08(0.67)	24.49(0.76)	2.50(1.17)	3.45(1.76)	3.23(0.8)
	DRO	24.97(0.04)	25.05(0.06)	0.12(0.07)	0.17(0.10)	0
	ARL	22.73(0.4)	24.26 (0.84)	2.92(1.08)	3.78(1.11)	3.19(0.67)
	BPF	50.80(2.18)	63.46(0.99)	22.87(1.69)	37.77(1.84)	11.18(1.11)
	MPFR	36.26	38.36	6.23	9.13	17.33
	FKL	28.56	30.49	3.69	6.47	7.58
	VFair(Ours)	23.15(0.13)	23.83(0.21)	0.93(0.21)	1.17(0.28)	0.47(0.07)
	Improved	-0.07	+0.66	+1.57	+2.28	+2.76
C & C	ERM	41.15(1.25)	109.72(5.60)	106.56(5.67)	337.26(18.15)	87.52(9.43)
	DRO	99.34(3.85)	257.51(40.23)	248.56(48.63)	715.62(189.66)	284.49(72.71)
	ARL	40.43(1.14)	109.00(6.06)	106.88(5.70)	331.38(19.63)	83.98(5.55)
	BPF	71.05(1.02)	127.28(4.78)	110.16(10.06)	320.65(26.11)	96.76(8.08)
	MPFR	93.57	296.36	295.59	843.47	375.79
	FKL	83.73	278.30	275.29	794.59	321.42
	VFair(Ours)	41.17(0.64)	106.40(2.66)	104.54(3.11)	318.33(8.96)	67.44(3.36)
	Improved	-0.02	+3.32	+2.02	+18.93	+20.08
AgeDB	ERM	4.25(0.49)	4.32(0.53)	0.15(0.12)	0.15(0.12)	0.57(0.26)
	DRO	17.72(22.59)	17.98(22.65)	0.5(0.37)	0.5(0.37)	5.76(7.67)
	ARL	5.11(1.76)	5.29(1.98)	0.36(0.41)	0.36(0.41)	2.51(3.23)
	VFair(Ours)	3.57(0.76)	3.63(0.77)	0.12(0.09)	0.12(0.09)	0.23(0.08)
	Improved	+0.68	+0.69	+0.03	+0.03	+0.34