notesum.ai

Published at November 26

Learning from Noisy Labels via Conditional Distributionally Robust Optimization

cs.LG

Released Date: November 26, 2024

Authors: Hui Guo¹, Grace Y. Yi², Boyu Wang¹

Aff.: ¹Department of Computer Science, University of Western Ontario; ²Department of Statistical and Actuarial Sciences, Department of Computer Science, University of Western Ontario

Arxiv: http://arxiv.org/abs/2411.17113v1

Method	CIFAR-10			CIFAR-100
Method	IDN-LOW	IDN-MID	IDN-HIGH	IDN-LOW	IDN-MID	IDN-HIGH
CE (Clean)	$88.60_{\pm 0.79}$			$58.75_{\pm 0.55}$
CE (MV)	$80.90_{\pm 0.88}$	$76.05_{\pm 0.70}$	$69.65_{\pm 1.73}$	$50.96_{\pm 0.49}$	$44.80_{\pm 0.99}$	$38.51_{\pm 0.66}$
CE (EM) [7]	$81.15_{\pm 0.74}$	$75.84_{\pm 0.97}$	$69.85_{\pm 1.43}$	$51.29_{\pm 1.00}$	$45.24_{\pm 0.41}$	$38.01_{\pm 0.90}$
Co-teaching [30]	$83.08_{\pm 0.52}$	$80.58_{\pm 0.36}$	$\mathbf{81.30}_{\pm 0.82}$	$53.10_{\pm 0.98}$	$47.25_{\pm 0.82}$	${44.11}_{\pm 0.31}$
Co-teaching+ [31]	$81.17_{\pm 0.55}$	$78.23_{\pm 0.43}$	${71.84}_{\pm 1.13}$	$53.10_{\pm 0.64}$	$47.92_{\pm 0.76}$	$41.33_{\pm 0.81}$
CoDis [32]	$85.33_{\pm 0.39}$	$\mathbf{82.02}_{\pm 0.41}$	${78.67}_{\pm 0.46}$	$\mathbf{58.66}_{\pm 0.44}$	$52.27_{\pm 0.64}$	$46.12_{\pm 0.66}$
LogitClip [33]	$\mathbf{85.39}_{\pm 0.35}$	$80.87_{\pm 0.42}$	$75.36_{\pm 0.79}$	$57.79_{\pm 0.77}$	$\mathbf{53.14}_{\pm 0.37}$	$\mathbf{49.00}_{\pm 0.35}$
DoctorNet [34]	$81.85_{\pm 0.41}$	$78.69_{\pm 0.75}$	$76.26_{\pm 1.28}$	$52.61_{\pm 0.70}$	$47.80_{\pm 0.86}$	$43.50_{\pm 0.53}$
MBEM [9]	$82.37_{\pm 0.77}$	$78.05_{\pm 0.83}$	$71.43_{\pm 2.43}$	$52.20_{\pm 0.07}$	$45.26_{\pm 0.50}$	$38.92_{\pm 0.69}$
CrowdLayer [27]	$83.98_{\pm 0.35}$	$77.76_{\pm 1.06}$	$67.77_{\pm 1.69}$	$51.28_{\pm 0.64}$	$45.28_{\pm 0.64}$	$38.93_{\pm 0.76}$
TraceReg [12]	$80.72_{\pm 0.79}$	$77.71_{\pm 1.36}$	$67.86_{\pm 1.77}$	$51.43_{\pm 0.61}$	$45.08_{\pm 0.57}$	$38.69_{\pm 1.01}$
Max-MIG [11]	$81.00_{\pm 0.72}$	$75.90_{\pm 0.52}$	$70.96_{\pm 0.96}$	$51.76_{\pm 1.11}$	$44.93_{\pm 0.71}$	$38.70_{\pm 0.49}$
CoNAL [35]	$81.60_{\pm 0.82}$	$76.02_{\pm 0.79}$	$69.50_{\pm 1.89}$	$51.61_{\pm 1.14}$	$44.19_{\pm 0.62}$	$38.24_{\pm 0.29}$
CCC [36]	$84.81_{\pm 0.89}$	$81.29_{\pm 0.66}$	$77.28_{\pm 1.05}$	$56.65_{\pm 0.55}$	$50.68_{\pm 0.40}$	$43.94_{\pm 0.95}$
Ours (AdaptCDRP)	$\mathbf{88.09}_{\pm 0.37}$	$\mathbf{87.37}_{\pm 0.29}$	$\mathbf{86.62}_{\pm 0.45}$	$\mathbf{60.20}_{\pm 0.15}$	$\mathbf{56.65}_{\pm 1.03}$	$\mathbf{54.24}_{\pm 0.99}$