notesum.ai

Published at November 7

cs.LG

cs.AI

Released Date: November 7, 2024

Authors: Rahul Vashisht¹, P. Krishna Kumar¹, Harsha Vardhan Govind², Harish G. Ramaswamy¹

Aff.: ¹Indian Institute of Technology Madras; ²IIITDM Kancheepuram

Parameter Initialization Regime	Feature Shuffle Accuracy
Parameter Initialization Regime	Feature-1	Feature-2	Feature-3
Standard data-agnostic (like Xavier-glorot)	$50.3~{}{\scriptstyle\pm 1.78}$	$100~{}{\scriptstyle\pm 0.0}$	$100~{}{\scriptstyle\pm 0.0}$
Pretraining model with $10\%$ noisy labels	$64.2~{}{\scriptstyle\pm 6.8}$	$91.6~{}{\scriptstyle\pm 4.3}$	$97.1~{}{\scriptstyle\pm 2.2}$