notesum.ai

Published at December 3

OODFace: Benchmarking Robustness of Face Recognition under Common Corruptions and Appearance Variations

cs.CV

cs.AI

cs.CR

cs.LG

Released Date: December 3, 2024

Authors: Caixin Kang¹, Yubo Chen, Shouwei Ruan, Shiji Zhao, Ruochen Zhang, Jiayi Wang, Shan Fu, Xingxing Wei

Aff.: ¹Institute of Artificial Intelligence, Beihang University

Arxiv: http://arxiv.org/pdf/2412.02479v1

Models		Open-source Model Eval								Architecture Eval						Loss Function Eval
Corruptions		FaceNet	SphereFace	CosFace	ArcFace	ElasticFace	AdaFace	TransFace	TopoFR	MobileFace	Mobilenet	Mobilenet-v2	ShuffleNet	ShuffleNet-v2	ResNet50	Softmax-IR	SphereFace-IR	Am-IR	CosFace-IR	ArcFace-IR
None (clean)		99.23	98.20	98.63	99.50	99.80	99.83	99.75	99.78	99.43	99.40	99.10	99.43	99.15	99.72	99.53	99.57	99.18	99.70	99.67
Lighting & Weather	Brightness	98.20	95.68	96.96	99.05	99.70	99.73	99.58	99.50	98.86	98.29	97.78	98.76	98.02	99.19	99.08	99.17	98.08	99.49	99.42
	Contrast	84.64	84.01	84.27	92.92	95.51	99.10	96.93	94.75	87.26	84.07	83.93	86.22	83.81	89.61	89.92	90.38	88.74	89.60	89.24
	Saturate	98.59	96.81	97.86	98.20	98.87	99.70	99.20	98.95	99.07	98.80	98.51	99.04	98.60	99.38	99.33	99.32	98.59	99.56	99.49
	Fog	93.25	86.10	88.30	92.56	93.38	91.02	93.10	93.02	89.69	83.59	85.45	88.42	87.44	88.61	90.43	89.41	89.21	92.30	92.18
	Snow	90.96	87.23	91.84	96.53	97.48	98.83	97.87	96.80	93.86	89.99	91.10	92.61	92.58	93.06	94.92	93.97	94.66	96.09	96.25
Sensor	Defocus Blur	94.30	79.71	82.12	88.31	87.98	87.34	88.70	85.53	86.16	84.78	85.29	87.30	86.29	86.73	87.65	86.18	88.67	88.98	89.10
	Color Shift	98.81	97.11	98.22	99.45	99.80	99.81	99.78	99.73	99.24	99.14	98.81	99.23	98.84	99.54	99.45	99.49	98.86	99.62	99.62
	Pixelate	98.83	94.42	96.21	98.46	99.51	99.80	99.23	98.61	98.29	97.52	96.99	98.51	98.16	99.09	98.95	98.76	97.98	99.21	99.21
Movement	Motion Blur	96.41	87.67	89.28	95.04	95.59	94.09	96.36	93.56	92.41	91.06	91.72	93.43	92.75	93.25	94.21	93.89	93.66	95.26	95.25
	Zoom Blur	97.69	96.62	97.40	98.77	99.49	99.58	99.26	99.12	98.95	98.25	97.81	98.73	98.36	99.30	99.07	99.09	98.32	99.41	99.38
	Facial Distortion	94.89	79.58	84.62	93.60	91.84	95.28	93.33	92.24	92.21	87.67	88.68	92.25	91.29	90.98	92.46	91.66	92.78	93.97	94.34
Data & Processing	Gaussian Noise	87.84	73.13	80.82	93.21	87.19	87.68	88.40	82.18	84.66	75.69	77.30	76.73	82.43	84.10	81.77	80.40	89.23	88.70	87.05
	Impulse Noise	89.02	72.90	81.90	94.65	90.10	90.27	90.03	84.25	85.94	77.41	78.37	77.02	82.09	84.42	83.41	82.81	90.97	91.06	88.90
	Shot Noise	84.80	70.20	77.65	93.02	86.67	86.70	87.46	81.55	81.53	72.96	73.98	73.77	78.08	81.66	78.61	77.63	87.21	86.42	84.48
	Speckle Noise	90.67	74.61	83.65	95.90	93.53	94.23	92.99	89.79	87.61	79.00	79.45	79.97	83.66	88.01	86.27	84.54	91.36	92.25	90.41
	Salt Pepper Noise	76.74	62.82	66.06	88.90	82.51	87.13	79.20	70.70	76.15	64.35	66.89	59.54	63.54	69.04	64.73	65.23	82.50	78.36	74.51
	Jpeg Compression	98.67	95.44	97.05	98.92	99.49	99.48	99.47	99.24	98.67	98.36	98.11	98.57	97.91	99.14	98.96	98.88	98.12	99.32	99.33
Occlusion	Random Occlusion	93.74	86.13	89.07	94.58	97.36	98.43	97.38	98.10	91.73	88.89	87.63	90.94	91.21	93.24	94.05	93.56	92.73	96.10	95.22
	Frost	90.93	83.24	89.98	94.50	94.29	96.88	94.36	93.94	93.04	88.73	89.52	92.17	91.54	92.44	93.36	92.09	93.33	94.83	94.99
	Spatter	91.25	89.20	92.26	96.60	98.27	98.82	98.93	98.30	94.70	90.88	92.36	93.62	92.71	93.87	96.87	96.80	95.69	98.02	97.64
Average		92.51	84.63	88.28	95.16	94.43	95.20	94.58	92.49	91.50	87.47	87.98	88.84	89.47	91.23	91.17	90.66	93.03	93.93	93.30