notesum.ai

Published at December 10

PETALface: Parameter Efficient Transfer Learning for Low-resolution Face Recognition

cs.CV

Released Date: December 10, 2024

Authors: Kartik Narayan¹, Nithin Gopalakrishnan Nair¹, Jennifer Xu², Rama Chellappa¹, Vishal M. Patel¹

Aff.: ¹Johns Hopkins University; ²Systems and Technology Research

Arxiv: http://arxiv.org/pdf/2412.07771v1

Refer to caption

Training	Loss	Dataset	Arch.	High-Resolution						Mixed-Quality		Low-resolution
				LFW [17]	CFP-FP [43]	CPLFW [60]	AgeDB [41]	CALFW [61]	CFP-FF [43]	IJB-B [52]	IJB-C [39]	TinyFace [7]
				Verification Accuracy						TAR@FAR=0.01%		Rank-1	Rank-5	Rank-10
Pre-trained	CosFace [50]	WBF4M	R50	99.68	96.83	93.28	96.88	95.63	99.70	94.09	96.01	72.71	76.36	78.99
Pre-trained	ArcFace [9]	WBF4M	R50	99.67	96.71	93.41	96.81	95.71	99.75	94.02	95.99	73.04	76.85	79.45
Pre-trained	AdaFace [29]	WBF4M	R50	99.78	97.14	93.81	97.26	95.98	99.81	94.95	96.67	73.49	76.60	79.07
\cdashline1-15[1pt/1pt] Pre-trained	CosFace [50]	WBF4M	ViT-B	99.73	97.30	94.31	97.51	95.95	99.87	95.18	96.87	73.57	76.95	78.94
Pre-trained	ArcFace [9]	WBF4M	ViT-B	99.82	97.23	93.68	97.53	95.91	99.80	94.91	96.64	72.74	76.28	78.13
Pre-trained	AdaFace [29]	WBF4M	ViT-B	99.76	97.00	93.75	96.85	95.71	99.80	94.90	96.52	74.03	77.22	79.37
Pre-trained	CosFace [50]	WBF4M	Swin-B	99.78	96.75	93.76	97.65	95.98	99.87	95.18	96.79	72.74	76.79	79.18
Pre-trained	ArcFace [9]	WBF4M	Swin-B	99.76	96.77	93.93	97.35	95.83	99.87	94.87	96.66	73.31	76.68	79.23
Full-FT	CosFace [50]	WBF4M	Swin-B	98.50	89.52	84.88	85.10	89.15	97.55	75.22	79.47	71.32	76.42	79.45
Full-FT	ArcFace [9]	WBF4M	Swin-B	98.31	88.94	84.00	83.45	88.33	97.14	71.84	76.10	71.11	76.63	79.96
LoRA	CosFace [50]	WBF4M	Swin-B	99.65	96.61	93.38	97.35	95.75	99.84	93.57	95.63	75.37	78.88	82.02
LoRA	ArcFace [9]	WBF4M	Swin-B	99.73	96.28	93.20	96.71	95.68	99.74	93.38	95.28	75.64	78.99	81.43
PETALface	CosFace [50]	WBF4M	Swin-B	99.68	96.61	93.50	97.40	95.76	99.85	93.79	95.67	75.45	79.05	81.19
PETALface	ArcFace [9]	WBF4M	Swin-B	99.66	96.37	93.18	96.45	95.61	99.80	93.29	95.27	75.72	78.86	81.70
PETALface	ArcFace [9]	WBF12M	Swin-B	99.76	97.31	94.25	98.08	95.80	99.91	95.17	96.87	76.66	79.64	81.38