notesum.ai

Published at November 27

Hidden Data Privacy Breaches in Federated Learning

cs.CL

cs.CR

Released Date: November 27, 2024

Authors: Xueluan Gong¹, Yuji Wang², Shuaike Li³, Mengyuan Sun³, Songze Li⁴, Qian Wang³, Kwok-Yan Lam¹, Chen Chen¹

Aff.: ¹Nanyang Technological University, Singapore; ²Shanghai Jiao Tong University, China; ³Wuhan University, China; ⁴Southeast University, China

Arxiv: http://arxiv.org/abs/2411.18269v1

CIFAR-10 dataset
Baselines	Metrics^†	$N=16$	$N=32$	$N=64$	$N=128$	$N=256$	$N=512$
Transpose Attack	Leakage ( $\uparrow$ )	8.2 $\pm$ 4.0	2.4 $\pm$ 2.0	0.6 $\pm$ 0.8	0.2 $\pm$ 0.4	0.0 $\pm$ 0.0	0.0 $\pm$ 0.0
	SSIM ( $\uparrow$ )	0.506 $\pm$ 0.034	0.394 $\pm$ 0.023	0.306 $\pm$ 0.037	0.250 $\pm$ 0.035	0.197 $\pm$ 0.019	0.151 $\pm$ 0.010
	PSNR ( $\uparrow$ )	15.994 $\pm$ 0.441	14.882 $\pm$ 0.385	14.378 $\pm$ 0.387	13.983 $\pm$ 0.559	13.504 $\pm$ 0.319	13.103 $\pm$ 0.330
	LPIPS ( $\downarrow$ )	0.457 $\pm$ 0.010	0.490 $\pm$ 0.021	0.518 $\pm$ 0.013	0.547 $\pm$ 0.010	0.548 $\pm$ 0.007	0.557 $\pm$ 0.009
RtF	Leakage ( $\uparrow$ )	11.5 $\pm$ 0.3	11.2 $\pm$ 1.1	4.2 $\pm$ 0.6	1.6 $\pm$ 0.2	0.7 ± 0.3	1.4 ± 0.3
	SSIM ( $\uparrow$ )	0.670 $\pm$ 0.018	0.407 $\pm$ 0.023	0.198 $\pm$ 0.013	0.070 $\pm$ 0.007	0.195 ± 0.049	0.280 ± 0.036
	PSNR ( $\uparrow$ )	19.931 $\pm$ 0.417	13.115 $\pm$ 0.456	8.848 $\pm$ 0.293	6.358 $\pm$ 0.116	7.885 ± 0.939	8.601 ± 0.688
	LPIPS ( $\downarrow$ )	0.205 $\pm$ 0.015	0.390 $\pm$ 0.018	0.521 $\pm$ 0.007	0.577 $\pm$ 0.007	0.504 ± 0.042	0.485 ± 0.023
LOKI	Leakage ( $\uparrow$ )	13.8 $\pm$ 0.4	27.5 $\pm$ 0.5	55.6 $\pm$ 0.9	110.0 $\pm$ 0.7	219.080 $\pm$ 0.9	435.6 $\pm$ 4.6
	SSIM ( $\uparrow$ )	0.870 $\pm$ 0.019	0.849 $\pm$ 0.015	0.800 $\pm$ 0.015	0.739 $\pm$ 0.006	0.696 $\pm$ 0.006	0.700 $\pm$ 0.015
	PSNR ( $\uparrow$ )	32.095 $\pm$ 1.32	31.400 $\pm$ 0.960	29.471 $\pm$ 0.890	27.269 $\pm$ 0.127	25.903 $\pm$ 0.198	26.173 $\pm$ 0.725
	LPIPS ( $\downarrow$ )	0.071 $\pm$ 0.011	0.086 $\pm$ 0.010	0.114 $\pm$ 0.009	0.151 $\pm$ 0.004	0.177 $\pm$ 0.004	0.173 $\pm$ 0.008
our method	Leakage ( $\uparrow$ )	16.0 $\pm$ 0.0	32.0 $\pm$ 0.0	64.0 $\pm$ 0.0	128.0 $\pm$ 0.0	256.0 $\pm$ 0.0	512.0 $\pm$ 0.0
	SSIM ( $\uparrow$ )	1.000 $\pm$ 0.000	1.000 $\pm$ 0.000	1.000 $\pm$ 0.000	0.999 $\pm$ 0.001	0.934 $\pm$ 0.015	0.785 $\pm$ 0.021
	PSNR ( $\uparrow$ )	68.734 $\pm$ 0.465	67.565 $\pm$ 0.446	64.764 $\pm$ 0.711	59.978 $\pm$ 1.394	30.394 $\pm$ 0.778	23.122 $\pm$ 0.130
	LPIPS ( $\downarrow$ )	0.000 $\pm$ 0.000	0.000 $\pm$ 0.000	0.000 $\pm$ 0.000	0.001 $\pm$ 0.001	0.093 $\pm$ 0.019	0.295 $\pm$ 0.021
CIFAR-100 dataset
Baselines	Metrics^†	$N=16$	$N=32$	$N=64$	$N=128$	$N=256$	$N=512$
Transpose Attack	Leakage ( $\uparrow$ )	3.8 $\pm$ 2.6	3.8 $\pm$ 3.4	3.4 $\pm$ 2.1	5.4 $\pm$ 2.4	9.4 $\pm$ 2.3	7.2 $\pm$ 1.9
	SSIM ( $\uparrow$ )	0.388 $\pm$ 0.053	0.301 $\pm$ 0.047	0.248 $\pm$ 0.018	0.224 $\pm$ 0.014	0.215 $\pm$ 0.016	0.190 $\pm$ 0.009
	PSNR ( $\uparrow$ )	15.582 $\pm$ 0.921	14.463 $\pm$ 0.494	13.896 $\pm$ 0.383	13.725 $\pm$ 0.186	13.590 $\pm$ 0.223	13.348 $\pm$ 0.070
	LPIPS ( $\downarrow$ )	0.475 $\pm$ 0.018	0.499 $\pm$ 0.017	0.528 $\pm$ 0.007	0.533 $\pm$ 0.004	0.549 $\pm$ 0.009	0.559 $\pm$ 0.012
RtF	Leakage ( $\uparrow$ )	11.3 $\pm$ 0.3	11.6 $\pm$ 1.3	5.0 $\pm$ 0.3	2.7 $\pm$ 0.4	0.9 ± 0.2	1.6 ± 0.2
	SSIM ( $\uparrow$ )	0.655 $\pm$ 0.028	0.421 $\pm$ 0.027	0.209 $\pm$ 0.010	0.106 $\pm$ 0.012	0.229 ± 0.026	0.297 ± 0.034
	PSNR ( $\uparrow$ )	19.656 $\pm$ 0.779	13.784 $\pm$ 0.588	8.860 $\pm$ 0.261	6.820 $\pm$ 0.245	7.446 ± 0.820	9.075 ± 1.139
	LPIPS ( $\downarrow$ )	0.213 $\pm$ 0.016	0.371 $\pm$ 0.018	0.521 $\pm$ 0.006	0.570 $\pm$ 0.006	0.522 ± 0.011	0.475 ± 0.007
LOKI	Leakage ( $\uparrow$ )	13.6 $\pm$ 1.0	26.6 $\pm$ 1.4	54.8 $\pm$ 2.4	113.6 $\pm$ 3.4	221.8 $\pm$ 5.9	432.4 $\pm$ 8.6
	SSIM ( $\uparrow$ )	0.856 $\pm$ 0.074	0.854 $\pm$ 0.046	0.794 $\pm$ 0.037	0.740 $\pm$ 0.042	0.701 $\pm$ 0.024	0.705 $\pm$ 0.024
	PSNR ( $\uparrow$ )	33.282 $\pm$ 6.744	31.572 $\pm$ 3.341	27.907 $\pm$ 2.039	26.638 $\pm$ 2.045	26.026 $\pm$ 1.137	5.810 $\pm$ 0.888
	LPIPS ( $\downarrow$ )	0.073 $\pm$ 0.043	0.083 $\pm$ 0.024	0.125 $\pm$ 0.021	0.155 $\pm$ 0.029	0.182 $\pm$ 0.014	0.180 $\pm$ 0.016
Ours	Leakage ( $\uparrow$ )	16.0 $\pm$ 0.0	32.0 $\pm$ 0.0	64.0 $\pm$ 0.0	128.0 $\pm$ 0.0	256.0 $\pm$ 0.0	505.8 $\pm$ 5.19
	SSIM ( $\uparrow$ )	1.000 $\pm$ 0.000	1.000 $\pm$ 0.000	1.000 $\pm$ 0.000	0.999 $\pm$ 0.001	0.920 $\pm$ 0.014	0.702 $\pm$ 0.034
	PSNR ( $\uparrow$ )	68.520 $\pm$ 0.887	65.489 $\pm$ 0.431	62.697 $\pm$ 0.230	56.803 $\pm$ 0.815	29.916 $\pm$ 0.619	22.281 $\pm$ 0.436
	LPIPS ( $\downarrow$ )	0.000 $\pm$ 0.000	0.000 $\pm$ 0.000	0.000 $\pm$ 0.000	0.001 $\pm$ 0.001	0.102 $\pm$ 0.016	0.340 $\pm$ 0.021