notesum.ai

Published at November 6

Towards Personalized Federated Learning via Comprehensive Knowledge Distillation

cs.LG

cs.AI

cs.CR

cs.CV

Released Date: November 6, 2024

Authors: Pengju Wang¹, Bochao Liu¹, Weijia Guo¹, Yong Li¹, Shiming Ge¹

Aff.: ¹Not specified

Arxiv: http://arxiv.org/abs/2411.03569v1

Refer to caption

Dataset	Client	FedAvg	FedProx	FedPer	LG-FedAvg	pFedMe	FedFomo	pFedSD	FedCKD
FMNIST	$n=20$	90.15 $\pm$ 0.10	90.05 $\pm$ 0.13	96.30 $\pm$ 0.03	95.22 $\pm$ 0.22	93.24 $\pm$ 0.08	95.38 $\pm$ 0.04	96.57 $\pm$ 0.08	96.61 $\pm$ 0.06
FMNIST	$n=100$	86.82 $\pm$ 0.39	76.78 $\pm$ 0.30	94.99 $\pm$ 0.17	91.41 $\pm$ 0.08	92.05 $\pm$ 0.08	92.06 $\pm$ 0.14	95.97 $\pm$ 0.06	95.98 $\pm$ 0.04
CIFAR10	$n=20$	50.44 $\pm$ 0.68	50.50 $\pm$ 0.78	80.74 $\pm$ 0.47	78.61 $\pm$ 0.31	79.51 $\pm$ 0.28	79.29 $\pm$ 0.34	82.08 $\pm$ 0.46	82.94 $\pm$ 0.13
CIFAR10	$n=100$	49.04 $\pm$ 0.80	42.11 $\pm$ 0.95	78.89 $\pm$ 0.90	71.60 $\pm$ 1.52	74.62 $\pm$ 0.72	73.16 $\pm$ 0.65	80.22 $\pm$ 0.24	81.41 $\pm$ 0.35
CIFAR100	$n=20$	32.24 $\pm$ 0.32	32.50 $\pm$ 0.55	52.12 $\pm$ 0.22	40.71 $\pm$ 0.05	38.42 $\pm$ 0.71	44.67 $\pm$ 0.37	55.27 $\pm$ 0.30	57.25 $\pm$ 0.07
CIFAR100	$n=100$	29.13 $\pm$ 0.18	14.27 $\pm$ 0.35	44.45 $\pm$ 0.64	21.61 $\pm$ 0.21	27.07 $\pm$ 0.25	26.48 $\pm$ 0.27	48.91 $\pm$ 0.77	50.20 $\pm$ 0.39