notesum.ai
Published at December 10Learnable Sparse Customization in Heterogeneous Edge Computing
cs.DC
cs.LG
Released Date: December 10, 2024
Authors: Jingjing Xue1, Sheng Sun, Min Liu, Yuwei Wang, Zhuotao Liu, Jingyuan Wang
Aff.: 1Institute of Computing Technology, Chinese Academy of Sciences
| Methods | MNIST | CIFAR10 | CIFAR100 | Tiny-Imagenet | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Acc | FLOPs | Acc | FLOPs | Acc | FLOPs | Acc | FLOPs | Acc | FLOPs | |
| (%) | (1e12) | (%) | (1e12) | (%) | (1e12) | (%) | (1e12) | (%) | (1e12) | |
| FedAvg | 88.15
1.14 |
2.8 | 31.28
1.24 |
825.4 | 24.30
0.53 |
4934.3 | 5.21
0.14 |
27081.0 | 23.39
0.56 |
10.5 |
| FedProx | 87.53
1.16 |
2.8 | 31.12
1.38 |
825.4 | 24.83
0.52 |
4934.3 | 5.66
0.12 |
27081.0 | 23.37
0.57 |
10.5 |
| Oort | 95.21
0.42 |
2.8 | 33.62
0.97 |
825.4 | 26.56
0.39 |
4934.3 | 4.93
0.12 |
26539.4 | 23.91
0.06 |
10.5 |
| REFL | 94.67
0.33 |
1.3 | 33.10
1.68 |
642.1 | 24.87
0.64 |
2950.7 | 5.03
0.10 |
15436.2 | 24.45
0.07 |
8.8 |
| PruneFL | 90.90
0.34 |
2.2 | 32.20
1.66 |
793.3 | 26.89
0.46 |
4673.8 | 5.03
0.13 |
26076.9 | 23.60
0.19 |
9.0 |
| CS | 92.44
1.16 |
1.4 | 28.09
0.84 |
417.0 | 27.76
0.61 |
2493.7 | 6.02
0.10 |
13686.2 | 21.69
0.24 |
5.3 |
| eFD | 93.31
0.91 |
1.1 | 28.44
0.98 |
380.1 | 22.74
0.45 |
1989.5 | 3.85
0.11 |
10337.5 | 23.20
0.04 |
4.6 |
| Fjord | 92.56
1.03 |
1.1 | 28.04
1.27 |
380.1 | 25.83
0.77 |
1989.5 | 3.77
0.08 |
10337.5 | 23.09
0.56 |
4.6 |
| HeteroFL | 90.76
1.05 |
1.1 | 33.22
1.73 |
380.1 | 26.34
0.77 |
1989.5 | 4.65
0.11 |
10337.5 | 23.38
0.11 |
4.6 |
| FedRolex | 93.73
1.44 |
1.1 | 33.59
1.91 |
380.1 | 26.28
1.02 |
1989.5 | 4.82
0.12 |
10337.5 | 23.84
0.25 |
4.6 |
| FedMP | 91.63
0.90 |
1.7 | 28.99
0.78 |
532.0 | 30.36
0.95 |
2373.5 | 5.40
0.16 |
16019.2 | 23.57
0.87 |
6.3 |
| DepthFL | 95.44
0.53 |
2.2 | 29.72
1.06 |
725.8 | 20.41
0.52 |
3431.6 | 3.83
0.13 |
23565.1 | 23.11
0.16 |
4.9 |
| Ditto | 92.00
0.30 |
5.6 | 82.60
0.29 |
1650.8 | 49.01
0.19 |
9868.6 | 11.92
0.04 |
54162.0 | 23.97
0.24 |
21.0 |
| FedPer | 93.45
0.07 |
2.8 | 79.76
0.15 |
825.4 | 60.43
0.08 |
4934.3 | 14.96
0.10 |
27081.0 | 24.64
0.06 |
10.5 |
| FedRep | 91.92
0.30 |
2.8 | 80.87
0.09 |
825.4 | 45.36
0.53 |
4934.3 | 15.18
0.06 |
27081.0 | 24.43
0.07 |
10.5 |
| Per-FedAvg | 93.46
0.33 |
2.8 | 85.00
0.09 |
660.3 | 58.57
1.57 |
3256.6 | 16.60
0.51 |
18956.7 | 24.65
0.42 |
9.7 |
| LotteryFL | 93.37
1.28 |
1.8 | 75.71
1.00 |
656.7 | 44.83
0.58 |
3276.9 | 11.11
0.21 |
16454.3 | 24.33
0.02 |
6.2 |
| Hermes | 94.05
0.60 |
1.7 | 81.07
1.58 |
565.9 | 47.09
0.81 |
3547.7 | 11.52
0.10 |
17168.1 | 24.89
0.10 |
6.1 |
| FedSpa | 93.94
0.85 |
1.4 | 78.83
2.41 |
522.9 | 55.76
1.02 |
3057.5 | 9.20
0.12 |
16229.8 | 24.62
0.04 |
5.3 |
| FedP3 | 92.41
0.34 |
1.0 | 78.46
0.16 |
320.1 | 54.20
0.19 |
1951.6 | 17.69
0.05 |
13093.1 | 23.91
0.09 |
4.6 |
| FedLPS | 96.77 0.11 | 0.8 | 87.43 0.19 | 268.5 | 62.80 0.05 | 1706.7 | 21.48 0.12 | 9307.3 | 26.17 0.04 | 4.2 |