notesum.ai
Published at November 22LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
cs.CV
Released Date: November 22, 2024
Authors: Jieming Bian1, Lei Wang1, Letian Zhang2, Jie Xu1
Aff.: 1University of Florida; 2Middle Tennessee State University

| DomainNet | Clipart | Infograph | Painting | Quickdraw | Real | Sketch | Average | ||
|---|---|---|---|---|---|---|---|---|---|
| ViT | FFA-LoRA | 81.75 | 51.96 | 77.51 | 61.83 | 88.68 | 75.20 | 72.82 | |
| FedIT | 84.37 | 54.17 | 79.67 | 69.00 | 89.20 | 78.08 | 75.75 | ||
| FLoRA | 83.70 | 53.51 | 79.43 | 70.09 | 89.25 | 77.20 | 75.53 | ||
| FlexLoRA | 85.15 | 53.93 | 79.82 | 70.01 | 89.42 | 77.85 | 76.02 | ||
| LoRA-FAIR | 86.25 | 56.26 | 80.09 | 71.25 | 89.52 | 79.06 | 77.07 | ||
| MLP-Mixer | FFA-LoRA | 69.74 | 37.15 | 66.43 | 38.66 | 80.94 | 57.49 | 58.40 | |
| FedIT | 74.69 | 41.89 | 70.57 | 51.53 | 83.25 | 64.31 | 64.37 | ||
| FLoRA | 74.39 | 41.33 | 69.91 | 53.83 | 82.75 | 64.08 | 64.38 | ||
| FlexLoRA | 75.11 | 41.62 | 70.49 | 53.29 | 83.41 | 64.79 | 64.79 | ||
| LoRA-FAIR | 75.92 | 43.21 | 70.42 | 55.62 | 83.43 | 66.62 | 65.87 | ||
| NICO++ | Autumn | Dim | Grass | Outdoor | Rock | Water | Average | ||
| ViT | FFA-LoRA | 91.26 | 88.19 | 93.29 | 89.84 | 90.51 | 88.60 | 90.28 | |
| FedIT | 91.64 | 88.87 | 93.09 | 90.05 | 90.87 | 88.96 | 90.58 | ||
| FLoRA | 91.48 | 89.47 | 93.33 | 90.38 | 90.83 | 90.05 | 90.93 | ||
| FlexLoRA | 91.26 | 88.91 | 93.16 | 90.41 | 90.78 | 89.09 | 90.60 | ||
| LoRA-FAIR | 92.47 | 89.35 | 93.73 | 90.56 | 91.01 | 90.34 | 91.24 | ||
| MLP-Mixer | FFA-LoRA | 83.34 | 76.82 | 84.70 | 80.14 | 79.30 | 75.97 | 80.05 | |
| FedIT | 85.21 | 79.62 | 86.01 | 82.44 | 83.10 | 78.65 | 82.51 | ||
| FLoRA | 85.10 | 79.70 | 86.03 | 82.12 | 82.24 | 75.52 | 82.29 | ||
| FlexLoRA | 86.31 | 79.82 | 86.60 | 82.77 | 83.05 | 79.73 | 83.08 | ||
| LoRA-FAIR | 86.09 | 81.06 | 86.79 | 82.71 | 84.09 | 80.60 | 83.56 |