notesum.ai
Published at November 22FedMLLM: Federated Fine-tuning MLLM on Multimodal Heterogeneity Data
cs.CL
cs.CV
Released Date: November 22, 2024
Authors: Binqian Xu1, Xiangbo Shu1, Haiyang Mei2, Guosen Xie1, Basura Fernando3, Mike Zheng Shou2, Jinhui Tang1
Aff.: 1Nanjing University of Science and Technology; 2Show Lab, National University of Singapore; 3Institute of High-Performance Computing, A*STAR

| Method | Hateful-Memes | CrisisMMD |
|---|---|---|
| FedYogi | 67.02 | 47.46 |
| 69.80(+2.78) | 49.46(+2.00) | |
| FedAdam | 67.35 | 51.88 |
| 69.00(+1.65) | 56.03(+4.15) | |
| FedAvgM | 61.50 | 31.31 |
| 62.97(+1.47) | 33.13(+1.82) | |
| FedAdagrad | 69.33 | 49.22 |
| 71.17(+1.84) | 49.56(+0.34) |