notesum.ai

Published at October 30

Why Gradient Subspace? Identifying and Mitigating LoRA's Bottlenecks in Federated Fine-Tuning of Large Language Models

cs.LG
cs.AI

Released Date: October 30, 2024

Authors: Navyansh Mahla, Ganesh Ramakrishnan

Arxiv: http://arxiv.org/abs/2410.23111v1