notesum.ai

Published at October 22

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

cs.AI
cs.NE

Released Date: October 22, 2024

Authors: Yuheng Lu1, Bingshuo Qian1, Caixia Yuan1, Huixing Jiang2, Xiaojie Wang1

Aff.: 1Beijing University of Posts and Telecommunications; 2LI Auto Inc.

Arxiv: https://arxiv.org/abs/2410.16801v1