notesum.ai

Published at December 10

MoDULA: Mixture of Domain-Specific and Universal LoRA for Multi-Task Learning

cs.LG

cs.AI

Released Date: December 10, 2024

Authors: Yufei Ma¹, Zihan Liang, Huangyu Dai, Ben Chen, Dehong Gao, Zhuoran Ran, Wang Zihan, Linbo Jin, Wen Jiang, Guannan Zhang, Xiaoyan Cai, Libin Yang

Aff.: ¹Northwestern Polytechnical University, School of Cybersecurity, Xi'an, China

Arxiv: http://arxiv.org/pdf/2412.07405v1

Benchmark	Few-Shot	Metric
GSM8K	5	acc
Arithmetic	0	acc
MathQA	5	acc
HumanEval	0	pass@1
MBPP	0	pass@1
Medical	5	acc
MedQA	0	acc
MMLU	5	acc
C-Eval	5	acc
FinGPT-headline	0	acc
Title-Optimization	0	GPT-4 Judge
Keyword-Recommendation	0	GPT-4 Judge