notesum.ai

Published at November 27

Challenges in Adapting Multilingual LLMs to Low-Resource Languages using LoRA PEFT Tuning

cs.CL

cs.LG

Released Date: November 27, 2024

Authors: Omkar Khade¹, Shruti Jagdale¹, Abhishek Phaltankar¹, Gauri Takalikar¹, Raviraj Joshi²

Aff.: ¹Pune Institute of Computer Technology, Pune, India; Indian Institute of Technology Madras, Chennai, India; ²Indian Institute of Technology Madras, Chennai, India; L3Cube Labs Pune, India

Arxiv: http://arxiv.org/abs/2411.18571v1

MODEL	F1 Scores
	indicsentiment	ai2_arc-easy	arc challenge	indic copa	indic xnli
gemma-2b	0.7772	0.4435	0.4240	0.6547	0.3582
gemma-2b-it	0.7444	0.4651	0.4043	0.2963	0.3066
gemma-2b (Mr)	0.9397	0.6048	0.3848	0.4219	0.1675