notesum.ai

Published at October 31

Leveraging LLMs for MT in Crisis Scenarios: a blueprint for low-resource languages

cs.CL

cs.AI

Released Date: October 31, 2024

Authors: Séamus Lankford, Andy Way¹

Aff.: ¹ADAPT Centre, School of Computing, Dublin City University, Dublin, D09DXA0, Ireland

Arxiv: http://arxiv.org/abs/2410.23890v1

Hyperparameter	Values
Epochs	1, 3, 5
Batch size	8, 12, 16
Gradient steps	2, 4, 8
Learning rate	1 $\times 10^{-5}$ , 3 $\times 10^{-5}$ , 9 $\times 10^{-5}$
Weight decay	0.01, 0.1, 1, 2
Mixed precision	False, True