notesum.ai

Published at November 25

Fundamental Limits of Prompt Tuning Transformers: Universality, Capacity and Efficiency

cs.AI
cs.CL
stat.ML

Released Date: November 25, 2024

Authors: Jerry Yao-Chieh Hu1, Wei-Po Wang2, Ammar Gilani1, Chenyang Li3, Zhao Song4, Han Liu5

Aff.: 1Center for Foundation Models and Generative AI, Northwestern University, Evanston, IL 60208, USA; 2Department of Physics, National Taiwan University, Taipei 10617, Taiwan; 3Maynooth International School of Engineering, Fuzhou University, Fuzhou 350108, China; 4Simons Institute for the Theory of Computing, UC Berkeley, Berkeley, CA 94720, USA; 5Department of Statistics and Data Science, Northwestern University, Evanston, IL 60208, USA

Arxiv: http://arxiv.org/abs/2411.16525v1