notesum.ai

Published at November 22

Understanding LLM Embeddings for Regression

cs.AI

cs.CL

Released Date: November 22, 2024

Authors: Eric Tang¹, Bangding Yang², Xingyou Song³

Aff.: ¹Stanford University; ²Google; ³Google DeepMind

Arxiv: http://arxiv.org/abs/2411.14708v1

Refer to caption

Task Name	Avg. DOF	T5-Small %	T5-XXL %	Gemini Nano %	Gemini Pro %
Init2Winit	4	6.7	8.0	11.3	19.0
L2DA	10	2.7	12.0	9.3	10.7
AutoML	29	30.7	41.3	29.3	36.0
XLA	35	17.2	29.3	18.9	24.1