notesum.ai

Published at November 16

One-Layer Transformer Provably Learns One-Nearest Neighbor In Context

cs.AI
math.OC

Released Date: November 16, 2024

Authors: Zihao Li1, Yuan Cao2, Cheng Gao1, Yihan He1, Han Liu3, Jason M. Klusowski1, Jianqing Fan1, Mengdi Wang1

Aff.: 1Princeton University; 2The University of Hong Kong; 3Northwestern University

Arxiv: http://arxiv.org/abs/2411.10830v1