notesum.ai

Published at November 12

Circuit Complexity Bounds for RoPE-based Transformer Architecture

cs.LG
cs.AI
cs.CC
cs.CL

Released Date: November 12, 2024

Authors: Bo Chen1, Xiaoyu Li1, Yingyu Liang1, Jiangxuan Long1, Zhenmei Shi1, Zhao Song1

Aff.: 1Institution not specified

Arxiv: http://arxiv.org/abs/2411.07602v1