notesum.ai

Published at October 18

Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs

cs.RO

cs.AI

Released Date: October 18, 2024

Authors: Runchu Tian¹, Yanghao Li¹, Yuepeng Fu¹, Siyang Deng², Qinyu Luo¹, Cheng Qian¹, Shuo Wang¹, Xin Cong¹, Zhong Zhang¹, Yesai Wu², Yankai Lin³, Huadong Wang², Xiaojiang Liu⁴

Aff.: ¹Tsinghua University; ²ModelBest Inc.; ³Renmin University of China; ⁴Apple Inc.

Arxiv: https://arxiv.org/abs/2410.14641v1