notesum.ai

Published at November 12

Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows

cs.CL

cs.AI

cs.DB

Released Date: November 12, 2024

Authors: Fangyu Lei¹, Jixuan Chen¹, Yuxiao Ye¹, Ruisheng Cao¹, Dongchan Shin¹, Hongjin Su¹, Zhaoqing Suo¹, Hongcheng Gao¹, Wenjing Hu¹, Pengcheng Yin², Victor Zhong³, Caiming Xiong⁴, Ruoxi Sun⁵, Qian Liu⁶, Sida Wang, Tao Yu¹

Aff.: ¹University of Hong Kong; ²Google Deepmind; ³University of Waterloo; ⁴Salesforce Research; ⁵Google Cloud AI Research; ⁶Sea AI Lab

Arxiv: http://arxiv.org/abs/2411.07763v1