notesum.ai

Published at October 18

CELI: Controller-Embedded Language Model Interactions

cs.SE

cs.AI

cs.CL

68T50, 68Q32, 68N19

I.2.6; I.2.7; D.2.2

Released Date: October 18, 2024

Authors: Jan-Samuel Wagner¹, Dave DeCaprio¹, Abishek Chiffon Muthu Raja¹, Jonathan M. Holman¹, Lauren K. Brady¹, Sky C. Cheung¹, Hosein Barzekar¹, Eric Yang¹, Mark Anthony Martinez II¹, David Soong¹, Sriram Sridhar¹, Han Si¹, Brandon W. Higgs¹, Hisham Hamadeh¹, Scott Ogden¹

Aff.: ¹Genmab US, Inc.

Arxiv: https://arxiv.org/abs/2410.14627v1

Approach	Pass@1	$\Delta$ $\boldsymbol{\nabla}$
GPT-4-Turbo (1106) Base*	83.7%	–
GPT-4-Turbo (0125) Base**	86.6%	–
MapCoder* (Islam et al., 2024)	93.9%	+10.2
AgentCoder* (Huang et al., 2024)	89.6%	+5.9
LDB* (Zhong et al., 2024)	89.6%	+5.9
AgentVerse* (Chen et al., 2023)	89.0%	+5.3
CELI**	91.5%	+4.9