notesum.ai

Published at November 2

Infant Agent: A Tool-Integrated, Logic-Driven Agent with Cost-Effective API Usage

cs.AI

cs.CL

Released Date: November 2, 2024

Authors: Bin Lei, Yuchen Li, Yiming Zeng, Tao Ren, Yi Luo, Tianyu Shi, Zitian Gao, Zeyu Hu, Weitai Kang, Qiuwu Chen

Arxiv: http://arxiv.org/abs/2411.01114v1

Refer to caption

Method	Name	% Resolved	Model Used	Agent Scope	Open Source
Agent	MarsCode Agent	$39.33$	-	Code IDE	\faLock
	Honeycomb	$38.33$	-	-	\faLock
	Gru	$35.67$	-	Code IDE	\faLock
	Isoform	$35.00$	-	Auto. Software Dev.	\faLock
	SuperCoder2.0	$34.00$	-	Auto. Software Dev.	\faLock
	MarsCode Agent	$34.00$	4o	Code IDE	\faLock
	Lingma Agent	$33.00$	-	Fix Github issue	\faLock
	AutoCodeRover	$30.67$	4o	Fix Github issue	✓
	Infant Agent	$30.00$	4o	AI engineer	-
	Q Developer Agent	$29.67$	-	AI engineer	\faLock
	Agentless + RepoGraph	$29.67$	4o	Fix Github issue	✓
	CodeR	$28.33$	4	Fix Github issue	\faLock
	MASAI	$28.00$	4o	Fix Github issue	\faLock
	SIMA	$27.67$	4o	Fix Github issue	\faLock
	Agentless	$27.33$	4o	Fix Github issue	✓
	Moatless Tools	$26.67$	3.5 S.	Fix Github issue	✓
	OpenDevin	$26.67$	3.5 S.	AI engineer	✓
	Agent-101	$26.67$	4o	AI engineer	\faLock
	Aider	$26.33$	-	AI engineer	\faLock
	HyperAgent	$25.33$	-	AI engineer	\faLock
	Moatless Tools	$24.67$	4o	Fix Github issue	✓
	IBM SWE-1.0	$23.67$	-	AI engineer	\faLock
	GenAgent	$23.67$	4	AI engineer	\faLock
	SWE-agent	$23.00$	3.5 S.	AI engineer	✓
	OpenDevin	$22.00$	4o	AI engineer	✓
	Navie Agent	$21.67$	4o	Auto. Software Dev.	✓
	AutoSE	$21.67$	4o	-	\faLock
	Q Developer Agent	$20.33$	4o	AI engineer	\faLock
	AutoCodeRover	$19.00$	4	Fix Github issue	\faLock
	SWE-agent	$18.33$	4o	AI engineer	✓
	SWE-agent	$18.00$	4	AI engineer	✓
RAG	-	$4.33$	3 Opus	-	-
	-	$3.00$	2	-	-
	-	$2.67$	4	-	-
0-shot	-	$1.33$	3.5 S.	-	-
0-shot	-	$0.33$	4o	-	-