notesum.ai

Published at November 20

cs.AI

cs.CL

Released Date: November 20, 2024

Authors: Mircea Lică, Ojas Shirekar¹, Baptiste Colle¹, Chirag Raman¹

Aff.: ¹Delft University of Technology

Capabilities	Task	Mistal-7B	Mixtral-8x7B	GPT-4
MindForge w/o interactions	Dirt	37.5%	29.15%	100%
MindForge instructive setting, human agent	Dirt	-	87%	100%
MindForge instructive setting, GPT-4 expert	Dirt	54.16%	66.66%	100%
MindForge collaborative setting, no expert	Dirt	33.3%	29.15%	-
MindForge w/o interactions	Wood	33.3%	50%	100%
MindForge instructive setting, GPT-4 expert	Wood	45.85%	70.8%	100%
MindForge collaborative setting, no expert	Wood	20.8%	45.85%	-