notesum.ai

Published at December 5

Bench-CoE: a Framework for Collaboration of Experts from Benchmark

cs.AI

Released Date: December 5, 2024

Authors: Yuanshuai Wang¹, Xingjian Zhang, Jinkun Zhao, Siwei Wen, Peilin Feng, Shuhao Liao, Lei Huang, Wenjun Wu

Aff.: ¹Institute of Artificial Intelligence, Beihang University

Arxiv: http://arxiv.org/pdf/2412.04167v1

Refer to caption

Model	Accuracy	Increment $\Delta{}$
Gemma-2-9b-it[28]	52.04%	0
Llama-3-Smaug-8B[21]	38.10%	-
Mathstral-7B-v0.1[12]	41.78%	-
Qwen2-7B-Instruct[31]	47.07%	-
Bench-CoE (Subject-Level)	52.24%	0.2%
Bench-CoE (Query-Level)	64.28%	+12.24%