notesum.ai

Published at December 6

EXAONE 3.5: Series of Large Language Models for Real-world Use Cases

cs.CL

Released Date: December 6, 2024

Authors: LG AI Research¹, Soyoung An, Kyunghoon Bae, Eunbi Choi, Kibong Choi, Stanley Jungkyu Choi, Seokhee Hong, Junwon Hwang, Hyojin Jeon, Gerrard Jeongwon Jo, Hyunjik Jo, Jiyeon Jung, Yountae Jung, Hyosang Kim, Joonkee Kim, Seonghwan Kim, Soyeon Kim, Sunkyoung Kim, Yireun Kim, Yongil Kim, Youchul Kim, Edward Hwayoung Lee, Haeju Lee, Honglak Lee, Jinsik Lee, Kyungmin Lee, Woohyung Lim, Sangha Park, Sooyoun Park, Yongmin Park, Sihoon Yang, Heuiyeen Yeen, Hyeongu Yun

Aff.: ¹University

Arxiv: http://arxiv.org/pdf/2412.04862v1

Models	Real-world Use Cases	Long Context	General Domain
EXAONE 3.5 32B	74.3	71.1	74.8
Qwen 2.5 32B [49]	69.8	66.9	78.7
C4AI Command R 32B [10]	46.0	63.4	56.8
Gemma 2 27B [48]	64.2	-	68.7
Yi 1.5 34B [2]	46.9	-	53.9
EXAONE 3.5 7.8B	70.7	66.6	70.2
Qwen 2.5 7B [49]	52.7	56.1	71.0
Llama 3.1 8B [15]	48.6	58.8	62.4
Gemma 2 9B [48]	57.9	-	62.9
Phi 3 small (7B) [1]	41.7	33.4	63.2
EXAONE 3.5 2.4B	61.1	63.4	63.3
Qwen 2.5 3B [49]	44.5	40.7	62.1
Qwen 2.5 1.5B [49]	30.1	34.5	47.9
Llama 3.2 3B [34]	36.7	44.2	54.9
Gemma 2 2B [48]	41.7	-	42.2