notesum.ai

Published at October 31

Metamorphic Malware Evolution: The Potential and Peril of Large Language Models

cs.CR

cs.LG

Released Date: October 31, 2024

Authors: Pooria Madani¹

Aff.: ¹Ontario Tech University, Oshawa, Canada

Arxiv: http://arxiv.org/abs/2410.23894v1

Model

Params

HumanEval pass@1

Closed Source

GPT-3.5 [19]

175B

48.10%

GPT-4 [3]

100T

67.00%

Codex [6]

12B

28.80%

AlphaCode [18]

1.1B

14.00%

Phi-1 [20]

1.3B

50.6%

Open Source

CodeGen-Multi [16]

CodeGen-Mono [16]

16B

29.3%

CodeGen2 [21]

16B

19.1%

StarCoder [22]

15.5B

33.6%

CodeT5+ [23]

16B

30.90%

CodeParret [24]

1.5M

3.58%

SantaCoder [25]

1.1B

14.00%

WizardCoder [26]

16B

57.3%