notesum.ai
Published at October 22Semantic-guided Search for Efficient Program Repair with Large Language Models
cs.SD
cs.AI
eess.AS
Released Date: October 22, 2024
Authors: Thanh Le-Cong1, Bach Le1, Toby Murray1
Aff.: 1The University of Melbourne, Australia

| Model | O + BS | Q + BS | O + SeqBS | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 10 | 25 | 50 | 100 | 200 | 10 | 25 | 50 | 100 | 200 | 10 | 25 | 50 | 100 | 200 | |
| CodeGen-2B | 66 | 80 | 87 | 75 | 38 | 64 | 80 | 98 | 107 | 89 | 65 | 73 | 80 | 70 | 27 |
| CodeGen-6B | 72 | 93 | 75 | 39 | 11 | 65 | 95 | 114 | 91 | 55 | 62 | 91 | 74 | 39 | 5 |
| InCoder-1B | 74 | 108 | 119 | 120 | 96 | 71 | 102 | 124 | 134 | 126 | 69 | 104 | 107 | 109 | 65 |
| InCoder-6B | 77 | 95 | 92 | 61 | 27 | 77 | 100 | 123 | 114 | 83 | 75 | 88 | 76 | 34 | 14 |
| RepairLlama | 139 | 169 | 160 | 134 | 75 | _ | _ | _ | _ | _ | _ | _ | _ | _ | _ |