notesum.ai
Published at December 6Evaluating and Aligning CodeLLMs on Human Preference
cs.CL
Released Date: December 6, 2024
Authors: Jian Yang1, Jiaxi Yang2, Ke Jin1, Yibo Miao3, Lei Zhang2, Liqun Yang1, Zeyu Cui1, Yichang Zhang1, Binyuan Hui1, Junyang Lin1
Aff.: 1Alibaba Group; 2Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences; 3Shanghai Jiao Tong University

| Statistics | Number |
| Problems | |
| User Interface&Experience | |
| Development&Programming | |
| Specialized Computing | |
| Tools, Environments, and Application | |
| Miscellaneous and General Inquiry | |
| Databases&Data Handling | |
| Miscellaneous and General Inquiry | |
| #Difficulty Level | |
| - Easy/Medium/Hard | // |
| Length | |
| Question | |
| - maximum length | tokens |
| - minimum length | tokens |
| - avg length | tokens |
| Baseline Answer | |
| - maximum length | tokens |
| - minimum length | tokens |
| - avg length | tokens |