notesum.ai

Published at December 10

Optimizing Alignment with Less: Leveraging Data Augmentation for Personalized Evaluation

cs.CL

cs.AI

Released Date: December 10, 2024

Authors: Javad Seraj¹, Mohammad Mahdi Mohajeri, Mohammad Javad Dousti, Majid Nili Ahmadabadi

Aff.: ¹University of Tehran

Arxiv: http://arxiv.org/pdf/2412.07429v1

Refer to caption

	BigGen-Bench	TruthfulQA
Seed for preference dataset	2 k	2.4 k
Naïve	2 k	2.4 k
Pool of feedback	4.9 k	6.7 k
Efficient sampling	2.3 k	2.2 k