notesum.ai

Published at November 18

Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering

cs.AI

cs.CL

stat.ML

Released Date: November 18, 2024

Authors: Xinyan Guan¹, Yanjiang Liu¹, Xinyu Lu¹, Boxi Cao¹, Ben He¹, Xianpei Han¹, Le Sun¹, Jie Lou¹, Bowen Yu¹, Yaojie Lu¹, Hongyu Lin¹

Aff.: ¹Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences

Arxiv: http://arxiv.org/abs/2411.11504v1

Refer to caption

	Feature Engineering	Data Engineering	Verifier Engineering
Representative Models	Machine Learning Models	Deep Learning Models	Foundation Models
e.g.	SVM, XGBoost	CNN, LSTM	LLMs, VLMs
Supervision	Manual Features	Human Annotations	Verifier Feedback
Scope	Task-Specific	Multiple Related Tasks	General Intelligence
Generalization	Limited	Relatively high	High
Scalability	Limited	Moderate	High