notesum.ai

Published at November 29

On Domain-Specific Post-Training for Multimodal Large Language Models

cs.CL

cs.CV

cs.LG

Released Date: November 29, 2024

Authors: Daixuan Cheng¹, Shaohan Huang², Ziyu Zhu³, Xintong Zhang⁴, Wayne Xin Zhao⁵, Zhongzhi Luan², Bo Dai¹, Zhenliang Zhang¹

Aff.: ¹State Key Laboratory of General Artificial Intelligence, BIGAI; ²Beihang University; ³State Key Laboratory of General Artificial Intelligence, BIGAI, Tsinghua University; ⁴State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing Institute of Technology; ⁵Renmin University of China

Arxiv: http://arxiv.org/pdf/2411.19930v1

User: <Image>Describe the image.

Assistant: {Caption}

User: Answer with a precise response. {Instruction}

Assistant: {Precise Response}

User: Answer with an informative response. {Instruction}

Assistant: {Informative Response}