notesum.ai

Published at December 5

MIND: Effective Incorrect Assignment Detection through a Multi-Modal Structure-Enhanced Language Model

cs.CL

cs.AI

Released Date: December 5, 2024

Authors: Yunhe Pang¹, Bo Chen², Fanjin Zhang², Yanghui Rao¹, Jie Tang³

Aff.: ¹School of Computer Science and Engineering, Sun Yat-Sen University; ²Department of Computer Science and Technology, Tsinghua University; ³Department of Computer Science, Tsinghua University

Arxiv: http://arxiv.org/pdf/2412.03930v1

Model	Modality	AUC	MAP
ChatGLM3-6B	base	0.737	0.786
	+sem	0.742	0.783
	+graph	0.748	0.790
Qwen2-7B	base	0.743	0.783
	+sem	0.751	0.789
	+graph	0.761	0.794
Llama3-8B	base	0.751	0.787
	+sem	0.768	0.795
	+graph	0.784	0.810