notesum.ai

Published at November 4

Enhancing ID-based Recommendation with Large Language Models

cs.IR

cs.AI

Released Date: November 4, 2024

Authors: Lei Chen¹, Chen Gao¹, Xiaoyi Du², Hengliang Luo², Depeng Jin¹, Yong Li¹, Meng Wang³

Aff.: ¹Tsinghua University, China; ²Meituan, China; ³Hefei University of Technology, China

Arxiv: http://arxiv.org/abs/2411.02041v1

Refer to caption

Model	Recall@10	NDCG@10	Recall@20	NDCG@20	Recall@50	NDCG@50
BPR	0.02778	0.03106	0.04914	0.03946	0.09772	0.05788
BPR+LLM4IDRec	0.02879	0.03215	0.05111	0.04064	0.10113	0.05927
Improv.	3.64%	3.51%	4.01%	2.99%	3.49%	2.40%
SimGCL	0.04218	0.04839	0.07137	0.05892	0.13569	0.08261
SimGCL+LLM4IDRec	0.04393	0.05019	0.07371	0.06089	0.13991	0.08533
Improv.	4.15%	3.72%	3.28%	3.34%	3.11%	3.29%
NCL	0.03946	0.04516	0.06693	0.05513	0.12726	0.0782
NCL+LLM4IDRec	0.04098	0.04694	0.06921	0.06921	0.13112	0.08014
Improv.	3.85%	3.94%	3.41%	2.55%	3.03%	2.48%
XSimGCL	0.04249	0.04859	0.07234	0.05943	0.13864	0.08389
XSimGCL+LLM4IDRec	0.04411	0.05036	0.07394	0.06104	0.14075	0.08581
Improv.	3.81%	3.64%	2.21%	2.71%	1.52%	2.29%
P5	0.04286	0.04951	0.07307	0.06050	0.13974	0.08558
P5+LLM4IDRec	0.04428	0.05110	0.07556	0.06220	0.14395	0.08804
Improv.	3.32%	3.21%	3.41%	2.81%	3.01%	2.88%