notesum.ai

Published at October 22

cs.CL

cs.AI

Released Date: October 22, 2024

Authors: Krishna Sayana¹, Raghavendra Vasudeva¹, Yuri Vasilevski¹, Kun Su¹, Liam Hebert¹, Hubert Pham¹, Ambarish Jash¹, Sukhdeep Sodhi¹

Aff.: ¹Google Research, Mountain View, California, USA

Output Feature	Metrics	CF	Content	CF + Content	(%) vs CF	(%) vs Content
Purchase reason	BLEU	17.71	21.07	21.92	+23.8%	+4.0%
	ROUGE-LSum	38.26	42.63	43.01	+12.4%	+0.9%
	Similarity	0.614	0.664	0.669	+9.0%	+0.8%
Purchase reason explanation	BLEU	19.56	21.68	24.24	+23.9%	11.8%
	ROUGE-LSum	37.26	38.05	41.11	+10.3%	+8.0%
	Similarity	0.783	0.787	0.851	+8.7%	8.1%
User Summary (Brief)	BLEU	17.96	19.3	19.12	+6.5%	-0.9%
	ROUGE-LSum	36.5	38.06	38.16	+4.5%	+0.3%
	Similarity	0.861	0.866	0.864	+0.3%	-0.2%
User Summary (Long)	BLEU	16.96	18.07	18.09	+6.7%	+0.1%
	ROUGE-LSum	31.61	33.35	33.42	+5.7%	+0.2%
	Similarity	0.885	0.895	0.903	+2.0%	+0.9%