notesum.ai

Published at October 21

RAG4ITOps: A Supervised Fine-Tunable and Comprehensive RAG Framework for IT Operations and Maintenance

cs.SE

cs.AI

cs.HC

Released Date: October 21, 2024

Authors: Tianyang Zhang¹, Zhuoxuan Jiang², Shengguang Bai¹, Tianrui Zhang³, Lin Lin⁴, Yang Liu⁵, Jiawei Ren¹

Aff.: ¹Learnable.ai, Shanghai, China; ²Shanghai Business School, Shanghai, China; ³University of North Carolina Greensboro, Greensboro, NC, USA; ⁴Skema Business School, Paris, France; ⁵North Carolina Central University, Durham, NC, USA

Arxiv: https://arxiv.org/abs/2410.15805v1

HIS	AHNS	QA for KA			QA for TS
HIS	AHNS	Acc@1	Acc@5	Acc@20	Acc@1	Acc@5	Acc@20
-	-	0.661	0.895	0.970	0.711	0.771	0.790
+	-	0.650	0.903	0.974	0.735	0.783	0.795
-	+	0.665	0.915	0.970	0.721	0.783	0.795
+	+	0.661	0.919	0.979	0.759	0.795	0.795