notesum.ai

Published at November 21

G-RAG: Knowledge Expansion in Material Science

cs.IR

cs.AI

Released Date: November 21, 2024

Authors: Radeen Mostafa¹, Mirza Nihal Baig², Mashaekh Tausif Ehsan³, Jakir Hasan²

Aff.: ¹magicmind.me, USA; ²Department of Computer Science and Engineering, Shahjalal University of Science and Technology; ³Department of Mechanical Engineering, Bangladesh University of Engineering and Technology

Arxiv: http://arxiv.org/abs/2411.14592v1

Pipeline	Score	No. of queries	Mean	Standard Deviation
Naive RAG	Correctness	10	2.43	1.51
	Faithfulness		0.70	0.48
	Relevancy		0.39	0.28
Graph RAG	Correctness	10	3.30	2.00
	Faithfulness		0.90	0.32
	Relevancy		0.18	0.26
G-RAG	Correctness	10	3.90	1.10
	Faithfulness		0.90	0.32
	Relevancy		0.34	0.32