notesum.ai

Published at November 8

Enhancing Cluster Resilience: LLM-agent Based Autonomous Intelligent Cluster Diagnosis System and Evaluation Framework

cs.AI

cs.DC

68T42

Released Date: November 8, 2024

Authors: Honghao Shi, Longkai Cheng, Wenli Wu, Yuhang Wang, Xuan Liu, Shaokai Nie, Weixv Wang, Xuebin Min, Chunlei Men, Yonghua Lin

Arxiv: http://arxiv.org/abs/2411.05349v1

Refer to caption

Model	Inference on 1 A800 GPU	Inference in 1 A800*8 Server	Score on Metric A	Score on Metric B	Score on Metric C
Llama3.1-70B	no	yes	0.8658	0.0	0.0
Nemotron-70B	no	yes	0.7315	0.0	0.0
Mistral-120B	no	no	0.7383	0.0	0.0
Llama3.2-3B	yes	yes	0.047	0.0	0.0