notesum.ai

Published at December 3

cs.RO

cs.SY

eess.SY

Released Date: December 3, 2024

Authors: Pranav Doma¹, Aliasghar Arab¹, Xuesu Xiao²

Aff.: ¹New York University; ²George Mason University

Model	Strategy	Instruction Adherence (%)	Completeness of Response (%)	Safety Compliance (%)
Mistral	Navigate Quickly	28.57	42.85	14.28
	Maximize Safety	85.71	71.42	89.28
	Balance Efficiency and Safety	71.42	85.71	89.28
Llama3.1	Navigate Quickly	57.14	71.42	64.28
	Maximize Safety	85.71	71.42	91.42
	Balance Efficiency and Safety	89.28	88.57	92.85
LLama3	Navigate Quickly	82.14	64.28	71.42
	Maximize Safety	89.28	85.71	92.85
	Balance Efficiency and Safety	92.85	96.42	96.42