notesum.ai

Published at December 6

Sense and Sensitivity: Evaluating the simulation of social dynamics via Large Language Models

cs.CY

Released Date: December 6, 2024

Authors: Da Ju, Adina Williams¹, Brian Karrer¹, Maximilian Nickel¹

Aff.: ¹Meta FAIR

Arxiv: http://arxiv.org/pdf/2412.05093v1

Refer to caption

			Prompt $\theta_{\text{base}}$			Prompt $\theta_{\text{wording}}$			Prompt $\theta_{\text{logic}}$
$N$	$p$	$\epsilon$	Distance	Polarity %		Distance	Polarity %		Distance	Polarity %
20	0.3	0.9	1.1 (0.3)	15.7 (7.0)		1.5 (0.2)	26.3 (19.4)		2.5 (0.2)	58.0 (26.5)
20	0.5	0.9	1.4 (0.4)	15.5 (9.1)		1.6 (0.3)	18.4 (16.3)		2.3 (0.4)	55.8 (31.7)
20	0.9	0.9	1.0 (0.3)	9.2 (2.7)		1.7 (0.3)	23.2 (18.8)		2.3 (0.3)	48.4 (30.3)
20	1.0	0.9	1.2 (0.4)	11.8 (9.2)		1.7 (0.2)	44.0 (22.9)		2.2 (0.4)	49.3 (33.0)