notesum.ai

Published at November 11

Richer Output for Richer Countries: Uncovering Geographical Disparities in Generated Stories and Travel Recommendations

cs.CL

cs.AI

cs.CY

cs.LG

Released Date: November 11, 2024

Authors: Kirti Bhagat¹, Kinshuk Vasisht¹, Danish Pruthi¹

Aff.: ¹Indian Institute of Science, Bengaluru, KA, India

Arxiv: http://arxiv.org/abs/2411.07320v1

Refer to caption

Scenario	Attribute	GPT4		Mixtral 8x7B		LLaMa3 8B		LLaMa3 70B
Travel		GDP	Freq	GDP	Freq	GDP	Freq	GDP	Freq
Rec.	Uniqueness	$~{}~{}0.39^{*}$	$~{}~{}0.47^{*}$	$~{}~{}0.35^{*}$	$~{}~{}0.48^{*}$	$~{}~{}0.27^{*}$	$~{}~{}0.53^{*}$	$~{}~{}0.31^{*}$	$~{}~{}0.45^{*}$
	# Geo-entities	$~{}~{}0.20^{*}$	$~{}~{}0.14~{}~{}$	$~{}~{}0.16^{*}$	$~{}~{}0.19^{*}$	$~{}~{}0.12~{}~{}$	$~{}~{}0.22^{*}$	$~{}~{}0.42^{*}$	$~{}~{}0.30^{*}$
	Absence of Info	$-0.37^{*}$	$-0.04~{}~{}$	$-0.25^{*}$	$-0.02~{}~{}$	—	—	—	—
Story	Uniqueness	$~{}~{}0.25^{*}$	$~{}~{}0.41^{*}$	$~{}~{}0.15^{*}$	$~{}~{}0.32^{*}$	$~{}~{}0.28^{*}$	$~{}~{}0.39^{*}$	$~{}~{}0.26^{*}$	$~{}~{}0.38^{*}$
Gen.	# Geo-entities	$~{}~{}0.49^{*}$	$~{}~{}0.37^{*}$	$~{}~{}0.48^{*}$	$~{}~{}0.41^{*}$	$~{}~{}0.46^{*}$	$~{}~{}0.44^{*}$	$~{}~{}0.49^{*}$	$~{}~{}0.43^{*}$
	Emotion (Hardship)	$-0.54^{*}$	$-0.20^{*}$	$-0.50^{*}$	$-0.20^{*}$	$-0.42^{*}$	$-0.17^{*}$	$-0.46^{*}$	$-0.16^{*}$
	Emotion (Sadness)	$-0.45^{*}$	$-0.17^{*}$	$-0.34^{*}$	$-0.13~{}~{}$	$-0.32^{*}$	$-0.12~{}~{}$	$-0.30^{*}$	$-0.10~{}~{}$