notesum.ai

Published at November 20

"It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models

cs.HC

cs.AI

cs.CY

Released Date: November 20, 2024

Authors: Angel Hsing-Chi Hwang¹, Q. Vera Liao², Su Lin Blodgett², Alexandra Olteanu², Adam Trischler²

Aff.: ¹University of Southern California, USA; ²Microsoft Research Montréal, Canada

Arxiv: http://arxiv.org/abs/2411.13032v1

Participant	Primary Writing Genre	Years of Experience	Experience with genAI
P1	Science fiction, fantasy	5 - 10	P1 regularly used genAI tools but only for text editing purposes.
P2	Comedy, science fiction	10 - 15	P2 frequently used genAI tools for a wide range of purposes and was familiar with genAI models, such as GPT-3 and GPT-4.
P3	Lifestyle	$<$ 5	P3 regularly used genAI tools for text editing purposes (specifically for personal blog posts). They occasionally used genAI to brainstorm ideas for titles of their written work.
P4	Science writing	$<$ 5	P4 regularly used genAI tools but only for text editing purposes.
P5	Fantasy	$<$ 5	P5 had no experience with genAI at the time of the study.
P6	Lifestyle	5 - 10	P6 regularly used genAI tools but only for text editing purposes.
P7	History	15 - 20	P7 regularly used genAI tools to rewrite and make their drafts clearer.
P8	Science fiction	10 - 15	P8 had no experience with genAI at the time of the study.
P9	Lifestyle	$<$ 5	P9 regularly used genAI tools but only for text editing purposes.
P10	Biography	$>$ 20	P10 had no experience with genAI at the time of the study.
P11	Science writing	5 - 10	P11 had experimented with and explored the capabilities of various genAI tools. They did not find these tools useful for their writing jobs and thus did not use them regularly.
P12	Poetry	$>$ 20	P12 regularly used genAI tools to conduct research for their writing and used them for text editing purposes.
P13	Horror	10 - 15	P13 occasionally used genAI tools to write informational content.
P14	Romance	5 - 10	P14 used genAI tools for general purposes but not for writing.
P15	Spiritual	5 - 10	P15 had no experience with genAI at the time of the study.
P16	Romance	5 - 10	P16 regularly used genAI tools but only for text editing purposes.
P17	Science fiction	$<$ 5	P17 regularly used genAI tools but for text editing purposes; such practice was requested by many of their clients. For a specific client, the participant was provided with informational content generated by genAI and was asked to provide ”human voice” to the writing.
P18	Fantasy	5 - 10	P18 frequently used genAI tools to generate written content for a client.
P19	Screenplay	$>$ 20	P19 regularly used genAI tools to generate visual content accompanying their writing work. They also frequently used genAI tools to help with formatting their writing.