notesum.ai

Published at December 6

A Practical Examination of AI-Generated Text Detectors for Large Language Models

cs.CL

cs.AI

Released Date: December 6, 2024

Authors: Brian Tufts¹, Xuandong Zhao², Lei Li¹

Aff.: ¹Carnegie Mellon University; ²UC Berkeley

Arxiv: http://arxiv.org/pdf/2412.05139v1

Refer to caption

Detector	TPR@0.01	TPR@0.05	TPR@0.1	AUROC
Radar	0.05	0.15	0.27	0.6009
Fast-DetectGPT	0.49	0.61	0.68	0.8405
Wild	0.11	0.19	0.29	0.6841
PHD	0.08	0.23	0.37	0.6790
LogRank	0.09	0.40	0.50	0.7763
T5Sentinel	0.03	0.09	0.14	0.5179
Binoculars	0.58	0.67	0.72	0.8485