notesum.ai

Published at December 4

Best-of-N Jailbreaking

cs.CL

cs.AI

cs.LG

Released Date: December 4, 2024

Authors: John Hughes¹, Sara Price², Aengus Lynch³, Rylan Schaeffer⁴, Fazl Barez⁵, Sanmi Koyejo⁴, Henry Sleight², Erik Jones⁶, Ethan Perez⁶, Mrinank Sharma⁶

Aff.: ¹Speechmatics; ²MATS; ³UCL; ⁴Stanford University; ⁵University of Oxford; ⁶Anthropic

Arxiv: http://arxiv.org/pdf/2412.03556v1

	Claude Sonnet	Claude Opus	Gemini Flash	Gemini Pro	GPT-4o	GPT-4o-Mini
T=1	46.0%	44.7%	15.5%	14.9%	24.3%	26.4%
T=0	51.7%	50.3%	23.4%	15.0%	27.6%	28.7%