notesum.ai

Published at December 9

Vulnerability of Text-Matching in ML/AI Conference Reviewer Assignments to Collusions

cs.LG

cs.CR

cs.DL

Released Date: December 9, 2024

Authors: Jhih-Yi, Hsieh, Aditi Raghunathan¹, Nihar B. Shah¹

Aff.: ¹School of Computer Science, Carnegie Mellon University

Arxiv: http://arxiv.org/pdf/2412.06606v1

Refer to caption

	Attack Success Rates ( $\pm$ SE)			Manipulated Rankings
Natural Rankings	Top-1	Top-3	Top-5	Mean
Natural Rankings	Top-1	Top-3	Top-5	95% CI
101	$66\pm 5\text{\,}\mathrm{\char 37\relax}$	$84\pm 4\text{\,}\mathrm{\char 37\relax}$	$88\pm 3\text{\,}\mathrm{\char 37\relax}$	3.23
101	$66\pm 5\text{\,}\mathrm{\char 37\relax}$	$84\pm 4\text{\,}\mathrm{\char 37\relax}$	$88\pm 3\text{\,}\mathrm{\char 37\relax}$	[2.11, 4.35]
501	$60\pm 5\text{\,}\mathrm{\char 37\relax}$	$76\pm 4\text{\,}\mathrm{\char 37\relax}$	$83\pm 4\text{\,}\mathrm{\char 37\relax}$	6.58
501	$60\pm 5\text{\,}\mathrm{\char 37\relax}$	$76\pm 4\text{\,}\mathrm{\char 37\relax}$	$83\pm 4\text{\,}\mathrm{\char 37\relax}$	[3.47, 9.69]
1001	$48\pm 5\text{\,}\mathrm{\char 37\relax}$	$63\pm 5\text{\,}\mathrm{\char 37\relax}$	$67\pm 5\text{\,}\mathrm{\char 37\relax}$	15.68
1001	$48\pm 5\text{\,}\mathrm{\char 37\relax}$	$63\pm 5\text{\,}\mathrm{\char 37\relax}$	$67\pm 5\text{\,}\mathrm{\char 37\relax}$	[6.82, 24.54]