notesum.ai

Published at December 3

DP-2Stage: Adapting Language Models as Differentially Private Tabular Data Generators

cs.LG

cs.CL

cs.CR

D.4.6; G.3; I.2.7

Released Date: December 3, 2024

Authors: Tejumade Afonja¹, Hui-Po Wang, Raouf Kerkouche, Mario Fritz

Aff.: ¹CISPA Helmholtz Center for Information Security

Arxiv: http://arxiv.org/pdf/2412.02467v1

Refer to caption

		Adult					Airline
	Method	F1	AUC	ACC	HIST		F1	AUC	ACC	HIST
	Real data	69.9 $\pm$ 2	91.7 $\pm$ 1	84.0 $\pm$ 4	99.1 $\pm$ 0		90.6 $\pm$ 8	96.2 $\pm$ 5	91.8 $\pm$ 7	99.4 $\pm$ 0
$\varepsilon=\infty$	CTGAN	59.5 $\pm$ 6	88.5 $\pm$ 0	80.2 $\pm$ 3	91.2 $\pm$ 1		87.2 $\pm$ 3	94.7 $\pm$ 2	88.9 $\pm$ 3	94.4 $\pm$ 1
	TVAE	63.2 $\pm$ 2	87.5 $\pm$ 1	77.7 $\pm$ 4	91.5 $\pm$ 1		85.8 $\pm$ 5	93.0 $\pm$ 6	87.2 $\pm$ 6	90.3 $\pm$ 2
	VAE	53.8 $\pm$ 10	86.6 $\pm$ 1	80.5 $\pm$ 1	73.3 $\pm$ 3		79.8 $\pm$ 1	91.1 $\pm$ 1	80.0 $\pm$ 1	76.8 $\pm$ 0
	GPT-2	68.9 $\pm$ 0	90.7 $\pm$ 0	83.7 $\pm$ 2	90.7 $\pm$ 1		89.6 $\pm$ 5	95.9 $\pm$ 3	91.4 $\pm$ 4	90.8 $\pm$ 1