notesum.ai

Published at November 6

Generating Synthetic Electronic Health Record (EHR) Data: A Review with Benchmarking

cs.LG

cs.AI

stat.ML

Released Date: November 6, 2024

Authors: Xingran Chen¹, Zhenke Wu¹, Xu Shi¹, Hyunghoon Cho², Bhramar Mukherjee³

Aff.: ¹Department of Biostatistics, University of Michigan; ²Department of Biomedical Informatics and Data Science, Yale University; ³Department of Biostatistics, Yale University

Arxiv: http://arxiv.org/abs/2411.04281v1

MIMIC-III
	Fidelity							Utility				Privacy
	MMD	RMSPE	MAPE	CFD	COFD	AUC	ACC	TSTR (AUC)	TSTR (ACC)	TSRTR (AUC)	TSRTR (ACC)	MIR (mean)	MIR (median)	AIR
	$\downarrow$	$\downarrow$	$\downarrow$	$\downarrow$	$\downarrow$	$\downarrow$	$\downarrow$	$\uparrow$	$\uparrow$	$\uparrow$	$\uparrow$	$\uparrow$	$\uparrow$	$\downarrow$
Resample	0.0040	0.17	7.18	4.42	29.50	0.476	0.500	0.007	0.005	0.008	0.006	0.97	0.00	0.952
Prevalence-based Random	0.0044	0.14	6.99	46.94	114.11	0.494	0.421	-0.287	-0.275	-0.014	-0.010	5.47	5.29	0.622
Synthea	0.7206	11.56	222.96	47.34	469.45	0.999	0.995	-0.149	-0.115	-0.004	-0.002	4.86	4.80	0.571
Plasmode	0.5945	127.41	1951.77	39.01	596.81	0.999	0.996	-0.268	-0.333	0.0003	0.001	4.53	4.58	0.595
MedGAN	0.1430	0.58	46.85	120.89	252.11	0.913	0.840	-0.063	-0.038	-0.003	0.003	2.93	2.83	0.874
CorGAN	0.0478	0.57	44.30	22.20	84.48	0.720	0.669	-0.078	-0.056	-0.020	-0.013	3.06	3.16	0.838
VAE	0.3083	0.94	92.67	44.05	345.86	0.984	0.943	-0.086	-0.063	-0.010	-0.002	3.88	4.00	0.845
PromptEHR	0.8593	2.47	91.31	24.03	762.25	0.990	0.957	-0.081	-0.049	-0.014	-0.011	3.48	3.46	0.839
EHRDiff	0.3381	18.30	245.55	31.98	337.31	0.995	0.967	-0.178	-0.216	-0.029	-0.024	3.66	3.61	0.737
MIMIC-IV
Resample	0.2363	1047.70	11849.43	30.15	1103.51	0.898	0.854	-0.066	-0.028	-0.0009	0.005	2.58	2.00	0.766
Prevalence-based Random	0.3740	1092.77	12540.96	44.92	1153.67	0.956	0.914	-0.254	-0.168	-0.005	-0.001	2.96	2.45	0.694
Synthea	0.7216	727.39	5689.49	58.61	1491.42	0.999	0.993	-0.127	-0.092	-0.001	-0.002	3.80	3.46	0.597
Plasmode	0.5970	5844.53	84377.27	53.23	1535.78	0.999	0.999	-0.218	-0.206	0.000	-0.0002	3.98	3.46	0.497
MedGAN	0.2377	797.89	9259.80	107.59	1017.83	0.962	0.916	-0.076	-0.059	-0.0007	0.004	2.83	2.45	0.714
CorGAN	0.2335	959.54	10549.75	38.92	1152.84	0.927	0.883	-0.131	-0.081	-0.004	0.001	2.86	2.45	0.732
VAE	0.2360	680.68	6566.97	53.89	1430.53	0.978	0.923	-0.123	-0.074	-0.004	0.004	3.44	3.16	0.765
PromptEHR	0.8686	113.46	1418.71	39.09	887.76	0.995	0.980	-0.117	-0.066	-0.003	0.004	3.09	2.83	0.750
EHRDiff	0.3176	1274.05	14207.65	44.11	1309.36	0.995	0.981	-0.218	-0.152	-0.007	0.0008	3.04	2.65	0.675