notesum.ai

Published at November 25

Towards Foundation Models for Critical Care Time Series

stat.ML

Released Date: November 25, 2024

Authors: Manuel Burger¹, Fedor Sergeev¹, Malte Londschien¹, Daphné Chopard¹, Hugo Yèche¹, Eike Gerdes¹, Polina Leshetkina¹, Alexander Morgenroth¹, Zeynep Babür¹, Jasmina Bogojeska¹, Martin Faltys¹, Rita Kuznetsova¹, Gunnar Rätsch¹

Aff.: ¹ETH Zurich

Arxiv: http://arxiv.org/abs/2411.16346v1

Dataset	Task	Single-Center							Multi-Center
		LR (Last Meas.)	LGBM (Last Meas.)	LGBM (Feat.)	GRU	Transformer	Mamba	xLSTM	LR (Last Meas.)	LGBM (Last Meas.)	LGBM (Feat.)	GRU	Transformer	Mamba	xLSTM
MIMIC-IV	Dec. 24h	93.7	95.4	97.3	95.8	95.7	95.8	95.8	92.0	94.7	96.1	95.8	95.0	95.0	95.7
	Circ. 8h	93.5	95.2	95.6	94.9	94.9	94.8	95.0	92.5	94.6	95.1	94.5	94.4	94.5	94.7
	Resp. 24h	76.4	79.7	81.1	79.9	79.7	79.7	79.8	74.1	78.7	79.9	79.3	78.9	79.5	79.5
	Kidn. 48h	83.2	87.5	89.8	88.3	87.7	87.9	88.3	81.6	86.9	89.2	87.8	86.2	88.1	88.3
eICU	Dec. 24h	91.1	93.0	95.8	93.4	93.3	93.4	93.5	89.1	92.4	93.9	92.8	92.4	92.9	93.1
	Circ. 8h	94.4	95.6	96.0	95.4	95.4	95.2	95.3	93.2	95.2	95.6	94.7	94.8	94.8	94.9
	Resp. 24h	79.2	82.1	83.6	82.8	82.3	82.2	82.1	78.1	81.7	82.5	81.8	81.3	81.8	82.1
	Kidn. 48h	74.5	82.0	85.6	83.7	82.9	83.3	83.8	73.0	81.0	84.2	82.1	81.5	82.7	83.1
HiRID	Dec. 24h	93.0	93.8	94.5	94.6	94.0	94.4	94.3	92.4	94.4	95.1	94.3	94.1	94.4	94.5
	Circ. 8h	90.8	91.9	92.6	92.3	92.0	92.0	92.2	90.7	92.1	92.8	92.6	92.4	92.3	92.6
	Resp. 24h	75.2	76.6	78.1	77.2	76.9	76.6	76.8	75.1	77.1	78.4	78.0	77.5	77.4	77.3
	Kidn. 48h	91.2	93.0	93.7	92.3	91.1	91.9	92.1	90.7	93.4	94.3	93.6	93.2	93.0	93.4
UMCdb	Dec. 24h	88.9	92.3	95.9	92.9	91.8	92.1	92.3	88.4	92.3	95.2	93.2	92.9	93.4	93.4
	Circ. 8h	96.2	97.1	97.5	97.6	97.3	97.3	97.5	95.7	97.0	97.7	97.8	97.7	97.7	97.8
	Resp. 24h	78.8	80.4	82.0	81.2	80.7	80.6	80.5	78.2	80.5	82.1	81.4	81.2	80.8	80.7
	Kidn. 48h	93.4	95.1	95.6	94.5	94.1	93.9	94.3	93.4	95.8	96.1	95.2	95.0	95.2	95.0
SICdb	Dec. 24h	83.7	88.1	88.8	87.9	86.7	87.2	87.8	81.8	88.8	90.9	89.2	89.2	89.0	89.6
	Circ. 8h	88.7	90.3	91.6	91.0	90.7	90.6	90.5	95.7	90.3	91.7	91.3	91.1	91.1	91.3
	Resp. 24h	77.9	80.8	81.4	80.7	80.2	80.3	80.1	78.2	80.9	81.7	81.1	80.7	81.2	81.0
	Kidn. 48h	87.3	89.4	90.8	88.9	87.7	88.3	88.1	93.4	90.1	91.9	89.2	89.2	89.1	89.3
PICdb	Dec. 24h	85.3	85.6	90.3	87.8	88.0	87.2	87.8	70.6	87.0	88.8	83.2	81.8	84.5	84.0
	Circ. 8h	94.2	94.7	96.8	96.0	96.0	95.8	96.4	88.6	92.4	92.1	92.0	92.2	93.2	93.6
	Resp. 24h	71.3	66.3	68.5	68.4	70.7	70.2	65.9	65.9	59.5	59.3	66.1	66.2	66.8	67.3
	Kidn. 48h	73.5	81.9	78.9	63.5	63.8	66.5	69.0	57.4	71.8	81.2	67.5	67.1	67.0	64.5
Zigong	Dec. 24h	69.3	78.3	92.2	86.4	85.1	76.6	68.7	66.8	70.1	80.3	73.8	71.6	71.4	74.4
Zigong	Circ. 8h	88.2	92.3	93.5	88.8	86.6	84.8	84.7	89.0	90.0	89.1	86.0	84.9	86.0	86.2