notesum.ai

Published at November 26

Multimodal Outer Arithmetic Block Dual Fusion of Whole Slide Images and Omics Data for Precision Oncology

cs.CV

Released Date: November 26, 2024

Authors: Omnia Alwazzan¹, Amaya Gallagher-Syed¹, Thomas Millner¹, Ioannis Patras¹, Silvia Marino¹, Gregory Slabaugh¹

Aff.: ¹Unknown

Arxiv: http://arxiv.org/abs/2411.17418v1

Refer to caption

Model	F1-Ma	F1-Mi	Prec	Recall
Omics
SNN	$0.726$ $\pm 0.003$	$0.819$ $\pm 0.013$	$0.799$ $\pm 0.015$	$0.715$ $\pm 0.023$
MLP	$0.69$ $\pm 0.012$	$0.794$ $\pm 0.021$	$0.741$ $\pm 0.018$	$0.684$ $\pm 0.031$
WSI
ABMIL	$0.247$ $\pm 0.004$	$0.442$ $\pm 0.004$	$0.280$ $\pm 0.224$	$0.256$ $\pm 0.250$
TransMIL	$0.217$ $\pm 0.019$	$0.434$ $\pm 0.003$	$0.240$ $\pm 0.024$	$0.230$ $\pm 0.013$
Multimodal
ACMIL MOAD-Net	$0.501$ $\pm 0.011$	$0.729$ $\pm 0.031$	$0.602$ $\pm 0.032$	$0.490$ $\pm 0.014$
TransMIL (Cat)	$0.711$ $\pm 0.005$	$0.799$ $\pm 0.005$	$0.744$ $\pm 0.003$	$0.707$ $\pm 0.002$
TransMIL (KP)	$0.483$ $\pm 0.003$	$0.741$ $\pm 0.016$	$0.485$ $\pm 0.007$	$0.506$ $\pm 0.008$
TransMIL MOAD-Net	$0.724$ $\pm 0.005$	$0.816$ $\pm 0.002$	$0.759$ $\pm 0.009$	$0.719$ $\pm 0.001$
MCAT	$0.402$ $\pm 0.046$	$0.661$ $\pm 0.021$	$0.408$ $\pm 0.045$	$0.414$ $\pm 0.039$
MCAT $p_{ij}$	$0.432$ $\pm 0.015$	$0.703$ $\pm 0.017$	$0.441$ $\pm 0.031$	$0.446$ $\pm 0.011$
SURVPATH	$0.424$ $\pm 0.008$	$0.697$ $\pm 0.012$	$0.478$ $\pm 0.038$	$0.425$ $\pm 0.013$
SURVPATH $p_{ij}$	$0.531$ $\pm 0.008$	$0.761$ $\pm 0.008$	$0.632$ $\pm 0.005$	$0.520$ $\pm 0.007$
ABMIL (Cat)	$0.718$ $\pm 0.013$	$0.806$ $\pm 0.002$	$0.764$ $\pm 0.018$	$0.717$ $\pm 0.023$
ABMIL (KP)	$0.447$ $\pm 0.024$	$0.737$ $\pm 0.020$	$0.481$ $\pm 0.043$	$0.464$ $\pm 0.032$
ABMIL MOAD-Net	$\bf 0.745$ $\pm 0.025$	$\bf 0.820$ $\pm 0.013$