notesum.ai

Published at October 21

Unleashing the Potential of Vision-Language Pre-Training for 3D Zero-Shot Lesion Segmentation via Mask-Attribute Alignment

cs.IR

cs.AI

cs.CL

cs.LG

Released Date: October 21, 2024

Authors: Yankai Jiang¹, Wenhui Lei², Xiaofan Zhang², Shaoting Zhang¹

Aff.: ¹Shanghai AI Laboratory; ²Shanghai Jiao Tong University

Arxiv: https://arxiv.org/abs/2410.15744v1

Refer to caption

Method	MSD				KiTS23		In-house Dataset
	Hepatic Vessel Tumor		Pancreas Cyst		Kidney Tumor		Liver Cyst		Kidney Stone		Gallbladder Tumor
	DSC $\uparrow$	NSD $\uparrow$	DSC $\uparrow$	NSD $\uparrow$	DSC $\uparrow$	NSD $\uparrow$	DSC $\uparrow$	NSD $\uparrow$	DSC $\uparrow$	NSD $\uparrow$	DSC $\uparrow$	NSD $\uparrow$
SAM ${\dagger}$ (Shaharabany & Wolf, 2024)	35.76	45.83	37.17	49.26	35.45	41.33	34.99	40.88	24.14	31.92	28.08	36.38
SAM2 ${\dagger}$ (Yamagishi et al., 2024)	35.93	45.88	38.42	50.85	35.67	41.88	35.29	41.25	25.50	33.74	28.57	36.62
SaLIP $*$ (Aleem et al., 2024)	39.65	48.71	41.92	53.06	38.64	44.91	37.71	44.26	27.24	36.61	30.84	38.97
H-SAM* (Cheng et al., 2024)	45.58	54.24	46.87	57.91	44.21	50.39	43.75	50.20	29.23	38.11	32.17	40.05
ZePT $*$ (Jiang et al., 2024)	53.12	63.25	53.35	63.50	46.82	52.44	51.64	57.36	33.97	42.42	35.48	43.23
Malenia	59.52	69.60	60.91	70.28	54.96	60.60	61.85	70.93	43.05	52.95	47.35	55.79