notesum.ai

Published at November 26

Promptable Anomaly Segmentation with SAM Through Self-Perception Tuning

cs.CV

Released Date: November 26, 2024

Authors: Hui-Yue Yang¹, Hui Chen¹, Ao Wang¹, Kai Chen¹, Zijia Lin¹, Yongliang Tang², Pengcheng Gao², Yuming Quan², Jungong Han¹, Guiguang Ding¹

Aff.: ¹Tsinghua University; ²LUSTER LightTech Co., Ltd.

Arxiv: http://arxiv.org/abs/2411.17217v1

Refer to caption

	One box		Multiple boxes		Point=5		Point=10		Avg.
Method	mIoU	mBIoU	mIoU	mBIoU	mIoU	mBIoU	mIoU	mBIoU	mIoU	mBIoU
zero-shot	56.3	50.7	63.0	57.9	44.1	39.8	44.4	39.7	52.0	47.0
LoRA	65.1	58.8	69.9	64.8	62.4	57.5	68.7	62.9	66.5	61.0
SPT ${}_{\text{LoRA}}$	67.1	60.7	71.7	66.3	64.6	59.8	70.1	64.5	68.4	62.8
DoRA	65.3	58.8	70.1	64.7	62.8	57.9	67.7	62.0	66.5	60.9
SPT ${}_{\text{DoRA}}$	66.9	60.6	71.4	66.4	65.3	60.4	70.5	64.9	68.5	63.1
Adapter	65.1	59.2	70.0	65.3	61.8	56.9	67.2	61.4	66.0	60.7
SPT ${}_{\text{Adapter}}$	66.0	59.5	71.2	65.9	63.4	58.7	69.3	63.7	67.5	62.0