notesum.ai

Published at November 21

Out-Of-Distribution Detection with Diversification (Provably)

cs.CV

Released Date: November 21, 2024

Authors: Haiyun Yao¹, Zongbo Han¹, Huazhu Fu², Xi Peng³, Qinghua Hu¹, Changqing Zhang¹

Aff.: ¹College of Intelligence and Computing, Tianjin University; ²Institute of High Performance Computing, A*STAR; ³College of Computer Science, Sichuan University

Arxiv: http://arxiv.org/abs/2411.14049v1

Method	CIFAR-10				CIFAR-100				w./w.o. $\mathcal{D}_{aux}$
Method	FPR95 ( $\downarrow$ )	AUROC ( $\uparrow$ )	AUPR ( $\uparrow$ )	ID-ACC	FPR95 ( $\downarrow$ )	AUROC ( $\uparrow$ )	AUPR ( $\uparrow$ )	ID-ACC	w./w.o. $\mathcal{D}_{aux}$
MSP	58.98	90.63	93.18	94.39	80.30	73.13	76.97	74.05	$\times$
ODIN	26.55	94.25	95.34	94.39	56.31	84.89	85.88	74.05	$\times$
Mahalanobis	29.47	89.96	89.70	94.39	47.89	85.71	87.15	74.05	$\times$
Energy	28.53	94.39	95.56	94.39	65.87	81.50	84.07	74.05	$\times$
SSD+	7.22	98.48	98.59	NA	38.32	88.91	89.77	NA	$\times$
OE	9.66	98.34	98.55	94.12	19.54	94.93	95.26	74.25	$\checkmark$
SOFL	5.41	98.98	99.10	93.68	19.32	96.32	96.99	73.93	$\checkmark$
CCU	8.78	98.41	98.69	93.97	19.27	95.02	95.41	74.49	$\checkmark$
Energy (w. $\mathcal{D}_{aux}$ )	4.62	98.93	99.12	92.92	19.25	96.68	97.44	72.39	$\checkmark$
NTOM	4.00	99.09	98.61	94.26	18.77	96.69	96.49	74.52	$\checkmark$
POEM	2.54	99.40	99.50	93.49	15.14	97.79	98.31	73.41	$\checkmark$
MixOE	14.54	97.16	97.41	94.48	27.71	92.93	93.81	75.15	$\checkmark$
DivOE	11.41	97.76	98.18	93.74	18.91	95.00	95.26	74.08	$\checkmark$
DiverseMix (ours)	1.92	99.42	99.51	94.16	8.51	98.24	98.46	74.60	$\checkmark$