notesum.ai

Published at November 12

DPU: Dynamic Prototype Updating for Multimodal Out-of-Distribution Detection

cs.CV

cs.AI

Released Date: November 12, 2024

Authors: Shawn Li¹, Huixian Gong¹, Hao Dong², Tiankai Yang¹, Zhengzhong Tu³, Yue Zhao¹

Aff.: ¹University of Southern California; ²ETH Zurich; ³Texas A&M University

Arxiv: http://arxiv.org/abs/2411.08227v1

Method	HMDB51 25/26			UCF101 50/51			Kinetics600 129/110			EPIC-Kitchen
Method	FPR95 $\downarrow$	AUROC $\uparrow$	ID ACC $\uparrow$	FPR95 $\downarrow$	AUROC $\uparrow$	ID ACC $\uparrow$	FPR95 $\downarrow$	AUROC $\uparrow$	ID ACC $\uparrow$	FPR95 $\downarrow$	AUROC $\uparrow$	ID ACC $\uparrow$
MSP [16]	44.66	87.74	89.32	22.14	95.73	99.22	64.08	76.06	80.11	76.31	67.59	71.46
+A2D	38.78	88.37	90.64	7.09	98.19	99.61	63.04	76.47	79.50	66.23	67.91	71.83
+AN	33.99	88.79	89.98	7.96	98.24	99.71	62.91	76.92	80.52	67.91	71.52	71.64
+Ours	34.20	89.15	92.16	7.57	98.17	99.81	61.59	77.50	81.07	63.81	71.47	72.39
Energy [31]	43.36	87.46	89.32	22.52	96.06	99.22	68.75	75.49	80.11	76.68	68.29	71.46
+A2D	39.22	88.84	90.63	9.81	98.16	99.61	64.59	76.45	79.50	66.98	72.45	71.46
+AN	36.38	88.91	89.98	6.50	98.48	99.71	63.69	77.11	80.52	67.91	73.79	71.64
+Ours	35.07	89.52	92.16	7.48	98.43	99.81	62.56	77.40	81.07	63.62	74.13	72.39
Maxlogit [17]	43.36	87.75	89.32	22.52	96.02	99.22	68.73	75.98	80.11	76.68	68.29	71.46
+A2D	39.22	88.93	90.63	9.81	98.15	99.61	64.57	76.92	79.50	66.98	72.23	71.46
+AN	36.38	89.06	89.98	6.50	98.49	99.71	63.65	77.55	80.52	66.98	73.48	71.64
+Ours	35.08	89.60	92.16	7.57	98.39	99.81	62.46	77.76	81.07	63.62	73.50	72.39
Mahalanobis [23]	40.31	85.28	89.32	12.14	97.14	99.22	93.51	35.83	80.11	98.69	42.99	71.46
+A2D	44.88	86.99	90.63	8.74	98.07	99.61	92.86	50.65	79.50	95.52	44.43	71.46
+AN	41.61	87.69	89.98	7.86	97.99	99.71	92.49	50.05	80.52	94.78	44.37	71.64
+Ours	36.17	89.53	92.16	6.60	98.68	99.81	89.27	54.17	81.07	95.34	45.62	72.39
ReAct [40]	42.05	87.79	89.32	25.63	95.85	99.32	72.40	73.80	80.35	83.96	65.89	71.08
+A2D	37.91	89.09	90.63	10.39	98.12	99.61	71.26	74.29	79.64	68.66	72.03	70.52
+AN	37.47	88.63	90.20	12.43	97.33	99.90	67.95	75.55	80.70	66.60	73.11	72.39
+Ours	35.08	89.51	92.16	7.48	98.43	99.81	62.57	77.41	81.07	71.46	71.24	69.78
ASH [7]	53.59	87.16	89.54	32.14	94.02	99.22	69.24	76.16	79.62	76.87	67.92	70.15
+A2D	42.05	87.72	90.41	12.52	97.43	99.42	64.28	77.28	79.15	63.25	74.73	67.72
+AN	36.17	89.30	89.32	10.68	97.80	99.81	63.77	77.44	79.44	66.23	73.06	66.23
+Ous	35.08	89.51	92.16	7.48	98.43	99.81	62.57	77.41	81.07	71.46	71.24	69.78
GEN [32]	43.79	87.49	89.32	23.79	95.54	99.22	69.03	75.33	80.11	76.87	68.52	71.46
+A2D	38.56	88.61	90.63	8.83	98.12	99.61	62.28	77.08	79.50	65.86	73.05	71.46
+AN	35.95	89.78	89.32	7.67	92.28	99.71	62.95	76.95	80.52	65.30	75.17	71.64
+Ours	34.64	89.71	92.16	6.41	98.41	99.81	62.10	78.05	81.07	63.06	74.22	72.39
KNN [41]	42.92	88.46	89.32	15.63	96.93	99.22	68.67	74.64	80.11	75.93	63.60	71.46
+A2D	33.33	89.59	90.63	7.48	98.39	99.61	65.71	76.23	79.50	72.39	67.83	71.46
+AN	33.77	90.05	89.98	12.04	97.65	99.71	66.81	74.19	80.52	71.27	69.94	71.64
+Ours	32.90	89.36	92.16	11.84	97.74	99.81	66.71	75.34	81.07	71.64	68.03	72.39
VIM [47]	36.82	88.06	89.32	12.52	97.66	99.22	68.77	75.47	80.11	77.05	65.60	71.46
+A2D	33.77	89.37	90.63	6.80	98.62	99.61	64.59	76.45	79.50	66.42	68.43	71.46
+AN	34.64	88.80	89.98	4.56	98.73	99.71	63.67	77.12	80.52	67.72	69.09	71.64
+Ours	32.46	89.93	92.16	6.79	98.56	99.81	62.32	77.51	81.07	66.60	70.50	72.39