notesum.ai

Published at December 5

Fixed-Mean Gaussian Processes for Post-hoc Bayesian Deep Learning

cs.LG

stat.ML

Released Date: December 5, 2024

Authors: Luis A. Ortega¹, Simón Rodríguez-Santana, Daniel Hernández-Lobato

Aff.: ¹Universidad Autónoma de Madrid

Arxiv: http://arxiv.org/pdf/2412.04177v1

Refer to caption

Model	Method	NLL		ECE		Train Time		Test Time
ResNet18	MAP	1.247 $\pm$	0.000	0.026 $\pm$	0.000	0.0 $\pm$	0.0	5.058 $\pm$	0.029 $\times 10^{2}$
	ELLA	1.248 $\pm$	0.000	0.025 $\pm$	0.000	7.890 $\pm$	0.275 $\times 10^{3}$	8.060 $\pm$	0.010 $\times 10^{2}$
	FMGP	1.248 $\pm$	0.001	0.015 $\pm$	0.001	1.835 $\pm$	0.099 $\times 10^{4}$	7.324 $\pm$	0.001 $\times 10^{2}$
	MFVI	1.242 $\pm$	0.001	0.040 $\pm$	0.000	7.602 $\pm$	0.032 $\times 10^{4}$	3.773 $\pm$	0.308 $\times 10^{4}$
ResNet34	MAP	1.081 $\pm$	0.000	0.035 $\pm$	0.000	0.0 $\pm$	0.0	5.088 $\pm$	0.004 $\times 10^{2}$
	ELLA	1.082 $\pm$	0.000	0.034 $\pm$	0.000	1.201 $\pm$	0.373 $\times 10^{4}$	1.087 $\pm$	0.018 $\times 10^{3}$
	FMGP	1.077 $\pm$	0.000	0.016 $\pm$	0.000	1.942 $\pm$	0.103 $\times 10^{4}$	8.563 $\pm$	0.011 $\times 10^{2}$
ResNet50	MAP	0.962 $\pm$	0.000	0.037 $\pm$	0.000	0.0 $\pm$	0.0	4.954 $\pm$	0.010 $\times 10^{2}$
	ELLA	0.962 $\pm$	0.000	0.036 $\pm$	0.000	2.997 $\pm$	1.215 $\times 10^{4}$	1.954 $\pm$	0.018 $\times 10^{3}$
	FMGP	0.958 $\pm$	0.001	0.018 $\pm$	0.001	2.543 $\pm$	0.046 $\times 10^{4}$	1.100 $\pm$	0.010 $\times 10^{3}$
ResNet101	MAP	0.912 $\pm$	0.000	0.049 $\pm$	0.000	0.0 $\pm$	0.0	5.059 $\pm$	0.001 $\times 10^{2}$
	ELLA	0.913 $\pm$	0.000	0.048 $\pm$	0.000	4.464 $\pm$	1.649 $\times 10^{4}$	2.808 $\pm$	0.001 $\times 10^{3}$
	FMGP	0.900 $\pm$	0.000	0.030 $\pm$	0.001	2.654 $\pm$	0.064 $\times 10^{4}$	1.134 $\pm$	0.001 $\times 10^{3}$
ResNet152	MAP	0.876 $\pm$	0.000	0.050 $\pm$	0.000	0.0 $\pm$	0.0	6.324 $\pm$	0.004 $\times 10^{2}$
	ELLA	0.877 $\pm$	0.000	0.048 $\pm$	0.000	6.820 $\pm$	0.526 $\times 10^{4}$	3.877 $\pm$	0.007 $\times 10^{3}$
	FMGP	0.865 $\pm$	0.001	0.024 $\pm$	0.001	2.973 $\pm$	0.069 $\times 10^{4}$	1.267 $\pm$	0.002 $\times 10^{3}$