notesum.ai

Published at November 22

Benchmarking the Robustness of Optical Flow Estimation to Corruptions

eess.IV

cs.CV

cs.RO

Released Date: November 22, 2024

Authors: Zhonghua Yi¹, Hao Shi¹, Qi Jiang¹, Yao Gao¹, Ze Wang¹, Yufan Zhang¹, Kailun Yang², Kaiwei Wang¹

Aff.: ¹Zhejiang University; ²Hunan University

Arxiv: http://arxiv.org/abs/2411.14865v1

Model		Clean	Digital				Illumination				Weather				Noise			Blur					AVG EPE
Model		JPEG	Pixelate	Contrast	Saturate	HL^*	LL^*	OE^*	UE^*	Spatter	Fog	Frost	Snow	Gaussian	Shot	Impulse	Gaussian	Defocus	Glass	Camera	PSF		AVG EPE
Farnebäck		25.60	26.02	26.71	32.82	25.33	25.76	27.54	27.56	28.60	27.84	31.19	29.68	27.62	24.35	24.33	24.16	31.00	31.39	28.75	28.78	30.60	28.00
DIS	20.56	21.02	20.44	20.82	20.38	20.09	21.97	24.35	27.23	24.33	24.59	27.23	23.20	21.40	21.05	21.41	20.13	20.14	20.37	20.33	20.13	22.03
out-of-domain (OOD)
RAFT		4.29	10.28	4.53	4.77	5.73	5.20	7.25	6.74	4.34	21.49	6.34	27.75	14.01	13.77	12.22	14.20	6.15	6.31	9.02	5.22	5.41	9.54
GMA	4.19	10.01	4.69	4.63	5.70	4.97	7.36	6.21	4.19	23.40	6.04	28.98	14.15	15.02	13.55	15.99	6.41	6.96	10.38	5.26	5.50	9.97
CSFlow	4.11	9.24	4.39	4.79	5.13	4.88	7.47	6.53	4.15	21.52	6.23	27.54	13.98	10.82	9.75	10.95	5.56	5.93	8.55	5.10	5.06	8.88
SKFlow	3.97	8.86	4.21	4.54	5.24	4.53	6.68	5.63	3.97	20.75	5.55	26.54	13.65	14.67	13.52	15.54	6.04	6.45	9.17	5.07	5.23	9.29
GMFlowNet	4.08	9.41	4.52	4.85	5.31	4.93	8.05	5.98	4.28	21.52	6.33	27.03	11.57	12.47	11.32	13.04	5.55	5.91	8.19	5.06	5.01	9.02
CRAFT	4.66	10.49	5.12	5.54	6.56	5.51	7.99	7.09	4.80	23.17	6.91	30.13	18.59	17.14	15.69	17.90	7.01	7.33	12.22	6.12	5.99	11.07
FlowFormer	4.78	9.86	5.31	7.16	6.33	5.70	8.51	6.73	4.71	23.25	7.06	28.98	15.10	13.32	11.95	14.20	6.84	6.82	10.51	5.87	6.00	10.21
FlowFormer++	4.70	10.66	5.88	6.48	6.68	6.05	8.80	6.57	4.75	23.35	6.77	29.37	14.45	14.01	13.07	15.04	6.74	6.83	11.48	6.12	6.05	10.46
SAMFlow-T	4.22	9.23	4.76	5.67	5.56	5.11	6.82	5.94	4.12	21.59	5.69	27.66	13.18	11.87	12.51	15.04	6.16	6.18	9.03	4.86	5.39	9.32
SAMFlow-B	4.06	8.09	4.47	5.03	5.25	4.94	6.65	5.78	4.07	21.50	5.45	27.44	11.13	10.69	9.85	10.28	5.63	5.91	8.93	4.62	4.84	8.53
SAMFlow-H	3.78	7.08	4.14	4.98	5.37	4.73	6.27	5.50	3.77	21.16	5.30	27.32	10.73	11.81	10.61	10.58	5.42	5.60	8.49	4.18	4.75	8.39
FlowDiffuser	6.16	14.12	6.60	7.80	8.43	8.12	9.38	9.10	6.10	22.37	8.06	29.07	22.67	19.30	17.49	19.75	9.22	9.43	11.64	8.25	7.83	12.74
in-domain (ID)
RAFT		1.81	5.55	2.06	4.26	2.55	3.31	6.81	7.65	1.87	12.00	3.34	20.45	35.76	15.96	10.93	14.84	4.53	4.30	4.47	5.37	4.17	8.51
GMA	2.43	5.69	3.24	3.56	3.00	6.31	4.65	7.56	2.28	14.98	4.31	23.00	51.76	22.51	15.21	21.33	4.20	4.31	4.89	6.17	3.82	10.64
CSFlow	1.96	3.76	2.21	3.12	2.63	2.56	5.04	4.07	2.05	11.18	3.56	19.33	17.32	11.31	8.51	12.96	3.23	3.28	3.47	2.99	2.77	6.27
SKFlow	2.78	3.93	2.61	3.31	3.44	5.18	3.90	7.18	2.81	13.27	3.56	20.41	39.65	23.73	17.09	25.47	3.14	3.28	4.12	4.01	2.81	9.65
GMFlowNet	1.81	3.39	2.00	2.83	2.15	2.70	4.12	8.70	1.94	12.24	3.06	20.17	22.50	15.01	12.67	16.28	3.29	3.33	3.61	3.11	2.89	7.30
CRAFT	3.67	6.45	4.59	4.33	5.32	4.85	4.74	5.77	4.22	13.85	3.54	23.12	31.93	14.72	11.88	14.80	5.44	5.62	7.68	5.00	4.69	9.13
FlowFormer	1.72	3.69	2.32	4.58	2.21	2.67	4.45	3.81	1.96	16.35	3.94	22.63	21.92	8.81	6.78	9.54	4.39	4.40	4.06	3.58	3.56	6.78
FlowFormer++	1.63	3.83	2.41	3.46	2.16	2.19	4.18	2.96	1.60	17.05	3.12	23.74	12.63	9.65	7.56	9.17	3.58	3.76	4.22	3.04	3.15	6.17
SAMFlow-T	1.54	3.19	2.00	3.77	1.86	1.97	3.29	2.15	1.66	16.89	2.86	22.16	11.24	5.14	4.48	5.36	2.97	2.95	3.47	2.77	2.60	5.14
SAMFlow-B	1.51	3.32	2.00	3.07	1.76	2.25	3.25	2.12	1.53	17.50	2.56	22.54	9.68	5.82	4.62	5.46	2.58	2.65	3.90	2.68	2.33	5.08
SAMFlow-H	1.45	2.82	1.91	2.52	1.78	1.84	2.94	2.01	1.52	16.82	2.38	21.71	10.56	4.68	3.29	4.70	2.40	2.51	3.43	2.37	2.04	4.71
FlowDiffuser	4.71	8.81	4.92	7.94	7.01	7.21	10.85	9.75	5.66	16.87	6.74	24.36	32.40	28.20	24.81	28.15	6.10	6.16	8.50	5.48	5.55	12.77
BrightFlow	3.17	4.78	3.40	3.37	3.36	3.88	4.87	4.23	3.15	17.26	6.04	23.29	14.66	6.56	5.08	6.24	4.03	4.19	4.53	3.85	3.86	6.53
UPFlow	3.52	5.20	3.79	7.22	4.07	4.55	6.31	5.21	4.02	12.64	7.81	22.62	14.87	8.87	7.07	8.26	4.78	4.91	5.15	4.52	4.74	7.33
ARFlow	3.02	3.94	3.06	7.69	3.36	4.66	6.88	3.66	3.44	8.76	7.12	18.52	10.59	5.30	4.79	5.36	3.29	3.32	3.83	3.86	3.75	5.76