notesum.ai

Published at December 4

Task-driven Image Fusion with Learnable Fusion Loss

cs.CV

Released Date: December 4, 2024

Authors: Haowen Bai¹, Jiangshe Zhang¹, Zixiang Zhao², Yichen Wu³, Lilun Deng¹, Yukun Cui¹, Tao Feng⁴, Shuang Xu⁵

Aff.: ¹Xi'an Jiaotong University; ²ETH Zurich; ³City University of Hong Kong; ⁴Tsinghua University; ⁵Northwestern Polytechnical University

Arxiv: http://arxiv.org/pdf/2412.03240v1

Infrared-visible Image Fusion on MSRS [44] Dataset							Infrared-visible Image Fusion on FMB [26] Dataset
	EN $\uparrow$	SF $\uparrow$	SCD $\uparrow$	VIF $\uparrow$	$Q_{abf}$ $\uparrow$	SSIM $\uparrow$		EN $\uparrow$	SF $\uparrow$	SCD $\uparrow$	VIF $\uparrow$	$Q_{abf}$ $\uparrow$	SSIM $\uparrow$
TarDAL [25]	5.28	5.98	0.71	0.21	0.18	0.47	TarDAL [25]	6.63	6.94	1.03	0.28	0.29	0.74
SegMIF [26]	5.95	11.10	1.57	0.44	0.63	0.55	SegMIF [26]	6.83	13.69	1.72	0.39	0.65	0.60
MURF [53]	5.04	10.49	1.02	0.22	0.37	0.60	MURF [53]	6.37	13.88	1.34	0.22	0.37	0.68
EMMA [70]	6.73	11.56	1.62	0.49	0.64	0.70	EMMA [70]	6.77	15.00	1.50	0.42	0.65	0.72
DCINN [48]	6.00	10.51	1.49	0.41	0.57	0.52	DCINN [48]	6.47	11.47	1.39	0.38	0.59	0.74
MRFS [60]	7.00	8.86	1.42	0.37	0.49	0.55	MRFS [60]	6.78	12.42	1.24	0.38	0.62	0.73
TIMFusion [29]	6.27	9.67	1.34	0.32	0.48	0.68	TIMFusion [29]	6.51	12.23	1.24	0.35	0.59	0.73
TDFusion (Ours)	6.74	11.30	1.86	0.50	0.67	0.70	TDFusion (Ours)	6.86	14.16	1.76	0.43	0.68	0.75
Infrared-visible Image Fusion on M3FD [25] Dataset							Infrared-visible Image Fusion on LLVIP [13] Dataset
	EN $\uparrow$	SF $\uparrow$	SCD $\uparrow$	VIF $\uparrow$	$Q_{abf}$ $\uparrow$	SSIM $\uparrow$		EN $\uparrow$	SF $\uparrow$	SCD $\uparrow$	VIF $\uparrow$	$Q_{abf}$ $\uparrow$	SSIM $\uparrow$
TarDAL [25]	6.87	7.63	1.29	0.27	0.30	0.71	TarDAL [25]	6.32	7.42	1.04	0.27	0.22	0.58
SegMIF [26]	6.85	14.14	1.72	0.37	0.60	0.59	SegMIF [26]	6.68	15.46	1.38	0.40	0.66	0.57
MURF [53]	6.50	12.55	1.46	0.21	0.32	0.64	MURF [53]	6.13	15.08	0.96	0.21	0.31	0.57
EMMA [70]	6.92	15.23	1.49	0.38	0.59	0.69	EMMA [70]	7.35	15.37	1.57	0.41	0.64	0.66
DCINN [48]	6.59	11.21	1.46	0.34	0.51	0.72	DCINN [48]	6.98	13.34	1.43	0.38	0.52	0.64
MRFS [60]	6.94	12.07	1.26	0.34	0.55	0.70	MRFS [60]	6.83	11.04	1.23	0.31	0.42	0.64
TIMFusion [29]	6.75	12.31	1.37	0.35	0.53	0.70	TIMFusion [29]	6.58	13.52	1.14	0.33	0.46	0.64
TDFusion (Ours)	6.99	14.49	1.83	0.41	0.65	0.72	TDFusion (Ours)	7.36	16.38	1.75	0.46	0.70	0.67