notesum.ai

Published at November 27

SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation

cs.CV

Released Date: November 27, 2024

Authors: Duc-Hai Pham¹, Tung Do¹, Phong Nguyen¹, Binh-Son Hua², Khoi Nguyen¹, Rang Nguyen¹

Aff.: ¹VinAI Research, Vietnam; ²Trinity College Dublin

Arxiv: http://arxiv.org/abs/2411.18229v1

[Uncaptioned image]

Method	GT	KITTI		NYUv2		ETH3D		Diode		Booster		NuScenes
Method	aligned?	$\mathrm{\mbox{\boldmath{$\delta$}}}_{1}\uparrow$	$\textbf{A.Rel}\downarrow$	$\mathrm{\mbox{\boldmath{$\delta$}}}_{1}\uparrow$	$\textbf{A.Rel}\downarrow$	$\mathrm{\mbox{\boldmath{$\delta$}}}_{1}\uparrow$	$\textbf{A.Rel}\downarrow$	$\mathrm{\mbox{\boldmath{$\delta$}}}_{1}\uparrow$	$\textbf{A.Rel}\downarrow$	$\mathrm{\mbox{\boldmath{$\delta$}}}_{1}\uparrow$	$\textbf{A.Rel}\downarrow$	$\mathrm{\mbox{\boldmath{$\delta$}}}_{1}\uparrow$	$\textbf{A.Rel}\downarrow$
Marigold [21]	✓	0.92	0.09	0.96	0.05	0.96	0.06	0.77	0.31	0.97	0.05	0.66	0.27
Lotus [17]	✓	0.88	0.11	0.97	0.05	0.96	0.06	0.74	0.33	0.99	0.04	0.51	0.36
BetterDepth [55]	✓	0.95	0.75	0.98	0.04	0.98	0.05	-	-	-	-	-	-
UniDepth [31]		0.98	0.05	0.98	0.05	0.25	0.46	0.66	0.26	0.28	0.49	0.84	0.14
ZoeDepth [2]		0.97	0.06	0.95	0.08	0.34	0.58	0.30	0.48	0.21	0.64	0.22	0.59
Metric3Dv2 [19]		0.98	0.05	0.97	0.07	0.82	0.14	0.88	0.16	0.15	0.67	0.84	0.20
PatchRefiner [25]		0.79	0.16	0.01	2.48	0.05	1.78	0.25	1.26	0.01	5.55	0.32	0.58
UniDepth-aligned Lotus		0.84	0.13	0.94	0.09	0.20	0.49	0.56	0.36	0.26	0.49	0.41	0.43
SharpDepth (ours)		0.97	0.06	0.97	0.06	0.23	0.47	0.61	0.29	0.28	0.49	0.78	0.18