notesum.ai

Published at November 18

IKEA Manuals at Work: 4D Grounding of Assembly Instructions on Internet Videos

cs.CV

cs.AI

cs.RO

Released Date: November 18, 2024

Authors: Yunong Liu¹, Cristobal Eyzaguirre¹, Manling Li¹, Shubh Khanna¹, Juan Carlos Niebles¹, Vineeth Ravi², Saumitra Mishra², Weiyu Liu¹, Jiajun Wu¹

Aff.: ¹Stanford University; ²J.P. Morgan AI Research

Arxiv: http://arxiv.org/abs/2411.11409v1

Method	Dataset	Simple Matching			Hard Matching
Method	Dataset	Precision	Recall	F1 Score	Precision	Recall	F1 Score
SingleStep	IKEA-Manual	100.00	35.77	48.64	10.78	10.78	10.78
GeoCluster	IKEA-Manual	44.90	48.46	43.53	16.54	16.50	16.30
SingleStep	Ours	98.98	16.86	26.88	3.06	2.55	2.72
GeoCluster	Ours	43.04	24.16	29.74	14.98	9.49	11.51