notesum.ai

Published at November 9

Online Parallel Multi-Task Relationship Learning via Alternating Direction Method of Multipliers

cs.LG

cs.AI

cs.DC

Released Date: November 9, 2024

Authors: Ruiyu Li¹, Peilin Zhao², Guangxia Li³, Zhiqiang Xu⁴, Xuewei Li⁴

Aff.: ¹School of Computer Science and Technology, Xidian University, China; ²Tencent AI Lab, Tencent Inc, ShenZhen, China; ³MBZUAI, Abu Dhabi, UAE; ⁴School of Intelligent Engineering, Henan Institute of Technology, China

Arxiv: http://arxiv.org/abs/2411.06135v1

	Synthetic	Tweet Eval	Multi-Lingual	Chem	Landmine	MNIST
ADMM-Single	$0.214$	$0.341$	$0.206$	$0.304$	$0.379$	$0.154$
DROM	$0.299$	$0.497$	$0.253$	$0.347$	$0.431$	$0.183$
PMSC-Log	$0.212$	$0.452$	$0.208$	$0.369$	$0.389$	$0.252$
D-PSGD (Ring)	$0.204$	$0.283$	$0.168$	$0.320$	$0.377$	$0.137$
D-PSGD (Full-Conn)	$0.209$	$0.245$	$0.168$	$0.320$	$0.394$	$0.124$
C-ADMM	$\mathbf{0.138}$	$0.232$	$\mathbf{0.077}$	$0.319$	$0.304$	$0.079$
D-ADMM (Ring)	$0.173$	$0.161$	$0.128$	$\mathbf{0.276}$	$0.332$	$0.070$
D-ADMM (Full-Conn)	$0.173$	$\mathbf{0.160}$	$0.098$	$0.277$	$\mathbf{0.256}$	$\mathbf{0.051}$