notesum.ai

Published at November 6

Adaptive Consensus Gradients Aggregation for Scaled Distributed Training

cs.LG
cs.AI
cs.DC

Released Date: November 6, 2024

Authors: Yoni Choukroun1, Shlomi Azoulay1, Pavel Kisilev1

Aff.: 1Huawei Tel Aviv Research Center

Arxiv: http://arxiv.org/abs/2411.03742v1