notesum.ai

Published at November 21

Accelerated zero-order SGD under high-order smoothness and overparameterized regime

math.OC

Released Date: November 21, 2024

Authors: Georgii Bychkov¹, Darina Dvinskikh², Anastasia Antsiferova³, Alexander Gasnikov⁴, Aleksandr Lobanov⁵

Aff.: ¹Lomonosov MSU, ISP RAS, Moscow, Russia; ²HSE University, MIPT, ISP RAS, Moscow, Russia; ³MSU Institute for Artificial Intelligence, ISP RAS, Moscow, Russia; ⁴Innopolis University, MIPT, IITP RAS, Innopolis, Republic of Tatarstan, Russia; ⁵MIPT, Skoltech, ISP RAS, Dolgoprudny, Moscow Oblast, Russia

Arxiv: http://arxiv.org/abs/2411.13999v1