notesum.ai

Published at May 10

The High Line: Exact Risk and Learning Rate Curves of Stochastic Adaptive Learning Rate Algorithms

NeurIPS

Released Date: May 10, 2024

Authors: Elizabeth Collins-Woodfin1, Inbar Seroussi2, Begoña García Malaxechebarría3, Andrew Mackenzie, Elliot Paquette1, Courtney Paquette4

Aff.: 1McGill University; 2Tel-Aviv University; 3University of Washington; 4McGill University & Google DeepMind

Arxiv: https://openreview.net/pdf/07b35fb1dfd73b1bf3e77793bfb98d5cc8c6fdde.pdf