notesum.ai

Published at November 29

On the Performance Analysis of Momentum Method: A Frequency Domain Perspective

cs.LG

Released Date: November 29, 2024

Authors: Xianliang Li¹, Jun Luo², Zhiwei Zheng³, Hanxiao Wang⁴, Li Luo⁵, Lingkun Wen⁶, Linlong Wu⁷, Sheng Xu¹

Aff.: ¹Shenzhen Institute of Advanced Technology; ²Shenzhen Institute of Advanced Technology, University of Chinese Academy of Sciences; ³University of California, Berkeley; ⁴University of Chinese Academy of Sciences, Institute of Automation; ⁵Sun Yat-sen University; ⁶University of Chinese Academy of Sciences, Shanghai Astronomical Observatory; ⁷University of Luxembourg

Arxiv: http://arxiv.org/pdf/2411.19671v1

	Increasing Factor ( $\mu$ )			Fixed Value ( $u_{t}$ )			Decreasing Factor ( $\nu$ )
Parameters	1k	10k	100k	0.3	0.6	0.9	100	1k	10k
Low-pass	77.12_0.07	77.06_0.14	76.86_0.12	76.98_0.09	76.82_0.18	76.84_0.06	72.58_0.44	70.53_0.31	69.69_0.75
High-pass	51.59_0.78	67.55_0.22	74.72_0.06	72.46_0.13	65.14_0.17	53.43_0.26	76.82_0.25	75.92_0.12	70.99_0.18