Momentum Remembers the Slope

β = 0.9, η = 0.1, slope 1: v = 1 then 1.9; steps 0.10 then 0.19. After six steps momentum reaches −1.78297 against plain GD −0.6.

This Optimization lesson is part of a paid plan. Sign in with a plan that includes this course to read it.