OurBigBook.comSite Source code

Heavy-ball method

The heavy-ball iteration adds momentum to gradient descent:

x_{k + 1} = x_{k} - α \nabla F (x_{k}) + β (x_{k} - x_{k - 1}) .

Table of contents 86 3
- Heavy-ball residual recurrence Heavy-ball method 26
- Heavy-ball error propagation matrix Heavy-ball method 50 1
  - Heavy-ball rate for a two-eigenvalue diagonal quadratic Heavy-ball error propagation matrix 21

 Ancestors (6)

 Incoming links (1)

Solution