Gradient descent

Gradient descent updates $x$ in the negative-gradient direction. For $F(x)=x^{T}Ax/2-b^{T}x$, this direction is the residual $r=b-Ax$.