Gradient Descent 

A visual comparison of the most common optimization technique, gradient descent with and without momentum. 

Three parameters (angle between arms) are used to minimize the distance between the hoop and target(loss function). Descent with momentum is noticeably faster.