Possible final projects

Nonlinear Conjugate Gradient Methods (Ch. 5 of Nocedal - Wright 2006 book) 

Trust-Region Methods more in detail: Cauchy point, Dogleg method,  global and local convergence (Ch. 4 of Nocedal - Wright 2006 book) 

Convrgence analysis of Quasi - Newton Methods (Ch. 6 of Nocedal - Wright 2006 book) 

Inexact Newton Methods  (Ch. 7.1 of Nocedal - Wright 2006 book) 

Limited-Memory Quasi-Newton Methods   (Ch.  7.2 of Nocedal - Wright 2006 book) 

Automatic Differentiation  (Ch.  8.2 of Nocedal - Wright 2006 book) 

Gradient and Momentum Methods (Ch.  5 of Kochenderfer - Wheeler 2019 book) 

Derivative-free and Direct Methods (Ch.  7 of Kochenderfer - Wheeler 2019 book) 

Stochastic Methods (Ch.  8 of Kochenderfer - Wheeler 2019 book) 

Genetic Algorithms and Population Methods  (Ch.  9 of Kochenderfer - Wheeler 2019 book) 

Optimization Methods in Artificial Neural Networks