Modern Alg Class

The Dual Perspective (Mirror Descent and AGD)

• mirror_note Updated on Sep 10

• Accelerated Gradient Descent (AGD)  Updated on Sep 18

• hw 2 Updated on Sep 19 Due on Oct 3

The Stochastic Setting

• The Stochastic Subgradient Descent Method (SGD) Updated on Oct 1.

• The Block Coordinate Method.

• The Variance Reduction Technique. Last Updated on Nov 5

Nonconvex Optimization

• The Deterministic Smooth Non-convex Optimization  Last Updated on Nov 7

• Non-smooth Non-convex Optimization

File For Jimmy:

Lec 9 Jimmy, practice Problem