In this class, we study constrained optimization problems that include an objective function as well as constraints (or restrictions). We firstly deal with linear programs to minimize (or maximize) a linear objective function with linear constraints. There are various linear programs with equality and inequality constraints, but we consider the standard form of linear programs and learn the simplex methods to seek the optimal solution for the standard form. We also see dual problems of linear programs and find the relation between the original and dual problems. An interesting case of linear programs, the integer linear programming (ILP), is introduced, and some technical methods for ILP are presented. Furthermore, we deal with nonlinear constrained optimization problems having nonlinear objective functions or nonlinear constraints. In this case, the Lagrange condition and second-order conditions are applied to find local extrema.
Note 1: Introduction to Optimization and Linear Programming
Note 2: Simple Examples of Linear Programs
Note 3: Two-Dimensional Linear Programs
Note 4: Convex Polyhedra and Linear Programming / Standard Form Linear Programs
Note 5: Standard Form Linear Programs (continued) / Basic Solution
Note 6: Properties of Basic Solutions / Geometric View of Linear Programs
Note 7: Solving Linear Equations Using Row Operations
Note 8: The Canonical Augmented Matrix / Updating the Augmented Matrix
Note 9: The Simplex Algorithm
Note 10: Matrix Form of the Simplex Method
Note 11: Two-Phase Simplex Method / Revised Simplex Method
Note 12: Dual Linear Programs
Note 13: Properties of Dual Problems / A Dual Quadratic Problem
Note 14: Introduction of Integer Linear Programming / Unimodular Matrices
Note 15: The Gomory Cutting-Plane Method
Note 16: Introduction to Problems with Equality Constraints / Problem Formulation
Note 17: Tangent and Normal Spaces
Note 18: Lagrange Condition / Second-Order Conditions
Note 19: Minimizing Quadratics Subject to Linear Constraints
Homework 4: The Simplex Method