Knitro

Introduction   Algorithms & Interfaces   Supports & Services   Product Info   Fact Sheet  

Training  Research  MINLP Research

"An integrated field model combined with optimization presents many technological challenges in terms efficient algorithms to couple models, as well as models with optimization, and sufficient hardware capability to run the complex model." by Silvya Dewi Rahmawati in March 2012 PhD thesis.

Optimal Control Area :

Title : "Searching the optimal solution of the root nodes in Active Set Identification" - Active Set methods are good for warm starts, which are also better for solving mixed integer nonlinear optimization problems. The penalty/barrier parameters and trust region methods help to solve the active set identification problems. When one optimal solution of the root node is obtained, it is possible to use multi-start to try to find the global solution. If more root nodes are found, then multi-start with acceptable boundaries between nodes partitions and outer nodes partitions should be attempted for global optimization. It is based on the possibility of the bounds on the optimal value and of the feasible solutions found. Some hints on parallel implementation and hot starts of large scale problems with the powerful features of Knitro software are discussed. Explicit Euler, Implicit Euler and Trapezoidal methods will be examined. 

Small and medium scale mixed integer nonlinear programming (MINLP) can be solved using a Branch and Bound variant called "spatial Branch and Bound" (sBB), where branching is allowed both on continuous and discrete variables that contribute to the gap between the original problem and its convex relaxation. For large scale variants it is good to use heuristics, such as Rounding, Feasibility Pump, Local Branching; or according to the problem structure to solve using special-purpose methods.

When the processes to be optimized are time-dependent, mixed-integer optimal control problem (MIOCP) is formally more general than MINLP, but after a certain way of discretization/decomposition a subclass of MINLP with specific features that need to be studied.
Useful methods are convexification, spatial branching, domain reduction, nonlinear cutting planes techniques and reformulation-linearization technique.
Definition : The mixed-integer optimal control problem, also called mixed-integer dynamic optimization (MIDO) problem, considers the computation of time dependent operating conditions (controls), discrete – binary or integer- decisions and time-independent parameters so as to minimize (or maximize) a performance index (or cost function) while keeping a set of constraints coming from safety and/or quality demands and environmental regulations.
Because of their non-convexity, an optimal solution is in general sought using Branch & Bound techniques (in the switched systems). These methods recursively partition/discretization the feasible set and obtain a lower bound on the optimal solution value by generating convex relaxation of the original problem. The introduction of Automatic Differentiation is important for Evaluating Derivatives to minimize the evaluation/rounding errors.
Reformulation : It is good to use an outer convexification with respect to the binary controls as suggested by Sebastian Sager.  Sebastian Sager describes that the reformulated control problem has two main advantages compared to standard formulations or convexifications. First, especially for time-optimal control problems, the optimal solution of the relaxed problem will exhibit a bang-bang structure, and is thus already integer feasible. Second, theoretical results have recently been found that show that even for path-constrained and sensitivity-seeking arcs the optimal solution of the relaxed problem yields the exact lower bound on the minimum of the integer problem. This allows to calculate precise error estimates, if a coarser control discretization grid, a simplified switching structure for the optimization of switching times, or heuristics are used.
 

Presentation :

 

[2008] Mathematical Optimization of Water Distribution Systems using Mixed Integer Nonlinear Programming,

Henry Kar Ming Chan, AMSI / MASCOS Industry workshop & ICE WaRM Industry Short Course: The mathematics of water supply and pricing,

14-16 July 2008.

 

Competition :

 

DARPA Seeks Robot Enthusiasts (and you) to Face Off for (US)$2M Prize!

Hardware, software, modeling and gaming developers sought to link with emergency response and science communities to design robots capable of supervised autonomous response to simulated disaster

(Source: DARPA; issued April 10, 2012 defense-unmanned.com)

 

Current and Future Year External Link : 

 
6-8 January 2013.
 
19-24 August 2012.
 
8-11 July 2012.
 
26-29 June 2012
 
5-9 March 2012. 
 

Reference :

 

 
 
 
[2012] Integrated Field Modeling and Optimization. Ph.D. thesis. [MINLP application]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

 

[2010] Experiments with MINLP Branching Techniques.

 

[2010] Nonlinear Constrained Optimization : Methods and Software.

 

[2010] ALGORITHMS AND SOFTWARE FOR CONVEX MIXED INTEGER NONLINEAR PROGRAMS.

 

[2009] Overview on Mixed Integer Nonlinear Programming Problems.

 

[2009] Application-oriented Mixed Integer Non-linear Programming, Phd thesis.

  

[2009] Applications and Algorithms for Mixed Integer Nonlinear Programming.

 

 

Course Materials for Mathematical and Computational Optimization of Dynamic Process :

 

[2012] Ph.D. course on convex optimization

 

[2012] Algorithmic Choices When Solving an Optimal Control Problem

 

[2012] The Direct Transcription Method for Optimal Control

 

[2011] Numerical Optimal Control (DRAFT) and Exercises 

 

[2011] A Tutorial on Non-Convex Mixed-Integer Non-Linear Programming

 

[2011] Advanced Process Systems Engineering

 

[2010] Computational Methods for Process Engineering

 

[2010] Script for Numerical Optimization Course

 

[2010] A Tutorial on Mixed-Integer Non-Linear Programming

 

[2010] Combinatorial Integral Approximation for Mixed-Integer Nonlinear Optimal Control 

 

[2010] On a global minimum principle for DAE optimal control problems

 

[2007] Optimal Control of Ordinary Differential Equations and Differential-Algebraic Equations by Matthias Gerdts, Mixed-Integer Optimal Control (Page 185-200)

 

Latest MINLP Benchmark Results : 

 

[2012] Mixed Integer (QC)QP Benchmark

 

[2011] AMPL-NLP Benchmark

 

[2011] convex-MINLP Solvers in GAMS

 

[2011] NLP Solvers in GAMS

 

[2010] Nonlinear large-scale Optimization

 

Books : 

 

[2012] Mixed Integer Nonlinear Programming by Jon Lee; Sven Leyffer (Eds.)

Series: The IMA Volumes in Mathematics and its Applications, Vol. 154

 

[2012] Optimal Control of ODEs and DAEs by Matthias Gerdts

Covers techniques for real-time control, feedback control, and Mixed-Integer Optimal Control.

Problems : 

 

There are some mixed integer nonlinear programming (MINLP) problems in the MIOCP benchmark (Mixed-Integer Optimal Control Problem). The preliminary results are as follows:

 

A. Lotka Volterra fishing problem (AMPL)

 

A solution obtained by Knitro version 6.0 under NEOS server environment and tested by Henry Kar Ming Chan. The standard defaults are used except the strong branching strategies and the integrality gap tolerances without parallel features. Final objective value is 1.34521362. Number of nodes processed is 508 and number of sub-problems solved is 671. Total program CPU time is 2823.85 seconds with time spent in evaluations for 684.37 seconds. The intervals on the equidistant grid on which w(t) = 1 holds, counting from 0 to 99, are 20-32, 34, 36-37, 42, 44, 52.

 

B. F-8 aircraft (AMPL)

 

CASE 1. A solution obtained by Knitro version 8.0 under NEOS server environment was tested by Henry Kar Ming Chan for the reduced model. The reduced model is defined by using less number of period of time (i.e. ntperu := 10). The standard defaults were used except mainly the strong branching strategies, maximum iterations and maximum nodes without parallel features and external optimizers. Final objective value is 0.0209291222. Number of nodes processed is 601 and number of sub-problems solved is 607. Total program CPU time is 62.164 seconds with time spent in evaluations for 14.67261 seconds. The intervals on the equidistant grid on which w(t) = 1 holds, counting from 0 to 59, are 0, 1, 31, 32, 44, 52, and 53.

The future release of Knitro may have the features such as the new pre-solver, new parallel features and improvements in mixed-integer programming and the active-set algorithm.

 

CASE 2. A solution obtained by Knitro version 6.0 under NEOS server environment was tested by Henry Kar Ming Chan for the reduced model. The reduced model is defined by using less number of period of time (i.e. ntperu := 200). The standard defaults were used except mainly the strong branching strategies, the integrality gap tolerances and maximum nodes without parallel features and external optimizers. Final objective value is 0.02200987541. Number of nodes processed is 861 and number of sub-problems solved is 872. Total program CPU time is 10775.09 seconds with time spent in evaluations for 3276.315 seconds. The intervals on the equidistant grid on which w(t) = 1 holds, counting from 0 to 59, are 0, 1, 31, 32, 42, 52, and 54.

 

C. More AMPL or other examples about optimal design and optimal control can be found on the following web sites:

Past Years External Link :  

 
24 May 2011.
 
 
 

[2009] CPAIOR09 : BR-OPT workshop : Bound Reduction techniques for Constraint Programming and Mixed-Integer Nonlinear Programming,

28 May 2009.

 

[2009] Spring Workshop : Computational Issues in Mixed Integer Nonlinear Programming,

19-20 March 2009.

 

[2008] IMA Hot Topics Workshop : Mixed-Integer Nonlinear Optimization: Algorithmic Advances and Applications,

17-21 November 2008.