Tool List

This is a list of useful software tools for research in control, optimization, and networks.

Miscellaneous

• arXiv Sanity Preserver for quickly parsing and searching CS, ML, and Math papers on arXiv
• WolframAlpha
• Phase plane plotter for nonlinear systems w/ 2 states
• Desmos for 2D plotting
• Geogebra for 3D plotting
• TensorFlow Playground, an interactive visual intro to neural networks

Python

Programming

• Python
• PyCharm IDE
• Spyder IDE
• Anaconda
  • Package management
• Jupyter
  • Interactive notebooks
• Kite
  • AI-based autocomplete
• Atom IDE
  • Packages: Script(Compile), Hydrogen + Python module (Interactive/Compile)

Numerical and scientific computing

SciPy Ecosystem

• NumPy
• SciPy
• Matplotlib
• Pandas
• SymPy
• NetworkX

Optimization

• CVXPY
• PICOS
• MOSEK
• Gurobi

Control

• Python Control Systems Library (python-control)

Simulation

• PyBullet
  • Physics simulation for robotics, games, visual effects and machine learning
• MuJoCo
  • Physics engine for robotics, biomechanics, graphics, animation, and machine learning

Reinforcement Learning

• Spinning Up in RL
  • Intro to deep RL
  • OpenAI
• Dopamine
  • Rapid prototyping of RL algorithms
  • Google
• ReAgent
  • End-to-end platform for applied RL
  • Previously "Horizon"
  • Facebook
• Ray
  • RLib
    • Scalable Reinforcement Learning
  • Tune
    • Scalable Hyperparameter Tuning
  • RaySGD
    • Scalable Deep Training
  • UC Berkeley
• rlpyt
  • Deep RL in PyTorch
  • Compatible w/ Gym
  • Blog post from BAIR
• SUMO
  • Traffic simulation
  • Developed by the Institute of Transportation Systems at the German Aerospace Center

Machine Learning

• TensorFlow
• PyTorch
• scikit-learn

MATLAB

Programming

• MATLAB

Optimization

• CVX
• SOSTOOLS
• YALMIP
• MOSEK
• Gurobi
• Sedumi

Control

• Control System Toolbox
• Robust Control Toolbox
• System Identification Toolbox
• Model Predictive Control Toolbox

Machine Learning

• Statistics and Machine Learning Toolbox

Julia

Programming

• Julia
• Atom IDE
  • Packages: Juno

Numerical and scientific computing

• Linear Algebra
• LightGraphs - Network Graph Creation and Analysis with extensions
  • LightGraphsExtra
  • MetaGraphs
  • SimpleWeightedGraphs
  • GraphIO

Plots & Visualization

• Plots with back-end packages
  • Examples and back-end comparisons
  • PyPlot with MatPlotLib
  • GR
  • UnicodePlots
  • PlotlyJS
• StatsPlots - statistics plots
• Network graph visualization
  • GraphPlot
  • TikzGraphs + TikzPictures
  • GraphRecipes (earlier PlotRecipes)
  • NetworkViz
• ThreeJS
• Colors - Control over color profiles, gradient packages
• LaTeXStrings - LaTeX to string functionality

Data Storage

• FileIO
• JLD2

Integration with other software

• MATLAB - requires MATLAB installed for local automation server
  • Run command "regmatlabserver" in MATLAB command prompt
• Conda + Python

Competitions

• DuckieTown