This course begins with discussion of linear models, Auto Regressive Moving Average (ARMA) and Auto Regressive Moving Average with Exogenous inputs (ARMAX) models. We then develop Reinforcement Learning algorithms for these models and analyze their learning regret.