Links
Continuous-time Markov Chains (OR Methods, Jensen)
http://www.me.utexas.edu/~jensen/ORMM/models/unit/markproc/index.html
Discrete-time Markov Chains (OR Methods, Jensen)
http://www.me.utexas.edu/~jensen/ORMM/models/unit/markchain/index.html
Continuous-time Markov Chains (OR Methods, Jensen)
http://www.me.utexas.edu/~jensen/ORMM/models/unit/markproc/index.html
Discrete-time Markov Chains (OR Methods, Jensen)
http://www.me.utexas.edu/~jensen/ORMM/models/unit/markchain/index.html