Finite Markov Chains Resources

We will use the following chapter as our primary resource:

Markov Chains

This chapter is from a text that can be found on this page, along with links to the programs referenced in the book:

Introduction to Probability

We will be using the first chapter of this book to cover the basics of probability theory:

Probability Resource

Here are some assorted references that may prove useful and/or interesting:

James Norris's Markov chains textbook

Richard Weber's Markov course blog

Applications of Markov chains

Algorithmic applications of Markov chains