Post date: Feb 26, 2011 10:07:27 AM
Here a good site for simulating Markov Chains. The states are limited to 4 but it gives a good understanding of the state probabilities.
http://people.hofstra.edu/Stefan_Waner/markov/markov.html
Also a state is known as an absorbing state when it is impossible to leave it i.e. Pii = 1.