Preliminary versions of all chapters of our book, Markov Decision Processes and Reinforcement Learning are now available for downloading.
Introduction to Decision Analysis and MDPs