Prof. Lei Ying and I are currently working on an introductory book on reinforcement learning. The draft and lecture slides are available here.