This book provides a rigorous and self-contained introduction to reinforcement learning. The book is intended for teaching an advanced undergraduate course, and is based on our teaching of such a course at Tel Aviv University and at Technion over the past several years.