Figure from Sutton and Barto, (2018), Reinforcement learning: An introduction. MIT press.