Interactive Notebooks

Please find all EdyGym notebooks below.  

Each notebook introduces a particular reinforcement learning challenge, illustrate the challenge in its associated environment, explains possible solution approaches to the challenge, and experimentally shows the effect of these choices. Click on each link to visit the notebook. 

Interactive Notebooks

1. Exploration

2. Credit assignment: On- versus off-policy

3. Credit assignment: Depth

4. State: Dimensionality

5. State: Partial Observability

6. State: Amount of Signal / Language

7. State/Action: Discrete versus continuous

8. Dynamics: Stochasticity

9. Dynamics: Model-based Reinforcement Learning

Usage instructions

• All notebooks use Google Colab, but EduGym is in no way authorized by Google. 

• Each notebook contains the pre-ran output of the current code, which you can directly investigate. 

• You can also run the code yourself: 

  • To do so, you first press "Connect" in the top-right of the notebook, to connect to the runtime. 

  • You can then run individual cells by pressing the "play" icon in front of them, or run the entire notebook from the "Runtime" dropdown menu on top. 

• You can also modify code in the notebook, and rerun segments of code. 

  • Each segment of code simply uses and modifies your current variable workspace. 

  • Therefore, you should in principle run the notebook from top to bottom, because later cells often require variables that are defined in earlier code segments.