Exam Calendar

The exam consists of 2 parts: 

• AI: written exam (2h 30 mins)

• ML: project

The final mark of the exam is obtained as a weighted average of the two parts (ML: 1/3, AI: 2/3) and will be registered only when both parts have been passed.The mark for each part will be valid for the entire A.Y., until the session of March/April 2024, included. After then, all marks will be cleared. 

ML Projects

ML Projects can be carried out in team of max 2 people, consist in implementing a Reinforcement Learning Agent based on Q-learning, and must implement two approaches:

1. Tabular Q-learning

2. Deep Q-Network (DQN), in its simplest form (using a single NN to approximate the Q-function)

Other approaches can be also implemented, but the two above are mandatory.

Any environment can be used (even one developed in the project itself), but we recommend using some already available, such as those provided by Gymnasium (formerly OpenAI Gym, which is also OK). 

Projects must be approved by the teacher before being submitted and presented. 

Projects can be submitted at any time through this form. The submission must consist in a single zip file containing:

• (mandatory) A pdf report describing: the problem addressed, the solution adopted, the experimental results, and the architecture of the implementation.

• (mandatory) The source files, collected in a single dir named src.

Optionally, to facilitate the presentation, a Colab notebook can be linked. The content of the notebook must be the same as that of the sources, which must be submitted anyway.

Discussions will take place as per the calendar below. Every project will be discussed separately with all team members. Every member is required to have full kowledge and understanding of every aspect of the project.

For students taking the AI module only: the exam consists in the AI exam only.

Exam Sessions

• First session:

  • Date, time, Room: Jun 10, 2024, 8.30, Rooms 204 and 105 (we meet here), Marco Polo Bulding (Viale dello Scalo S. Lorenzo, 82-88)

  • Reservation period: Check on INFOSTUD

  • ML Project discussion: Jun 17 at 17.00 online (same instructions as for student hour)

• Second session:

  • Date, time, Room: Jul 15, 2024, 8.30, Rooms 204 and 105 (we meet here), Marco Polo Bulding (Viale dello Scalo S. Lorenzo, 82-88)

  • Reservation period: Check on INFOSTUD

  • ML Project discussion: Jul 22 at 17.00 online (same instructions as for student hour)

• Third session:

  • Date, time, Room: Sep 5, 2024, 8.30, Rooms 105, Marco Polo Bulding (Viale dello Scalo S. Lorenzo, 82-88)

  • Reservation period: Check on INFOSTUD

  • ML Project discussion: Sep 16 at 17.00 online (same instructions as for student hour)

• Special session (appello straordinario):

  • Important: to take the exam in this session you need to formally conform to the following regulation (double check with administration if in doubt): "Riservata a studenti part-time, fuori corso nell’A.A. 2022-2023, studenti genitori, studenti lavoratori, studenti con disabilità e con D.S.A." 

  • Date, time, Room: TBA

  • Reservation period: TBA

  • ML Project discussion: TBA

• Fourth session:

  • Date, time, Room: TBA

  • Reservation period: TBA

  • ML Project discussion: TBA

• Fifth session:

  • Date, time, Room: TBA

  • Reservation period: TBA

  • ML Project discussion: TBA

• Special session (appello straordinario): 

  • Important: to take the exam in this session you need to formally conform to the following regulation (double check with administration if in doubt): "Riservata a studenti part-time, fuori corso, iscritti per l’A.A. 2022-2023 al terzo anno della laurea e al secondo anno della laurea magistrale, studenti genitori, studenti lavoratori, studenti con disabilità e con D.S.A." 

  • Date, time, Room: TBA

  • Reservation period: TBA

  • ML Project discussion: TBA