EE/CS 381: Sensorimotor Learning for Embodied Agents

Overview:

This is an advanced course focusing on modern machine-learning algorithms for autonomous robots as embodied intelligent agents. It covers advanced topics that center around what embodied AI is and how it differs from internet AI. How embodied agents perceive their environment from raw sensory data, make decisions, and continually adapt to the physical world through both hardware and software improvements.  By the end of the course, we hope to prepare you for conducting independent research in this area, knowing how to formulate the problem, design the algorithm, critically validate the idea through experimental designs, and finally, clearly communicate the findings in both writing and presentation.   Students are expected to read, present, and debate the latest research papers on embodied AI, as well as obtain hands-on experience through a capstone project. 

• Instructor: Shuran Song

• Time:  MW 3:00 pm-4:20 pm

• Location: 380-380F 

Announcement:

• Add yourself to the course Slack channel

Pre-requisites:

• Familiarity with the basic linear algebra.

• Knowledge of basic machine learning, computer vision, and robotics.  

• If you are not sure whether you are ready for the course, please check the course instructor. 

Grading:

• Presentation & Discussion (50 %)

  • In class discussion (40%) Students will  discuss each paper with one of 7 assigned roles (e.g., author, reviewer, learner ...)   

  • Offline discussion (10%): participate in discussion on Slack 

• Course project (50 %)

  • Project proposal (20%)

  • Final project presentation (20%) 

  • Project write-up (10%)

Resources

• PyTorch tutorial

• TensorFlow

• PyBullet Quickstart Guide

• OpenAI Spinning Up in Deep RL

Not seeing anything above? Reauthenticate