EP3260: Fundamentals of Machine Learning Over Networks

This course covers fundamentals of machine learning over networks (MLoN). It starts from a conventional single-agent setting where one server runs a convex/non-convex optimization problem to learn an unknown function. We introduce several approaches to address this seemingly, simple yet fundamental, problem. We introduce an abstract form of MLoN, present centralized and distributed solution approaches to address this problem, and exemplify via training a deep neural network over a network. The course covers various important aspects of MLoN, including optimality, computational complexity, communication complexity, security, large-scale learning, online learning, MLoN with partial information, and several application areas. As most of these topics are under heavy researches nowadays, the course is not based on a single textbook but builds on a series of key publications in the field. The course also includes a two-days workshop on recent advancements on fundamentals of MLoN. The course started in 2019 and the previous course material can be found here.

Students will be grouped for homework and computer assignments. Special topic sessions are in the format of a two-days workshop, where students will present (both oral presentation and posters) some key publications of the field. A basic knowledge of convex optimization and probability theory is required to follow the course.

Announcements

• The workshop, including Invited Speakers, Panelists, and the Student Presentations, will be on May 18-19. Please visit the website here.
• The recording of Lecture 10 is now available.
• Check the slides for Lecture 10 and new assignment: CA7.
• The recording of Lecture 8 is now available.
• Check the slides for Lecture 8 and new assignment: CA 6.
• The recording of Lecture 7 is now available.
• Check the slides for Lecture 7 and new assignment: CA 5.
• Due to the recent COVID-19 situation, all lectures have been postponed for 1 month. Please check the updated schedule on Course materials and download the new calendar on Course info.
• Check the new assignments: Homework 3, CA 3 and CA 4.
• Check the slides for Lecture 5 and Lecture 6.
• Check the slides for Lecture 3 and new assignments: Homework 2, CA 1 and CA 2.
• Check the slides for Lecture 2 and new assignment: Homework 1.
• Check the slides for Lecture 1.
• Registration is open. Register Here.
• The MLoN 2019 course videos are available in the YouTube playlist. You can subscribe to the channel to get updated videos.
• See here the full schedule.