CS 4803/8803: Efficient Machine Learning

Lecture Location: College of Computing Room 17
Lecture Time: Monday & Wednesday 12:30 PM - 01:45 PM Eastern Time

Semester Schedule (Tentitive)

Date

Lecture

Logistics

Aug. 18

Lecture 1: Course Overview & Deep Learning Basics - Part I

Homework 0 out

Aug. 20

Lecture 2: Deep Learning Basics - Part II

Chapter 1: Efficient Deep Learning Techniques

Aug. 25

Lecture 3: DNN Pruning - Part I

Aug. 27

Lecture 4: DNN Pruning - Part II

Homework 1 out

Sep. 1

Labor Day (No Lecture)

Sep. 3

Lecture 5: DNN Quantization - Part I

Sep. 8

Lecture 6: DNN Quantization - Part II

Homework 0 due

Sep. 10

Lecture 7: Invited Talk on Quantization (Dr. Charbel Sakr from Nvidia Research)

Sep. 15

Lecture 8: DNN Quantization - Part III + NAS

Homework 2 out

Sep. 17

Lecture 9: Knowledge distillation + Dynamic inference + Data-Efficient ML

Sep. 22

Lecture 10: Dynamic inference + Data-Efficient ML - Part II

Homework 1 due

Chapter 2: Decentralized Deep Learning Training Techniques

Sep. 24

Lecture 11: Distributed Training - Part I

Sep. 29

Lecture 12: Distributed Training - Part II

Oct. 1

Lecture 13: Distributed Training - Part III

Oct. 6

Fall Break (No Lecture)

Oct. 8

Lecture 14: Invited Talk on Distributed Training (Dr. Youjie Li from ByteDance)

Oct. 13

Lecture 15: Lightning Presentations - Session 1

Homework 3 out

Oct. 15

Lecture 16: Lightning Presentations - Session 2

Homework 2 due

Oct. 20

Lecture 17: Lightning Presentations - Session 3

Chapter 3: Efficient Deep Learning Solutions for Emerging Applications

Oct. 22

Lecture 18: Efficient Large Language Models - Part I

Homework 4 out

Oct. 27

Lecture 19: Efficient Large Language Models - Part II

Oct. 29

Lecture 20: Efficient Vision Transformers

Nov. 3

Lecture 21: Efficient 3D Reconstruction - Part I

Homework 3 due

Nov. 5

Lecture 22: Invited Talk on 3D Reconstruction (Prof. Chaojian Li from HKUST)

Nov.10

Lecture 23: Invited Talk on Efficient LLMs (Dr. Yonggan Fu from NVIDIA)

Nov. 12

Lecture 24: Efficient 3D Reconstruction - Part II

Chapter 4: Algorithm-hardware Co-design for Efficient Machine Learning

Nov. 17

Lecture 25: Algorithm-hardware Co-design

Nov. 19

Lecture 26: Lightning Presentations - Session 4

Nov. 24

Lecture 27: Invited Talk on Algorithm-hardware Co-design
(Prof. Yang (Katie) Zhao at UMN)

Homework 4 due

Nov. 26

Student Recess & Thanksgiving Holiday (No Lecture)

Dec. 1

Lecture 28: Lightning Presentations - Session 5

Page updated

Google Sites

Report abuse