Classes: Tuesdays 2:15 PM and Thursdays 4:15 PM, Online until further announcements
Books:
Understanding Machine Learning by Shai Shalev-Shwartz and Shai Ben-David [SSBD]
Foundations of Machine learning by Mehryar Mohri, Afsin Rostamizadeh and Amet Talwalkar
Introduction to Computational Learning Theory by Michael J. Kearns and Umesh V. Vazirani
Grading: Midterm 20%, Assignments+Class tests (20%+10%), Final 50%
Class 1 (Oct 07): Introduction: Basic terminologies [Video] [Boardwork] read Chapter 2 of SSBD, Exercise 2.3 submit by October 21.
Class2 (Oct 21): Definitions of PAC and Agnostic PAC learnability. Finite hypothesis classes are PAC learnable [Video][Boardwork] read Chapter 3 of SSBD.
Class 3 (Oct 26): Agnostic PAC learnability, Learning Via Uniform Convergence, Finite Hypothesis Classes are Agnostic PAC Learnable [Video][Boardwork] read Chapter 4 of SSBD
Class 4 (Oct 28): No Free Lunch Theorem [Video][Boardwork] read Chapter 5 of SSBD
Class 5 (Nov 02): More on No Free Lunch Theorem, Bias variance Tradeoff, Bayes optimal Classifier [Video][Boardwork] read Chapter 5 of SSBD
Class 6 (Nov 09):Shattering, VC Dimension, Examples [Video][Boardwork] read Chapter 6 of SSBD
Class 7 (Nov 11): VC-dimension of halfspaces, fundamental theorem of statistical learning [Video][Boardwork] read Chapter 9 (section 9.1.3) of SSBD
Class 8 (Nov 16): Growth function, Sauer's Lemma [Video][Boardwork] read Chapter 6 of SSBD
Class 9 (Nov 23): NFL theorem and Fundamental Theorem, [Video][Boardwork]
Class 10 (Nov 25): Fundamental Theorem quantitative version [Video][Boardwork]
Class 11 (Dec 9): Non uniform learnability, structural risk minimization [Video][Boardwork]
Class 12 (Dec 16): Structural Risk Minimization, Minimum description length [Video][Boardwork]
Class 13 (Dec 21): Consistent Learning, Computational Complexity of Learning [Video][Boardwork]
Class 14 (Dec 28): Learning Boolean Conjunctions, Learning 3-DNF formulae [Video][Boardwork]
Class 15 (Dec 30): Hardness of Learning [Video] [Boardwork]
Class 16 (Jan 04): Hardness of Learning [Video] [Boardwork]
Class 17 (Jan 11): Hardness of Learning [Video] [Boardwork]
Class 18 (Jan 15): Boosting [Video] [Boardwork]
Class 19 (Jan 18): Boosting [Video] [Boardwork]
Class 20 (Jan 20): Few words about Rademachar Complexity, closing [Video][Boardwork]