Machine Learning EMI

上課連結: 週一班 週六班ndations

Week 1 (slides): 

       Course Logits

  What is Machine Learning?  

  Formal Model

  Lab 0: Data Flow

Week 2:  

       No Lecture (Department administration affair). 

Week 3 (slides):    

      Linear hypothesis class

      Loss and optimization

      Generalization question

      PAC learning

      LAB 1: Learning with a linear classifier

Week 4 (slides):      

     Why finite-class PAC bounds fail for infinite hypothesis classes

     Shattering

     VC dimension

     VC-based generalization and sample complexity

     LAB 2: From theory to practice 

Week 5 (slides):

      No Free Lunch Theorem

      Bias-Variance TradeOff  

Week 6 (slides): 

     Convex Learning Problems

Week 7: 

      Spring Holiday (No Lecture)!

Week 8:   

      Midterm I  (13:30~16:00 Close Book. Held in the classroom.)

Week 9: 

      Surrogate Function  

      Stability of Strongly Convex Learning Problems (1:05:00)

 Week 10 (slides):       

 Support Vector Machine

      Kernel Trick

      The Representer Theorem

Week 11 (slides):       

 KNN

      Decision Tree

Majority Voting

     (自主學習) Implementation: Majority Voting and Parameter Tuning 

     Bagging      

AdaBoost  

GradientBoosting 

XGBoost

Week 12 (slides):       

Single Neural Networks

Complexity, Regularization, and Stability

Neural Networks as Representations

Neural Ensembles

Week 13: 

Data Preprocessing

     L1 Regularization 

     (自主學習) Implementation: Feature Selection

     Principle Component Analysis

      LDA

     Kernel PCA

     (自主學習) Implementation: Kernel PCA

     Machine Learning Pipeline and Cross-Validation 

     Learning Curve

     Imbalanced Data 

Week 14: 

     Clustering and K-means

     Determine the number of clusters

     Agglomerative Clustering

     DBSCAN        

Week 15: 

     Midterm II 

Week 16: 

     Final Report

    上課時繳交: Final Exam