Pattern Recognition and Machine Learning
2024 - 02
General Information
Objective: Study of the main machine learning methods and applications.
Syllabus: Machine learning basics; Python and Scikit-learn; Data preprocessing; Classifiers; Dimensionality Reduction; Hyperparameter tuning; Regression; Clustering; Recent Topics.
Duration/credits: 12 weeks - three credits.
Time: Fridays (08:20 - 12:00) - online synchronous (SYN) and asynchronous (ASYN) classes.
Grade: Assignments (20%) and Final Project (80%).
Lecturer: André Eugenio Lazzaretti.
Bibliography and Support Materials
Books:
Theory:
Bishop, C. Pattern Recognition and Machine Learning. Springer, 2006.
Theodoridis, S. Machine Learning: A Bayesian and Optimization Perspective. Academic Press, 2020.
Deisenroth, M. P.; Faisal, A. A. & Ong, C. S. (2020), Mathematics for Machine Learning, Cambridge University Press.
Practical:
Raschka, S. Python Machine Learning. Packt, 2020.
Linear Algebra:
Vector Calculus:
Probability and Statistics:
Optimization:
Python Basics:
General overview: link (Part II - L03 and L04).
Week 7 - 23/08
(SYN) Lecture 11 - Neural Networks and Backpropagation
Slides (slides);
Video (link).
Codes (link).
(ASYN) Assignment 6 - Neural Networks
Guide (link).
Week 10 - 13/09
Final Project Discussion.
Final Project - Rules:
It can be in pairs.
Something more than getting data and model already available is expected.
Important to detail and interpret the results.
Important: it could become a publication in a conference/journal.
Project Proposals - Guidelines:
What is the problem to be solved? Preferably a real problem that can be solved via deep learning.
Appropriate answer: perform classification of EEG signals to identify movement intentions.
Inappropriate answer: I have this dataset (own, Kaggle, etc.) and intend to use a CNN to check the classification result.
Dataset available? Few data may make it unfeasible.
What techniques do you intend to use and why?
If you have a comparison parameter (papers, kaggle, etc).
Final Project - Presentation:
Final Report Deadline: TBD.
Must contain: Introduction (detailing the addressed problem); Methodology; Results (with comparisons, if possible); Conclusions.
Suggested template: IEEE.
Presentation Deadline: TBD. 15 minutes for each work + 5 minutes for questions.
Week 11 - 20/09
Final Project Discussion.