Lecture Schedule
Jan 10, 2024: Introduction
Jan 17, 2024: Probability review
Jan 22, 2024: Text Normalization
Lecture slides: here
Jan 24, 2024: Text Representation
Lecture slides: here
Reading:
tf-idf: Section 6.5 of JM Chapter 6
Jan 29, 2024: Text Classification -- Naive Bayes and Introduction to Logistic Regression
Lecture slides: here
Reading:
Naive Bayes: Sections 4.1-4.6 JM Chapter 4
Logistic Regression and Gradient Descent: Sections 5.1-5.9 of JM Chapter 5 OR your favorite ML book
Jan 31, 2024: Text Classification -- Gradient Descent, Logistic Regression (contd) and Neural Networks
Lecture slides: here
Reading:
Logistic Regression and Gradient Descent: Sections 5.1-5.9 of JM Chapter 5 OR your favorite ML book
Neural Networks: Sections 7.1-7.4 of JM Chapter 7
Feb 5, 2024: Text Classification Evaluation
Lecture slides: here
Reading:
Evaluation: Sections 4.7 and 4.8 of JM Chapter 4 OR Sections 5.5 and 5.6 of CiML Chapter 5
Feb 7, 2024: Distributed Text Representations
Lecture slides: here
Reading:
Word vectors: Introduction and Sections 6.2-6.8 of JM Chapter 6
Feb 14, 2024: n-gram Language Models
Lecture slides: here
Reading:
n-gram Language Models: Introduction and Sections 3.1-3.5 of JM Chapter 3
Feb 19, 2024: Neural Language Models 1
Lecture slides: here
Reading:
Training Neural Networks: 10.1 and 10.2 of CiML Chapter 10
Feb 21, 2024: Neural Language Models 2 (Classification and LM with FNN and RNNs)
Lecture slides: here
Reading:
RNNs: 9.1-9.3 and 9.6 of JM Chapter 9
Feb 26, 2024: Neural Language Models 3 (RNNs, LSTMs, GRUs) and Intro to POS Tagging
Lecture slides: here
Reading:
RNNs: 9.1-9.3 and 9.6 of JM Chapter 9
Feb 28, 2024: Sequence Labeling: POS Tagging and NER
Lecture slides: here
Reading:
POS Tagging: Sections 8.1-8.2 of JM Chapter 8
NER, HMMs: Sections 8.3-8.4 of JM Chapter 8
March 4 and March 6, 2024: Mid-term project presentations
March 11 and March 13, 2024: Spring break. No class
March 18, 2024: Machine Translation
Lecture slides: here
Reading:
Machine Translation: 13.1-13.4 of JM Chapter 13.
Optional material on attention mechanism.
March 20, 2024: Machine Translation (contd.) and Midterm Review
Lecture slides: here
Midterm Review: here
Reading:
Machine Translation Evaluation: 13.6 of JM Chapter 13.
March 25, 2024: Mid-term Exam
March 27, 2024: Transformers
Lecture slides: here
Reading: 10.1 (optional), 10.2-10.6 of JM Chapter 10.
April 1, 2024: Parsing I
Lecture slides: here
Reading: 17.1-17.5 of JM Chapter 17
April 3, 2024: Parsing II
Lecture slides: here
Reading: 17.6-17.8 of JM Chapter 17
April 8, 2024: Data Annotation with guest lecturer
Lecture slides: here
April 10, 2024: Advanced Transformers I: Encoder Only Models-Pretraining and Finetuning
Lecture slides: here
Reading: JM Chapter 11
April 15, 2024: Advanced Transformers II: Encoder Only Models-Application of Parsing
Lecture slides: here
April 17, 2024: Advanced Transformers II: Decoder Only Models (LLMs)
Lecture slides: here
April 22 and April 24, 2024: Final Project Presentations
April 29, 2024: Advanced Transformer III: Implementation Details and Practical Applications of LLMs
Lecture slides: here
- Final project presentation dates will be announced later. Please hold Fr, 5/10, 12:00 pm for now.