Schedule

Topics listed in the schedule are tentative and subject to change

• 08/23/2022 (MR) Introduction

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 2: Regular Expressions, Text Normalization, and Edit Distance

  • Written Assignment Release

• 08/25/2022 (MR) Naive Bayes, Linear Classifier

  • Manning, Raghavan and Schutze, Introduction to information retrieval, Chapter 13: Text classification and Naive Bayes

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 4: Naive Bayes Classification and Sentiment Analysis

  • Coding Assignment 1 Release

• 09/06/2022 (MR) Word Embeddings (continued), Neural Networks & Neural Language Models

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 7: Neural Networks and Neural Language Models

• 09/08/2022 (MR) RNN, Sentence Representation

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 9: Deep Learning Architectures for Sequence Processing

  • Kiros et al, Skip-Thought Vectors

  • Coding Assignment 1 Deadline

• 09/20/2022 (RA) Dialogue (continued)

• 09/22/2022 (RA) Experiment Design; Annotation and Evaluation

  • Passonneau and Carpenter (2014): The Benefits of a Model of Annotation

  • Written Assignment Peer-Grading Deadline

• 10/04/2022 (MR) Language Models, Smoothing

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 3: N-gram Language Models

  • Project Proposal Deadline

• 10/06/2022 (MR) Spelling Correction & Statistical Machine Translation

  • Michael Collins: Statistical Machine Translation: IBM Models 1 and 2

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Appendix B: Spelling Correction and the Noisy Channel

  • Peter Norvig: How to Write a Spelling Corrector

• 10/18/2022 (RA) Constituent Parsing, Dependency Parsing

  • Charniak (1997): Statistical Techniques for Natural Language Parsing

  • Michael Collins: Probabilistic Context-Free Grammars (PCFGs)

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 12: Constituency Grammars

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 13: Constituency Parsing

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Appendix C: Statistical Constituency Parsing

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 14: Dependency Parsing

• 10/20/2022 (RA) Semantics: role labeling, word semantics

  • Jurafsky and Martin, Speech and Language Processing (3rd edition draft), Chapter 19: Semantic Role Labeling

  • Gildea and Palmer (2002): The Necessity of Parsing for Predicate Argument Recognition

• 11/01/2022 Article presentations

• 11/03/2022 Article presentations

  • Project Status Report Deadline

• 11/15/2022 (Guest lectures: Setareh Nasihati Gilani and Ehsan Qasemi) TBD

• 11/17/2022 (Guest lecture: Jesse Thomason) Grounding Language

  • Bisk et al. (2020) Experience Grounds Language

  • Tan and Bansal (2020): Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision

• 11/29/2022 Project poster presentations (in class)

• 12/01/2022 Project poster presentations (in class)

  • Project final report due