Logistics

When: Tuesday and Thursday, 9:30 am-10:45 am ET
Where: 125 Hanes Hall
Office hours:
  Instructor: Thursdays, 11-12:30pm (email for appointment)
TA : Mondays, 10:30-12:00 am in FB 220

Sign up on the course Piazza (Access code is comp790)

Announcements:
-- Assignment 2 is out
-- Assignment 1 is out
-- Some suggested project ideas
-- Sign ups for paper presentations live here

Course Information

This is a research-oriented course on structured prediction. which is the class of prediction problems where the output is constrained by some structure. These include labeling, alignment, parsing, ranking and segmentation problems over structures such as sequences, trees and graphs. The examples used in the course will focus on problems from natural language processing, although the methods will have applications in many domains (computer vision, computational biology, social media analysis, information retrieval, etc.). We will also explore some methods for machine learning with structured inputs. 

The course will also involve paper readings and a research project. The first half of the course will focus on foundational methods in this area, while the second half will also explore recent methods such as graph-based neural networks and Transformer-based architectures . The tentative list of topics that we will cover is:

• Structures: sequences, trees, graphs. 

• Practical concerns in predicting structures

• Linear Sequence models: HMMs, MEMMs, CRFs

• Structured Perceptron and Large-margin methods (M3Ns, Structured SVMs)

• Inference methods: Dynamic Programming, Graph algos, ILPs, MCMC Sampling, Variational Inference, Continuous Inference Networks

• Graphical Models, Latent Variable Modeling, VAEs

• Deep Structured Prediction, Energy-based Models

• Graph-based and Transformer-based Neural Networks

• Optimization: SGD, EM, Dual Decomposition, AD3

• Learning to Search and RL: DAgger & SEARN-like methods

Prerequisites:

This course assumes previous experience with Machine Learning (prior exposure to NLP will be a plus), although there are no formal pre-requisites. If you have not taken such classes before or are uncertain, you should speak to the instructor.

Class Schedule (tentative):