Overview

This graduate-level course will explore techniques for the analysis of visual data, primarily color images. The first part of the course will examine the physics and geometry of image formation, including the design of cameras and the study of color sensing in the human eye. The second part of the the course we will focus on algorithms to extract information from images. This includes detection of interest points for image alignment, depth estimation, and instance recognition; representations and architectures of image classification, object detection and de-noising; and generative modeling of images. The course covers both modern (e.g., deep learning based) and classical (physics and geometry based) techniques. Time permitting we will look at some additional topics at the end of the course.

Course assignments will highlight several computer vision tasks and methods. For each homework, you will construct a basic system and improve it through a cycle of error analysis and model redesign. There will also be a final project which will investigate a single topic or application in greater depth. This course assumes a strong working knowledge of probability, linear algebra, and ability to program in Matlab or Python. Prior experience in machine learning, signal or image processing is strongly recommended. Take a look at the course structure page for details.

NOTE: Due to COVID this course will be taught remotely.

Staff

• Instructor: Subhransu Maji (smaji@cs.umass.edu)

• TA: Chenyun Wu (chenyun@cs.umass.edu)

Logistics

• Class: Pre-recorded or live via Zoom.

• Moodle for homework and project write-ups instructions.

• Piazza for announcements and discussions.

• Gradescope for submissions and grades.

Grading

• 60% Mini projects (5 in total)

• 15% Weekly homework (~10 in total)

• 23% Final project

• 2% Class participation

Accommodation statement

The University is committed to providing an equal educational opportunity for all students. If you have a documented physical, psychological, or learning disability on file with Disability Services (DS), you may be eligible for reasonable academic accommodations to help you succeed in this course. If you have a documented disability that requires an accommodation, please notify me within the first two weeks of the semester so that we may make appropriate arrangements.

Academic honesty

Since the integrity of the academic enterprise of any institution of higher education requires honesty in scholarship and research, academic honesty is required of all students. Students are expected to be familiar with this policy and the commonly accepted standards of academic integrity (http://www.umass.edu/honesty).

Acknowledgements

Many of the slides and homework assignments are based on excellent computer vision courses taught elsewhere by Svetlana Lazebnik, Alyosha Efros, Alexander Berg, Steven Seitz, James Hays, Charless Fowlkes, Kirsten Grauman and many others. Many thanks to Richard Szeliski for making the textbook available online for free.