Semester: Spring 2020
Location and Hours: Tuesdays and Thursdays, 9:35--10:50am, Room 113 Bright Building
Instructor: Prof. Anxiao (Andrew) Jiang, 309B Bright Building. Email: ajiang@cse.tamu.edu
Grader: John Mathai Reji. Email: johnmathai@tamu.edu
Grading and Requirements:
Grading is project-based.
Submission Policy: An electronic copy of each project submission should be turned in in eCampus. Late project submissions will not be accepted.
Resources for computing using GPU:
1. HPRC: You can apply for an account at TAMU HPRC (High Performance Research Computing), https://hprc.tamu.edu.
2. Google CoLab: there's an open source Jupyter notebook environment by Google that runs in the cloud and allows us to use GPU resources. It requires no setup. It's a good resource for anyone who wants to do swift experiments in deep learning. Here is its link: https://colab.research.google.com/notebooks/welcome.ipynb#recent=true
Training a deep neural network often requires GPU. (Otherwise, computing can be very slow.) Try to get access to a computer with GPU, or use the above online resources. There are also cloud computing services (such as from Amazon) that provide GPU computing for a cost (which is OK for small experiments, but can be costly for large experiments).
Syllabus:
(Tuesday 1/14/2020) Deep Reinforcement Learning. Lecture slides: http://faculty.cse.tamu.edu/ajiang/636_11.pdf
(Thursday 1/16/2020) Deep Reinforcement Learning. Lecture slides: http://faculty.cse.tamu.edu/ajiang/636_12.pdf
(Tuesday 1/21/2020) Deep Reinforcement Learning. Lecture slides: http://faculty.cse.tamu.edu/ajiang/636_13.pdf
(Thursday 1/23/2020) Deep Reinforcement Learning. Lecture slides: http://faculty.cse.tamu.edu/ajiang/636_14.pdf
(Tuesday 1/28/2020) Deep Reinforcement Learning. Lecture slides: http://faculty.cse.tamu.edu/ajiang/636_15.pdf
(Thursday 1/30/2020) Attention and Transformer. Lecture slides: https://www.youtube.com/watch?v=ugWDIIOHtPA
(Tuesday 2/4/2020) Self-study.
(Thursday 2/6/2020) Self-study.
(Tuesday 2/11/2020) Attention and Transformer. Lecture slides: https://www.youtube.com/watch?v=ugWDIIOHtPA
(Thursday 2/13/2020) Batch Normalization and Tuning Hyperparameters. Lecture slides:https://www.youtube.com/watch?v=BZh1ltr5Rkg&t=214s (for batch normalization) and https://www.youtube.com/watch?v=kyX29rUntjM&t=1024s (for tuning hyperparameters)
(Tuesday 2/18/2020) Transfer Learning. Lecture slides: http://faculty.cse.tamu.edu/ajiang/636_18.pdf
(Thursday 2/20/2020) Model Compression. Lecture slides: https://www.youtube.com/watch?v=dPp8rCAnU_A&list=PLJV_el3uVTsOK_ZK5L0Iv_EQoL1JefRL4&index=52 (part 1), https://www.youtube.com/watch?v=7B8Cx7woQk4&list=PLJV_el3uVTsOK_ZK5L0Iv_EQoL1JefRL4&index=53 (part 2).
(Tuesday 2/25/2020) Model Compression. Lecture slides: https://www.youtube.com/watch?v=mzZzn8fBvEs&list=PLJV_el3uVTsOK_ZK5L0Iv_EQoL1JefRL4&index=54 (part 3), https://www.youtube.com/watch?v=fMsNf0ufYnY&list=PLJV_el3uVTsOK_ZK5L0Iv_EQoL1JefRL4&index=55 (part 4), https://www.youtube.com/watch?v=L0TOXlNpCJ8&list=PLJV_el3uVTsOK_ZK5L0Iv_EQoL1JefRL4&index=56 (part 5), https://www.youtube.com/watch?v=f0rOMyZSZi4&list=PLJV_el3uVTsOK_ZK5L0Iv_EQoL1JefRL4&index=57 (part 6).
(Thursday 2/27/2020) Deep Learning for Language Modeling. Lecture slides: https://www.youtube.com/watch?v=Jvigef51rqk&list=PLJV_el3uVTsPMxPbjeX7PicgWbY7F8wW9&index=4. Spatial Transformer Layer. Lecture slides: https://www.youtube.com/watch?v=SoCywZ1hZak&list=PLJV_el3uVTsPMxPbjeX7PicgWbY7F8wW9&index=5
(Tuesday 3/3/2020) Generative Adversarial Network. Lecture slides: https://www.youtube.com/watch?v=0CKeqXl5IY0&list=PLJV_el3uVTsPMxPbjeX7PicgWbY7F8wW9&index=14
(Thursday 3/5/2020) Generative Adversarial Network. Lecture slides: https://www.youtube.com/watch?v=0CKeqXl5IY0&list=PLJV_el3uVTsPMxPbjeX7PicgWbY7F8wW9&index=14.
(Tuesday 3/10/2020) No class due to spring break.
(Thursday 3/12/2020) No class due to spring break.
(Tuesday 3/17/2020) No class due to school shutdown.
(Thursday 3/19/2020) No class due to school shutdown.
(Tuesday 3/24/2020) VAE and GAN. Lecture slides at http://faculty.cse.tamu.edu/ajiang/636_17.pdf. [Lecture video: https://youtu.be/zswlolfCOBQ]
(Thursday 3/26/2020) VAE and GAN. Lecture slides at http://faculty.cse.tamu.edu/ajiang/636_17.pdf. [Lecture video: https://youtu.be/zswlolfCOBQ]
(Tuesday 3/31/2020) Generative Adversarial Network. [Lecture video: https://youtu.be/5QhP1h1Meds]
(Thursday 4/2/2020) Generative Adversarial Network. [Lecture video: https://youtu.be/5QhP1h1Meds]
(Tuesday 4/7/2020) Smart Home for People Project, Part 1. [Lecture video: https://youtu.be/d8Cf6osApkg] [Demo video for 8 actions: https://youtu.be/2vigWc0YMKE]
(Thursday 4/9/2020) Smart Home for People Project, Part 2. [Lecture video: https://youtu.be/jxagcySkP3E ]
(Tuesday 4/14/2020)
(Thursday 4/16/2020)
(Tuesday 4/21/2020)
(Thursday 4/23/2020)
(Tuesday 4/28/2020) No class due to Redefined Day.
Statement: The Americans with Disabilities Act (ADA) is a federal anti-discrimination statute that provides comprehensive civil rights protection for persons with disabilities. Among other things, this legislation requires that all students with disabilities be guaranteed a learning environment that provides for reasonable accommodation of their disabilities. If you believe you have a disability requiring an accommodation, please contact Disability Services, currently located in the Disability Services building at the Student Services at White Creek complex on west campus or call 979-845-1637. For additional information, visit http://disability.tamu.edu.
“An Aggie does not lie, cheat or steal, or to tolerate those who do.” See http://aggiehonor.tamu.edu