Generative AI Class
Time: Winter 2024
Time: Winter 2024
Instructor: Yi Zhang
Syllabus (DRAFT, Subject to Change)
Week 1: Introduction to Generative AI and Major Modeling Approaches (GAN, VAE/Diffusion, Autoregressive Models)
Week 1: Introduction to Generative AI and Major Modeling Approaches (GAN, VAE/Diffusion, Autoregressive Models)
Week 2: Sequence Generation with Recurrent Neural Networks (RNNs), Attention and Transformers
Week 2: Sequence Generation with Recurrent Neural Networks (RNNs), Attention and Transformers
Week 3: Controlled Generation; Reinforcement Learning for Generative AI
Week 3: Controlled Generation; Reinforcement Learning for Generative AI
Week 4: LLM pre-training, Prompt Based Fine Tuning, Parameter Fine Tuning & Scaling
Week 4: LLM pre-training, Prompt Based Fine Tuning, Parameter Fine Tuning & Scaling
Week 5: Retrieval Augmented LLMs (Open Book GAI)
Week 5: Retrieval Augmented LLMs (Open Book GAI)
Wee 6: Reasoning, Multimodality
Wee 6: Reasoning, Multimodality
Week 7: Using Tools and Automation, Planning
Week 7: Using Tools and Automation, Planning
Week 8: Generative AI Applications
Week 8: Generative AI Applications
Week 9: Explainable Generative AI
Week 9: Explainable Generative AI
Week 10: Tiny/Small/Edge Models, Knowledge Distillation
Week 10: Tiny/Small/Edge Models, Knowledge Distillation
Week 11: Project Report
Week 11: Project Report