2023 Fall

2023 Fall Schedule

• Sep 10: Hello & ANN [slides, recording]

  • Readings

    • LeCun, Yann; Léon Bottou; Yoshua Bengio; Patrick Haffner (1998). "Gradient-based learning applied to document recognition". Proceedings of the IEEE. 86 (11): 2278–2324. CiteSeerX 10.1.1.32.9552. doi:10.1109/5.726791. S2CID 14542261. Retrieved October 7, 2016. (link)

• Sep 17: ANN & CNN [slides, recording]

  • Readings

    • Krizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey E. (May 24, 2017). "ImageNet classification with deep convolutional neural networks". Communications of the ACM. 60 (6): 84–90. doi:10.1145/3065386. ISSN 0001-0782. S2CID 195908774.

• Sep 24: CNN on Real-World Images [slides, recording]

  • Readings

    • Mollick, Ethan (2023) "Everyone is above average: Is AI a Leveler, King Maker, or Escalator?" One Useful Thing Blog, Sep 24, 2023 (link)

    • Hering, Annina (2023) "Indeed’s AI at Work Report: How GenAI Will Impact Jobs and the Skills Needed to Perform Them," Indeed Report, Sep 21, 2023 (link)

• Oct 1: LLM-powered Chatbot [tutorial video]

  • Readings

    • OpenAI (2022) "Introducing ChatGPT," OpenAI Blog, Nov 30, 2022 (link)

    • Casado, Martin (2023) "The Economic Case for Generative AI," Andreessen Horowitz Blog, Sep 25, 2023 (link)

    • Baum, Jeremy; Villasenor, John (2023) "The politics of AI: ChatGPT and political bias," Brookings Commentary, May 8, 2023 (link)

• Oct 8: Building an LLM Chatbot with Semantic Kernel [tutorial video]

• Oct 15: Building Chatbots with Skills and Plugins [tutorial video]

• Oct 22: Reasoning with Tools and Plugins [tutorial video]

  • Readings

    • Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, Yuan Cao (2023), "REACT: Synergizing Reasoning and Acting in Language Models", ICLR 2023 (link)

• Oct 29: Image Understanding with LLMs [in class video]

  • Readings

    • GPT-4V(ision) System Card, OpenAI Paper, September 25, 2023 (link)

    • Yuntao Bai, et al (2022), "Constitutional AI: Harmlessness from AI Feedback," arXiv:2212.08073 [cs.CL] (link)

• Nov 12: Building GPTs [in class video]

• Nov 19: OpenAI News and Discussions [in class video]

• Nov 26: Thanksgiving Holiday (no meeting)

• Dec 3: AI Model Evaluations [slides, in class video]

  • Readings

    • Stephanie Lin, Jacob Hilton, Owain Evans (2022) "TruthfulQA: Measuring How Models Mimic Human Falsehoods."  Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, May 2022 (link)

• Dec 10: Assistants API and Knowledge Retrieval [slides, in class video]

  • Readings

    • Charles Packer, Vivian Fang, Shishir G. Patil, Kevin Lin, Sarah Wooders, Joseph E. Gonzalez (2023) "MemGPT: Towards LLMs as Operating Systems," arXiv:2310.08560 [cs.AI], Oct 12, 2023 (link)

• Dec 17:  Multi-Agents [slides, in class video]

  • Readings

    • Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Shaokun Zhang, Erkang Zhu, Beibin Li, Li Jiang, Xiaoyun Zhang, Chi Wang (2023) "AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation", MSR-TR-2023-33, August 2023 (link)

Milestones

• Sep-Nov : explore new areas of “Deep Learning” and Language Models

• Dec-Jan : propose new areas of research

• Feb-May : group research focused on publication

Research Projects

• spreadsheet