2023 Summer

2023 Summer Schedule

• June 22: Introduction & Transformers [slides, recording]

  • Readings

    • R. Shinha, H. Poosarla, H. Fu, A. Suen, A. Suen, A. Gandhi, V. Lo, L. Avigad, H. Senthikumar. "Statistical Analysis of Bias in ChatGPT Using Prompt Engineering," International Journal for Research in Applied Science & Engineering Technology, Vol 11(VI), June 2023 (link)

• June 25: Predictive Machine Learning [slides, recording]

  • Readings

    • A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser.  "Attention Is All You Need," arXiv:1706.03762, 2017 (link)

• June 29: Chatbots & Hallucinations [slides, recording]

  • Chatbots

  • Prompts

  • Hallucinations & Alignment

  • Papers: see this tab.

• July 2: Chatbots & Prompting [slides, recording]

  • Papers: see this tab.

• July 6: Grounding & Research [slides, recording]

  • We will review a few ideas for summer research

• July 9: Embeddings & LlamaIndex [slides, recording]

  • Readings

    • Brown, et al. "Language Models are Few-Shot Learners," https://arxiv.org/abs/2005.14165, 2020 (link)

• July 13: PII, Anonymization, Semantic Kernel [slides, recording]

  • Readings: 

    • C. Patsakis, N. Lykousas. "Man vs the machine: The Struggle for Effective Text Anonymisation in the Age of Large Language Models," arXiv:2303.12429 [cs.CR] (link)

• July 16: Plugins [slides, recording]

  • Readings: 

    • OpenAI, ChatGPT Plugins, OpenAI Blog, March 23, 2023 (link)

• July 20: ConstitutionalAI [slides, recording]

  • Readings:

    • Y. Bai, et al, "Contitutional AI: Harmlessness from AI Feedback," arXiv:2212.08073 [cs.CL], Dec 15, 2022 (link)

    • Anthropic, "Claude's Constitution", Anthropic Blog, May 9, 2023 (link)

• July 23: Agents & Reasoning [slides, recording]

  • Readings:

    • J. Wei, et al, "Chain-of-Thought Prompting Elicits Reasoning in Large Language Models," arXiv:2201.11903 [cs.CL], Jan, 2022 (link)

    • S. Yao, et al, "ReAct: Synergizing Reasoning and Acting in Language Models," Nov, 2022 (link)

• July 27: Planning & Self-Critique [slides, recording]

  • Readings:

    • N. Goodman, "Meta-Prompt: A Simple Self-Improving Language Agent," Substack, April 8, 2023 (link)

    • H. Touvron, et al, "Llama 2: Open Foundation and Fine-Tuned Chat Models," Meta, July 18, 2023 (link)

    • A. Ghosh, A. Suen, P. Mui, "Application of Computational Analysis to Identify Housing Discrimination in 21st Century United States," International Journal for Research in Applied Science & Engineering Technology (IJRASET), Vol 11, Issue VII, July 2023 (link)

• July 30 - Aug 11 : group meetings

• Aug 13: ASDRP Expo Planning

  • Readings:

    • D. Hafner, "Benchmarking the Spectrum of Agent Capabilities," arXiv:2109.06780 [cs.AI], Sep 14, 2021 (link)

    • Y. Wu, et al, "SPRING: GPT-4 Out-performs RL Algorithms by Studying Papers and Reasoning," arXiv:2305.15486 [cs.AI] May 24, 2023 (link)

    • R. Murthy, et al, "REX: Rapid Exploration and eXploitation for AI Agents," arXiv:2307.08962 [cs.AI], July 18, 2023 (link)

    • W. Yao, et al, "Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization," arXiv:2308.02151 [cs.CL], August 4, 2023 (link)

Milestones

• July 8 (S) : submit 1-pager research proposal

• July 29 (S) : submit initial data analysis 

• July 30-Aug 13: group research

• mid-August : draft research paper

• mid-August : ASDRP symposium presentation

• September : finalize paper for publication