Module 2: How ChatGPT Works

Learning Outcome 1: Quiz on AI language model response generation mechanisms and limitations. (10%)

Rationale: This quiz assesses learners' understanding of the architecture, functioning, and limitations of AI language models like ChatGPT. It tests their theoretical knowledge and comprehension of the technical aspects of AI language model response generation.

Learning Outcome 2: Group discussion and reflection on the evaluation of AI language model outputs, including a written reflection on potential biases and limitations observed. (5%)

Rationale: This assessment encourages learners to critically analyze and evaluate AI language model outputs, considering factors such as accuracy, biases, and limitations. The group discussion promotes collaborative learning and the written reflection allows learners to articulate their individual observations and insights.

Module 4: Ethical Considerations in AI Language Models

Learning Outcome 1: Written analysis of an ethical dilemma case study related to AI language models. (10%)

Rationale: This written analysis assesses learners' ability to apply ethical considerations to real-world scenarios involving AI language models. It evaluates their understanding of the ethical dilemmas and challenges associated with AI language model usage and their capacity to propose thoughtful solutions.

Learning Outcome 2: Group discussion and reflection on responsible and ethical usage of AI language models, including a written reflection on the guidelines and strategies proposed. (5%)

Rationale: This assessment encourages learners to engage in critical discussions about responsible and ethical usage of AI language models. The group discussion provides a platform for exchanging ideas and perspectives, while the written reflection allows learners to consolidate their understanding and propose guidelines and strategies for responsible usage.

Module 5: Evaluating AI Language Model Outputs

Learning Outcome 1: Written analysis and evaluation of AI language model responses, including identification of potential biases. (10%)

Rationale: This assessment evaluates learners' ability to critically analyze and evaluate AI language model responses. It assesses their skills in identifying potential biases and their capacity to provide well-supported analysis and evaluation of AI language model outputs.

Module 7: Responsible Usage and Future Directions

Learning Outcome 1: Group presentation on responsible usage and guidelines for interacting with AI language models. (20%)

Rationale: This group presentation assesses learners' ability to synthesize their knowledge and understanding of responsible usage and guidelines for interacting with AI language models. It promotes collaboration, effective communication, and the application of ethical principles in practical contexts.

Learning Outcome 2: Individual reflection on future directions and potential applications of AI language models. (5%)

Rationale: This individual reflection allows learners to critically reflect on the future directions and potential applications of AI language models. It encourages them to consider the broader societal impacts and possibilities for improvement in various domains.

By incorporating these assessments, the course ensures that learners' progress is effectively evaluated across the learning outcomes. It provides a comprehensive assessment of their knowledge, critical thinking skills, ethical considerations, and application of AI language models, enabling them to demonstrate their proficiency in the subject matter.

Summative Assessment Plan (25%)

The summative assessment is an open-book final quiz (Google form) with ~25 questions to cover each sub-topic, including one bonus question to be graded using the UVIC grading scheme below. A final grade in the course of at least 50% is mandatory to pass the course and receive full credit. Final grades are dependent on cumulative calculation of formative and summative assessments combined.