Evaluation Report

Audience: Learners taking this course

Our participants: Simulated Chat GPT prompts

Purpose: Provide a base comparison for evaluating results of the post-course survey. This will allow us to effectively determine the learning outcomes against our learning goals and objectives. 

Position: Taken at the beginning of the course.

• Students show the lowest proficiency in regulating emotions.

• Students show a wide range of the skills active listening, empathy, and self advocacy.

• Most students self-reported a poor proficiency in conflict resolution in general (these student would have a previous history of school-reported incidents. 

Audience: Learners taking this course

Our participants: Simulated Chat GPT prompts

Purpose: Determine the learning outcomes against our learning goals and objectives. 

Position: Taken upon completion of the course.

We did not conduct this post-course survey, but if we did we would have been able to measure:

• Improvements of students self-reported confidence of the skills: active listening, empathy, and self advocacy.

• Learning Transfer: student ability to apply newly-learned techniques to real relationships. 

• Learning outcomes that are not correctly correlating to learning objectives, and therefore highlighting specific areas that are not be addressed properly.

Audience: Student counselors and mentors

Purpose: Evaluate the strengths and weaknesses of the specified lesson material

Position: To be conducted in the early design stages

Method: Think aloud protocol (TAP) with an accompanying interview. 

Analyses: Affinity map for both TAP and interview.

• Students detailed an increase of learned empathy, which corroborates the skill deficiency identified in our needs analysis. 

• Students requested more hands-on actives to pair with instructional material.

• Students found role-playing actives very helpful, and could apply these practiced skills to their relationships. 

Audience: Student counselors and mentors

Our participant: High school program mentor (non-profit)

Purpose: Evaluate the strengths and weaknesses of the specified lesson material

Position: To be conducted in the early design stages

Method: Think aloud protocol (TAP) 

Evaluator Notes

• Some instructional videos may not be appropriate for the whole intended student age range. 

• Some scenes may need more context before being shown if they are not familiar with the show.

• May be helpful to play the videos more than once.

• Students should know the questions before watching the video.