Final Prototype

Final Prototype

Main Features

  • Color-coded display of student data for attendance, administrative referrals, and academics to show when a student's data is trending positively, negatively, or remaining neutral

  • Ability to schedule circles that will appear on participating student's data so trends can be compared to the implementation of the circle

  • Ability to send alerts to other support specialists in the school and/or recommend students to the school's Intervention Team if more interventions are deemed necessary for a student

Final Prototype [PDF]

Final prototype.pdf

Final Prototype [Google Slides]

This is a functional version of our final prototype in Google Slides. Some features may not be available due to the conversion of Powerpoint to Google Slides. To expand into a full screen version, click the arrow in the top right corner.

Final prototype

Testing Session Information

Test Setting

  • The second testing session took place in a large science classroom in Wake Forest Middle School, Wake Forest, North Carolina.

  • Each of the three testers had a laptop with to be able to use our prototype. Jackie Healey observed and facilitated tester #1 on her own. Brian Barrett observed and recorded tester #2 and #3. David Russo facilitated tester #2 and #3. Alex Conte observed and took notes on all testers depending on where they were in the testing process.

Participants

The participants consisted on three Wake Forest Middle School Teachers from varying subject areas and grade levels. Each teacher had more than 5 years of teaching experience and had been trained in the use restorative circles as well has had experience in their implementation.

  1. Tester #1 - 22 years teaching experience English Language Arts in 6th-8th grade, currently teaching 7th grade ELA, attended training in restorative circles and has implemented them in her classroom

  2. Tester #2 - 11.5 years teaching experience in English Language Arts and Social studies in 6th-8th grade, currently teaching 7th and 8th grade ELA and social studies, attended training in restorative circles and has implemented them in her classroom

  3. Tester #3 - 17 years teaching experience in Science in 6th-8th grade, currently teaching 7th grade science, attended training in restorative circles and has implemented them in her classroom

Research Questions

  • Can teachers determine positive or negative trends using student data following the implementation of circles?

  • Can teachers evaluate data points and trends in student data to determine if the implementation of a restorative circle was successful?

  • Can teachers identify students who need further interventions provided trends in student data?

Task

*The following is the task information that was provided for the second round of testers. It was updated after the first testing session to alleviate some initial confusion that testers had. It was made clearer when the circle was completed following the conflict, who was involved in the conflict. We also clarified when circle information was initially imputed, and that the testing session would be taking place two weeks after the initial circle.

Restorative Justice Circle Information:

  1. Restorative circles are a tool that teachers, administrators, and restorative justice county officials are being trained to implement into schools to practice relationship building skills to strengthen relationships and connections within communities. Ultimately, WCPSS is implementing circles to reduce, prevent and improve harmful behavior within schools.

  2. Restorative circles work by having participants and a facilitator sit in a circle. Norms are established, and a talking piece is shared, which allows one participant to speak at a time. The facilitator asks meaningful and thought-provoking questions to the participants that allow them to share thoughts and insights either to get to know each other better, or to get to the root of an issue.


You are a 7th grade science teacher at Wake Forest Middle School. Two weeks ago, you had 3 students who were involved in a bullying incident. You completed a circle with the students the next day.


Incident Background:

Tanya Sandler and Brittany Ballard were making fun of Carla Henderson's new haircut during group work. You completed a circle the next day to resolve any conflicts between the students. You checked in with Carla once since the circle and she says that she is "fine," but you want to be sure that this incident isn’t continuing to affect the girls.


Task:

  1. It is two weeks after the bullying incident, use the Circle Keeper program to determine the success of your circle.

  2. Determine which students the circle was successful or unsuccessful

  3. Share your thoughts and feelings out loud as you progress through CircleKeeper


Data Collection and Analysis

Data collection was taken both through hand-written notes, and video and audio recordings. Video and audio recording information was only taken from testers #2 and #3, thus verbatim statements will only be used from these two testers.

Main Findings

Main Findings #1


Main Findings #2


Main Findings #3


Final Prototype Revisions & Redesign Ideas

Final Revision 1: Alerts

Testing participants gave positive comments on the new message alert idea added to the prototype. This alert allows teachers to immediately know when a student is trending in the wrong direction. The Bell icon makes a distinct bell sound to alert staff on any new corrective actions. However, participants wanted a way to send alerts to other teachers, administrators and guidance counselors. This function will be added to the Event Details page and will show up in the Bell icon. These final redesign ideas will now allow teachers to intervene for students in more useful ways when a circle has been deemed unsuccessful based on their data.

Final Prototype

Final Redesign Ideas

Final Revision 2: Help

The help feature in our model listed here as a question mark was misinterpreted several times by testing participants. The main issue was the location of the help button and which areas of the current page is it connected. We received feedback and ideas to possibly move the help button to a location near the graphs or use the button as an index to answer navigational questions of the application. As being able to read the trends quickly and easily is important for each data set, the design team decided to move the Help icons next to each graph, where information pertinent to interpreting and interacting with that data can be accessed.

Final Prototype

Final Redesign Ideas

Final Revision 3: Graphs

Testers really liked the color-coding for the trends in the graphs and the ability to interact with them to view more information about referrals and circles, but found the academics graph difficult to read as the lines overlap. As being able to read trends in student data as they relate to implementation of a circle is one of our learning goals, we wanted to improve this experience for our users. To do this, we added the ability to select and unselect specific subjects to appear on the academics graph and made it possible for users to view each graph in full screen.

Final Prototype

Final Redesign Idea