We are envisioning an application that is easy and simple to use for both educators and students. The application should be easily accessible on any mobile device, including phones, tablets, or even laptops, to increase accessibility. The application should not require any student log-ins or accounts; rather, the teacher should be able to use one account to distribute the access code. Its primary feature is to repeat teachers' instructions in a step-by-step and interactive way with the student, personalizing and supporting learning.
Educators can copy and paste or type simple instructions they would typically write on the whiteboard to the Claritoon Teacher account.
The Claritoon will generate a QR code that students can use to automatically open up the application and guide the students in following step-by-step instructions.
When students scan the QR code on their mobile device, a cartoon animation will pop up asking if they are ready to learn.
If they click yes, the application will generate a text-to-speech audio and an animated video, breaking down the steps following the numbers provided by the educator.
The application will also be programmed to match a handful of frequently used keywords to generate images and animation to provide visualized explanations. For example, if the application detects words that describe school supplies such as "glue sticks," "scissors," and "pencils," it would generate images to pop up while reading the words for students to match the materials easily. In addition, the cartoon character will be programmed to follow the key action words, such as "write/writing," "draw/drawing," or "cut/cutting," to make the instructions more straightforward.
Students will have to click the "next(->) arrow" button once they complete the instruction for that step, making the learning engaging and personalizing the learning pace for each child. Before going to the next step, the character will ask and prompt students to make sure they really completed the current step before moving on to the next one.
Students can also go back by clicking the "back(<-) arrow" button to repeat the instructions as many times as they require.
The application is designed with young students in mind who are usually less independent compared to older ones and students with disabilities such as autism spectrum disorder and ADHD. Students in this target group may have a shorter memory span and/or attention deficit. Teachers would often need to repeat the instructions and find ways to keep students motivated and engaged.
The application will generate videos featuring cartoon characters doing the key actions as models. The use of videos is more effective than simply just showing pictures because it demonstrates the change of state and speed of the actions which could help students with learning difficulties to repeat the behavior and use it in other similar situations. Dynamic animation can also motivate students to concentrate on tasks.
Depending on the instructions, the video could present shots showing the character’s full body or from a first-person point of view which shows the character’s hands performing the action. The latter shot type is particularly useful when giving instructions related to in-classroom tasks because it allows children to observe and mimic the actions more easily and minimize distractions (Yakubova et al., 2015, as cited in Kahveci & Altun, 2019).
Teachers could benefit from using Claritoon as an assistive tool for instruction (Sandall et al., 2005, as cited in Shepley et al., 2016). It allows them to keep students engaged while they focus on helping individuals who need more support. They can also use it to gain some time to perform formative assessments while students are doing their tasks.
As part of the usability test of our prototype, we asked our colleagues a series of questions after explaining the concepts for the application. Two colleagues who work at an elementary school participated and answered the following questions:
What do you like about the application?
What would be challenging? What things do you think are required for this application to succeed?
Would you use the application in your classroom?
I like the idea of using the QR code as I often struggle with my students asking to put in any login code when using different websites.
It would be nice if the teacher could lock the application, and students would have to stay on it without any other choices. If, for example, they were redirected to another website, such as YouTube, as shown on the prototype, it could easily distract them.
Yes, I often need help with students who require support initiating and starting the task. I can see it being helpful in my classroom.
I like the vibrant visual and the input of the audio feature. I believe that the audio would be helpful for even older students.
I question the accessibility. Will all schools be able to access the mobile devices to use the application? Thinking about our school, we only have limited access to mobile devices, such as one class set of iPads.
Yes, I would use it. Because I am teaching French, the application would benefit all grades.
When we create Claritoon, we hope the video will be directly generated from the application rather than using a third-party platform, such as YouTube. Due to limited technological ability, we inserted a link to a YouTube video when we showed the prototype to teachers. Listening to the feedback, we edited the presentation to the best of our ability by directly embedding the video rather than opening up a new webpage to YouTube to reduce distractions.
Ideally, once we have a working prototype, we would also show it to different focus groups which include students from kindergarten to grade 2 and students with various levels of disabilities to gather observation notes and to listen to their perspectives and ideas.
Here is a demo of Claritoon. After inserting the instructions into the video generator, the application will generate the animation and any script if needed. After scanning the QR code provided by the educator, here is what students will see: