We evaluated TutorMatch mainly through two rounds of usability testing, using the Wizard of Oz and think-aloud methods. This was done by one of us acting as the system by manually switching screens based on what the user tapped. Our participants were UW students from other design teams who had never seen our app before. They were asked to complete the main tasks of signing in, setting their preferences, browsing tutor matches, and booking a session.
The testing also revealed several problems in our design choices and thought process. These included navigation between screens, distinction between student and tutor logins, feasiblity of a mobile app instead of for laptop, course specificity, online or in person.Â
The biggest insight we gained was that users want a flexible and modernized app with different functions, and control over their own experience rather than having AI make decisions for them. Testing early with simple methods like Wizard of Oz and think-aloud allowed us to catch these issues and refine the design before committing to them.
Features we brainstormed for TutorMatch in the beginning stages