Students will learn how to conduct lean UX usability testing with examples and guides for games, websites and mobile apps. Then they will perform usability testing and record using a coding sheet and write an observation report to include in the full presentation.
Usability Standards across platforms:
Determine your objective and see if the users are meeting that. You will create a hypothosis.
Develop a test area in your project or game - test specific areas: Such as:
Is this scene funny?
Is this scene effective?
Ask the usability tester think out loud through their process, listen and record how they feel:
Measure Emotions: Fun, Fear, Informed or any other adjective that you find fits the mode of your game or project
Look for ease of Memorization of process to make game play simple
See how seamlessly users access Help and Documentation and if it functions
Look for Intuitive Design Blocks to usability
Technical
Record Error frequency and severity
Check Compatibility across all platforms that could be used
Check Performance: Speed, Download time, etc
Measure Engagement time
Note the way the user is accessing the content, the room, lighting, location, how many others are playing, observing.
Ask for Heuristic Evaluation, Expert analysis
Diversity, Equity and Inclusion
Record who your user testers are and ensure that your testing is inclusive
Test Accessibility: See Accessible and Universal Design Overview
Game Usability:
UX Test Report Example From the EPIC Simuli Project
Mobile Site Usability:
TryGoogle Mobile Friendly Tester. Test how easily a visitor can use your page on a mobile device. Just enter a page URL to see how your page scores.
Please prepare a coding sheet or way of documenting your observations. You should determine what you are looking for ahead of time, while also being open to what your users tell you that you were not expecting.
See the Example Considerations for NIH Multidisciplinary team meetings
See the MeasuringUX.com Coding Sheet Example: This observes Verbal and NonVerbal behaviors for one participant on one task.
Read Lean UX: An explanation of observing and coding the data
Review the coding forms on slides 60-61 by Katherine Genoa-Obradovich on Tracheostomy and Laryngectomy Care Virtual Reality Curriculum (TLC-VRC)
Full Presentations can be found on the Project List Page
Game Usability, Advice from the Experts for Advancing the Player Experience
by Katherine Isbister and Noah Schaffer
Game Usability: Advice from the Experts for Advancing UX Strategy and Practice in Videogames 2nd Edition
by Katherine Isbister (Editor), Celia Hodent (Editor)
10 usability Heruistics Applied to Video Games
Alita Joyce, Nielsen Norman Group
Transforming Tools Together: Autism and Mental Health Screeners: Focus Group Interview Guide (autistic adolescents)
[before recording begins]
Hello everyone. Welcome to the study, Mental Health Screeners for Autistic Youth. Our goal is to transform existing mental health screeners to make them better for autistic youth and make sure they get the care they need. My name is [name] and I’ll be your discussion guide.
Before we get started, I want to go over some instructions. I will be reading these instructions because they’re important and I don’t want to forget anything.
We will be recording this. Your real name will never be associated with anything. Instead, we will refer to you by your fake name. If you haven’t yet, please write your fake name on your name tag.
If you ever feel uncomfortable, remember you do not have to answer every question. You can skip any question. You can just nod your head no. We also provided each of you with a way to signal to us no.
You can also take a break whenever you need to. We have many friendly faces here in this room who can join you on a break, if you want, so that you’re not alone.
We would be grateful if you shared your ideas and experiences. This will help us help other autistic youth by designing better screeners. If I notice you have not shared much, I will check on you and ask you if you want to share. Again, you can say no. I’m only checking on you because I know sometimes it can be hard to find the right time to join a discussion. I want to help you by making sure you get a chance to share anything you want to share.
Lastly, it is important that we respect people’s privacy. If you share something about someone who is not in this room, try your best not to say their name. Outside of this room, we also ask you not to share what you hear others say. So that everyone feels comfortable sharing, we have to promise to each other that we will not share other people’s stories outside of here.
Any questions?
Ok, we’re going to get started here. You can still leave, if you want. Can you please raise your hand or nod your head to let me know you want to continue?
[start recoding]
We will now start the recording.
1) Hello everyone! To get started, let's go around and introduce ourselves. Can everyone say their name and their favorite movie, television show, or videogame?
2). We’re interested in learning more about any experiences you have getting screened for anxiety or depression. Could anyone tell me about an experience?
a. When you took the screening, where were you? Who else was with you?
b. Was there anything that made it hard for you to either understand or focus on the
screening questions [probe: were there any words that didn’t make sense to you?
was there anything distracting you? Was the person making too much eye
contact?]?
c. Was there anything that helped you to either understand or focus on the
screening questions [probe: Did the person who asked you to do the screening
explain what it was for (what did they say)?
...... etc etc.
Review the Iterative Changes
We also made different versions of this for each audience - Pros, Caregivers using different ways of asking at their level.