DECIDE Framework

D - Determine the goals

Introduction

  • Usability Testing for the improvement of MU Cyber Club Reservation System Application

GOAL

  • To examine the usability of the current application in the perspective of students who used and never used the system.
  • To evaluate effectiveness of content presentation in the application
  • Focus on: First glance, Content presentation, Implementation

E - Explore the questions

Question

  • We have to ask the basic information of the prospective users about using the reservation system including
    • Have the users ever used the Reservation system before ?
    • What type of room that the users reserved ?
    • Which channel did the users choose to reserve ?
    • Do the users know that MU Cyber Club has Online Reservation system ?


  • Then, we will ask the questions that related to using of our application
    • Can the prospective users reserve required room ?
    • Can the prospective users Cancel the room that have reserved ?
    • Can the prospective users reserve room from the History Reservation Page ?

C - Choose the evaluation approach and methods

In the part of the evaluation approach, we had interview prospective users in Mahidol University including Mahidol Learning Center around True Coffee and location which convenient to participant e.g., In area around the faculty of participants. Furthermore, we also recorded videos and voices of participants while we were interviewing our participants for apply in usability testing.

Before, we recorded videos we had give the video consent form to our participants for assure that participant will allow us to record the videos of them.

After they approved the video consent form, we will explain briefly about our project proposal and the application we created. Then, we will describe what features we consists in the prototype and how to use it.

Then, we will give our prototype of application to participants for trying to use it and we ask them try to using MU Cyber Club Reservation System Application prototype from the List of Task and Scenarios.


I - Identify the practical issues

Participants

  • Undergraduate students in Mahidol University.
  • One or Two participants from each faculty who have been using or not using the reservation system before.
  • Recruit from university students via Mobile phone list.
  • Provide a Android smartphone with the application prototype installed.
  • Make an appointment with the participant.

Usability Testing Team

  • One Observer - observe users’ behaviors and identify issues.
  • One facilitator - To guide and support participants, explain the procedure of usability testing.
  • One time controller - Control the time, and declared time limit for task failure.
  • One video recorder - Record the process of usability testing in format of video and picture for using to keep the information of usability test process.

D - Decide to the ethical issues

Before we recorded video, We have to give the video consent form to the participants to assure that they will allow us for recording the videos. In addition, we will tell to participants for their permission and our ethical responsibility including

  • Explained the purpose and process of the test.
  • Ask the participant to sign the consent form if she or he accepted.
  • Ensure the privacy of participant’s personal information.
  • Ask for the participant’s permission for video record.
  • Allow the participant to leave anytime.

Video Consent Form

Sign to consent form before testing

E - Evaluation, Analyze, Interpret and Present the data

For the Evaluation part, we created the evaluation form to measure the performance, satisfaction rate from users, and level of the complexity of of system by using usability specification table an record the statistic for each participants.

Usability Specification table

Participant 1

Time to use ( sec ) Satisfaction rate Complexity level

Task 1: 54 9 1

Task 2: 5 8 2

Task 3: 18 9 3

Feedback and Suggestion

"Too small font for room details in Home Page, easy to understand and use, but confused about cancel button in Cancel Room Reservation, confused about where to press the button to do Room Reservation from History."

Participant 2

Time to use ( sec ) Satisfaction rate Complexity level

Task 1: 18 9 1

Task 2: 28 9 1

Task 3: 47 9 1

Feedback and Suggestion :

"Too classic User Interface, too common page transition, and need faster responsible."

Participant 3

Time to use ( sec ) Satisfaction rate Complexity level

Task 1: 40 9 1

Task 2: 9 9 2

Task 3: 37 9 3

Feedback and Suggestion :

"Save time to reserve room from MLC Building, need some advance functions."

Participant 4

Time to use ( sec ) Satisfaction rate Complexity level

Task 1: 58 8 1

Task 2: 13 10 1

Task 3: 46 9 1

Feedback and Suggestion :

"Too small for time slot selection in Room Reservation Page, good tone of color interface."

Participant 5

Time to use ( sec ) Satisfaction rate Complexity level

Task 1: 94 10 1

Task 2: 28 8 3

Task 3: 27 9 1

Feedback and Suggestion :

"Should support Thai-English languages, confused cancel process in Cancel Room Reservation."

Participant 6

Time to use ( sec ) Satisfaction rate Complexity level

Task 1: 45 9 1

Task 2: 11 9 1

Task 3: 27 9 1

Feedback and Suggestion :

"Save time, know time slot of each rooms, need more color in background."