Usability Test

D - Determine the goals

1. To assure that user can understand the interface of our prototype clearly and they can use it with the convenient by usability test and observe the statistics in both time for the process and the number of mistake during the interaction with prototype.

2. To clarify the question that is our design can solve the problems effectively for users.

3. To gather the feedback and understanding about how we can improve the design appropriately with users and suit to their needs.

E - Explore the questions

1. We look out for the participant and introduce our purpose of the testing to participants. If they allow us to do the testing, we will perform the following steps.

2. Asked the participants to read the description and sign the consent document before the testing.

3. Asked about their personal informations, which require for the test include with name, surname, age, job, and which types that they prefer to pay for BTS ticket (single round, rabbit, 1 day trip)

4. Asked the participants about their experiences from using BTS Skytrain services

- How long the participants take BTS Skytrain services?

- How frequent that participants take BTS Skytrain services?

- Any problem that participants faced from taking the services?

5.Asked about the usability question and observe the result

- How much time that participants spend to complete each task?

- Can the users buy the ticket successfully?

- Can the users add the cards within application

- Does application provide convenient and faster buying ticket process?

- Does the application provide appropriate screen for user friendly?

C - Choose the evaluation approach and methods

For the evaluation and method, we begin with asking the question from the explore the question section and then we described about our BTS Skytrain application and ticket machine to the participants as some feature may not work effectively since it was just prototypes for usability test. In addition we told the participants that we simulated the ticket machine by using prototypes in tablet as iPad.

Then we let participants to try using our prototype and asked them to perform the tasks as in the List of tasks and scenario and we also record the performance of using prototypes by participants in order to do the evaluation.

Observe the route of BTS Skytrain services.
Sign in or sign up with the system before using the features.
Select the types of ticket and buy it in the ticket page.
Check the add the their rabbit card, credit/debit cards, and One day pass or use the cards in the card page.
Explore for the message page and select QR code to use or send to other phone number if it hadn't been scanned yet.
If participants want to try using ticket machine prototype, they will be start by select the feature.
Try to top up the money or the round of trips into the rabbit card as they add into the application.

After the participants have done with the using prototype, we asked for the feedback and opinion from the participants about how they think about the prototype which part of prototype require the improvement.

Then the usability testing was done, we said thank you to every participants for helping us to do this testing and apologize them to take their valuable time.

I - Identify the practical issues

Participant

For the participants, we went to Siam station to find and ask BTS Skytrain customers to give us the interview and do usability testing, which most of participants are college students. In addition, we do the usability online through the program as Teamviewer, which we can observe the participants perform in each task clearly and easy to capture the information.

Facilitator

One of our members will be a facilitator staff who will explain the motivation of our project and all of the processes of testing to the tester user, include telling them to step by step how to perform the testing and evaluation process.

Observer

We require 2 members to be the observer who observe and record the statistics to use in the evaluation steps.

Time planner

We need one staff from our members to be a person who records the times of each task and tell the schedule of each task.

D - Decide to the ethical issues

Before the beginning of usability test, we provide the project description and asked the participants about the permission in recording a video and picture during the testing before let them sign the consent form if they agree to do the testing. During the testing, users can leave the testing anytime as they make decision to do so.

E - Evaluation, Analyze, Interpret and Present the data

This is the criteria according to the table below to measure the usability.

Participant 1: Miss Patteera Leelakunarak

Feedback:

There are too many features in the prototypes.
It hard to use in case that there is no facilitator.
Route map is provide the information enough to get satisfaction.
Prototype provides convenient buying ticker process.

Suggestion:

It would be better if the prototype can be used with the lower complexity.

Participant 2: Miss Thananya Santad

Feedback:

It’s comfortable to buy the ticket.
Can improve the buying ticket process and can get the ticket faster than waiting for a queue.
Image of BTS Skytrain route is too small and can’t zoom in the picture.
Top up feature is a bit complicated.

Suggestion:

Improve the route page to show the information with better resolution for user friendly.
If the top up feature is easier than now, it will be better and provide more convenient.

Participant 3 : Mr. Kawinphak Charoensappayanan

Feedback:

Overall of prototype is good, the travellers can buy the ticket online without waiting for a queue at the station.

Suggestion:

1. If possible, try to improve the prototype to let the users share the QR code by using your application, which will be sent to other message page as another choice from using only the social media

Participant 4: Miss. Kusalin Laksanakorn

Feedback:

The information in route page is hard to read if user doesn’t gaze at it.
Share the QR code from buying multiple tickets is interesting as she could buy it for her friends in the hurry situation.
Prototype is a bit complicated, so she has to take time for a while to understand it.
Buying ticket before arrive at the station support her to take the service faster.

Suggestion

Improve the route page in order to let the users read and understand the information easier.

Participant 5: Mrs. Pawpranan Wisitweeradilok

Feedback:

There are some features that have several steps and confuse to follow.
Can’t understand the route clearly because the information in text is too small.
Interested in buying ticket in the application instead of waiting for a queue at station.
The prototype is acceptable as it has the clearly identifier in each page and features.

Suggestion:

If there are any possibility to reduce the steps in some features, it would be better if the users can perform task easier.
Provide the bigger text for the route map or make it able to zoom in and zoom out.

Participant 6: Miss Pimphan Pookboonmee

Feedback:

The information in route page is able to understand clearly.
Buying ticket by using the application is sound interesting.
Top up money into the rabbit card with ticket machine is complicated and confused.

Suggestion:

The route page may be hard to read by other users, it will be easy to read if it able to expand or zoom in.
For the top up money into rabbit card, it might be great if it also support to insert the card into the ticket machine as another method along with the existed one in prototype.

These 8 bar charts show the satisfaction score of each participants that we record in the result of usability test.

This bar chart show the usability specification target, which indicate how many users can play the prototype and meet the measurement of usability specification.

Green color indicates the number of participant who performs the task better than our target measurement.

Red color indicates the number participant who performs the task below than our target measurement.

Google Sites

Report abuse