Evaluation

Overview

To get potential user feedback on our designs, we did three iterations of user studies.

• After paper prototype

• After wireframe prototype

• After working prototype

Evaluation of iteration 1 —— Paper Prototype

Method:

We sent our paper prototype to users and observe their facial expressions through Zoom. After that, we asked them questions below.

Questions:

• Whether the app is easy to understand

• What do you like or dislike for the app

• What do you expect for the app

Feedback:

• The interfaces are straightforward and pretty easy to understand

• In the home page, the “scan” button should be more obvious since it is one of the most frequently used functions

• The user expect that the user interface could be more colorful

Implications:

• Improve UI

Evaluation of iteration 2 —— WireFrame Prototype

Method:

We sent our video of wireframe prototype to users and observe their facial expressions through Zoom. After that, we asked them questions below.

Questions:

• What do you think of the UI

• (After task flow) What's your perspectives for the app

• What do you think of the interactions

Feedback:

• Most users are satisfied with the UI design

• The basic functions of the app meet both participants and organizers' needs

• The interaction is pretty fluent

• More details are needed

Implications:

• Supplement all essential pages to complete the full functions of the app

• Continue to working on UI

• Add user friendly buttons such as log out

Evaluation of iteration 3 —— App

Method:

We sent our video and demo to users and observe their facial expressions through Zoom. After that, they were asked to fill a questionnaire.

Questions:

For participants:

• Overall, did you find this app useful?

  • Not at all 1 2 3 4 5 Significantly

• Did you attend events more using this app?

  • Not at all 1 2 3 4 5 Significantly

• Did you know more events using this app?

  • Not at all 1 2 3 4 5 Significantly

• Did this app remind you of attending the events?

  • Not at all 1 2 3 4 5 Significantly

• Did this app motivate your interest to attend events?

  • Not at all 1 2 3 4 5 Significantly

• What other functions are you seeking for?

• Any other comments for this app?

link: https://forms.gle/o6TAPhdMYZwPY2eY8

For organizers:

• Overall, did you find this app useful?

  • Not at all 1 2 3 4 5 Significantly

• Did this app save your money for advertisement?

  • Not at all 1 2 3 4 5 Significantly

• Did this app save your time for advertisement?

  • Not at all 1 2 3 4 5 Significantly

• Did this app increase your events’ attendance?

  • Not at all 1 2 3 4 5 Significantly

• Did this app help with emergencies?

  • Not at all 1 2 3 4 5 Significantly

• What other functions are you seeking for?

• Any other comments for this app?

link: https://forms.gle/H2UYfRszvfvJKBt29

Results and Implications:

We found that most of participants and organizers chose 4 for question one and nobody graded smaller than 3. Therefore, we can conclude that our app meets the fundamental requirement - useful

Overall, our app reached our goals:

• help people keep track of all of the events near them

• help event organizers like the president or e-board members of an organization better advertise their events to specific audiences

And we will supplement more functions such as recommendation system in the future.