Designers or evaluators rigorously test the complete product using the best solutions identified during the prototyping phase. This is the final stage of the 5 stage-model, but in an iterative process, the results generated during the testing phase are often used to redefine one or more problems and inform the understanding of the users, the conditions of use, how people think, behave, and feel, and to empathise. Even during this phase, alterations and refinements are made in order to rule out problem solutions and derive as deep an understanding of the product and its users as possible.
The testing process did not start as smooth as expected. Starting from the fact that we had to change our target group a couple of times to make it more specific and easier to reach.
Since the Prototype Phase is considered to be the most expensive one, we decided to start testing the 2 app ideas on a verbal basis, introducing the potential clients to the app by making them aware of their needs.
The processes of Prototyping and Testing were by far the ones that took the longest. Each group member interrogated and tested the 2 different apps to a number of relatives, friends or potential customers, while taking written notes on the feedbacks received.
At the end of the first round of Testing, the group met up in an online meeting to discuss the findings and make the most out of the feedback.
Our objective, in this case, was to collect as much feedback to be able to improve our initial app idea and make it the most tailored to our customers as possible. The central point we kept in mind was to find something that would fulfil most of (if not all) of the target group's needs we encountered in the second process step: Define Phase.
Throughout the whole process we tried to keep an open and unbiased mentality, especially when dealing with potential customers' data (friends names, personal opinions, etc...) and info.
In the following steps you can see the different rounds it took us to finally reach a definitive solution and product, all background info and literature can be found in the Appendices page under "Testing Phase".
The first testing phase introduce the App’s ideas through a short story that can be read in the following paragraph:
Workers around the world have had to adapt as best they could to the lockdown. Those who were able to continue working from home have had experiences of all kinds due to the confinement. Continuing to work was an absolute priority, but concern for mental and health status, as well as the need for contact with the outside world and with other people was not long in coming. For that reason, we devised two applications that allow you to stay connected with your well-being. The first application offers reminders like "Drink water" and "Take time to yourself." The second application suggests a list of daily challenges in order to spend less time on the screen and being connected with other people. Among the challenges you can find suggestions like "Water your plants" or "Call a loved one".
After the story, participants were asked open questions such as:
1. If there were to be an app that could help you during corona, What would you want from that app?”
2. What do you think about the two App’s ideas presented?
3. Can you think in any other App Idea that you would find useful?
4. Which App would fit better for you?
5. Is there any particular feature that you would like on this app?
Responses can be read under the following section.
First round of prototype testing
For the testing of the prototype idea I interviewed several people that all work 100% remotely. I asked them the question; “If there were to be an app that could help you have more fun during corona what would you want from that app?” and this were the outcomes.
Transcript audio message from at home student (translated)
“I was thinking about an app that you could use during corona as well as daily life (assuming outside of corona) A sort of app that can help you through your day by for example alarms when waking up. An app that I can personalize to say hey an hour after I wake up, I want to exercise. So that the app can give me a notification reminding me; I wanted to exercise so let’s go. Or for example a reminder for lunch time. An app that can be personalized with news that is interesting for me (for example regarding Formula 1) That kind of stuff so I can indicate my own interests and that I can receive notifications. Or that the app can track my sleep. Basically, an app that can track my sleep pattern and remind me of entertainment or social media. An app that can structure you day that can be seen as a buddy. Oh, and an agenda function would be nice”
I also interviewed my lovely boyfriend and asked him the same question, and this was his response: “I wouldn’t want an app. I don’t really use apps and I wouldn’t want one that keeps reminding me every so often it would take me out of my workflow”
To the question if he would be open to it if it were a chrome extension the answer was also no. Concluding in me asking him if he has any needs regarding social contact or entertainment or whatever he could think of to which the answer was also no.
Lastly, I asked my mother about the app as well and she indicated she would be more interested in the app idea that concerns the social challenges idea and that she would be interested in connecting with people that share the same challenges.
Overall the responses to the idea were positive except for my boyfriend which did open my eyes to the possibility that an app just doesn’t fit the needs of certain people in the target group and that even an alternative like a chrome extension wouldn’t fit them either.
Both ideas were positively received by the rest of the people I asked.
During the Testing Phase I gathered feedback from several relatives and friends for a quick interview on our app. I introduced our idea and both prototypes during the interview. The most interesting feedback I received was from the two interviews you will find down below:
During the first round of testing I approached my mom and her boyfriend immediately. They have been working from home since the start of the pandemic, and rarely go out for work-related meetings. I introduced both app ideas to them during an interview and they seemed very enthusiastic about it. I knew beforehand that they were very active people so it was no surprise to me that they would love both applications. However the Social Challenges App appeared to be the popular choice for them. They mentioned that since they started working remotely, their workload heavily intensified over the couple of months. They loved the idea of having daily random activities to lighten up their day, and to get some distraction from all the stress caused by their work.
During the second round of prototype testing I approached a close friend of mine who moved to Dublin a couple of months back to work for PayPal. He's been working from his apartment since the start of the pandemic, and it has taken quite a toll on him. I started talking to him about our apps and he told me straight away that he liked the Mental & Physical Welness App. I immediately asked him why and he told me that since he started working from home he has been maintaining an unhealthy lifestyle. This was mainly because he has a job that requires him to work long hours. This has led to him eating more junk food and take-out due to a lack of time. He also mentioned that he rarely has the urge to workout because he doesnt think it is as relaxing and fun as it used to be. He liked the idea of the app but also asked me how we we're going to differentiate from other welness apps.
In my first round of verbal feedback I interrogated various of my friends and relatives regarding the App. I firstly introduced them to the idea of the project and gave them a small introduction to the reasons why we are doing this, in the second place I described both apps separately, specifying each app's function and goals. Finally, after the objective explanation, I subtly asked them the following questions: What do you think? Would you use it? What Would you improve? Which one do you prefer?
The outcome and feedbacks related to this app were incredibly optimist! I say incredibly because I personally like the other one better. Most of the interviewees agreed on the fact that it is an innovative idea and it could be used by individuals as well as companies. 8/10 said they would download it and use it straight away. The only improving point that came out was the option to share your results on Socials, which we had not taken into account yet as a group.
The interviewees liked this app as well but most of them preferred the other one because of its originality. Some of them, in fact, expressed their theory of having already seen this app or very similar ones online. The features that people liked the most were: the priority list and time management ones. While, on the other side, the most concerning one could be the notifications/reminders feature which could eventually lead to an over-stressing reaction from the public's side due to the huge amount of spam it is already often received on a daily basis.
To get feedback on the idea for our apps, I interview four people, all remote workers but with different backgrounds. Kevin Anderson (29) is a freelance worker who specializes in Google advertising and programming. Aldana Marchiori (26) is a digital business entrepreneur and senior marketing student in Argentina. Beatriz Darwell- Taylor (25) is an Italian costume designer and freelance worker, and finally Aldana Castro (26) is a student of Architecture. They have all suffered from the consequences of working from home. Below you can read their answers to our questions.
Kevin Anderson (Translated Response)
I don't like either of the two applications because: First, I don't like depending on technological devices to do things related to my health. Second, I don't trust how my data is handled in what I do, for example, if I drink liquids or not. Also, there are a ton of apps that already do that and I don't use them. To organize myself I use Google Calendar and I organize my own tasks. If it were free, maybe I would try the Health Application, but only if it is free and it also has to be complete. The App would have to record when you drink water but also things like the cardiac rhythm of your heart when you walk or when you move. Although I understand and share that algorithms work well for health tracking, I don't like an app, I prefer a real doctor.
The idea of technology is good to get closer to other people but if that is based on common interests, I feel that the richness of meeting other people with whom you do not coincide is lost a bit. It occurs as a filter bubble as it happens on Facebook. At the end, you only see part of the story, you only relate with those with whom you share interests.
Bea Darwell-Taylor (Translated Response)
So if I think of an app that could be useful during lockdown, I would like something to remind me of daily wellbeing tasks (drink water, write something down, watch a new movie, sing a song, etc) as well as suggesting activities to do.
I do like the idea of both apps. I think with the right designs, and useful tips would be really nice. If there was a feature where you can see your friends progress as well it would make it also more social and useful for me. I think many well-being apps tend to give this idea that you are by yourself doing it, just you and the app while if I knew my friend did his tasks today, I would be very motivated to do them as well. Because I’ve downloaded apps like this in the past. But I rarely use them with consistency. Which is a shame.
Aldana Marchiori (Translated Response)
Regarding what I would like from an application, I would like it to tell me things like "Remember to stand up", "Remember to stretch your body a little". The idea that the app provides health reminders is appealing to me because I generally don't take into account things like “drink water”.
I like the suggestion to spend less time in front of the screen, but I don't find time to challenge myself while working. I work on a regular basis and I can't stop spending time in front of the computer. That's why I really like the idea of a reminder application to drink water or things related to my health. Also, I would like this app to include things like joint mobility so that my cervicals do not contract.
Aldana Castro (Translated Response)
I would like an application that proposes exercises, for example a squat or abdominal routine. But that includes simple activities and does not need specific materials. For example, you can do physical activities with the weight of two water bottles filled with soil. Regarding the challenges I would like something recreational, like cooking. But the same as for health, nothing that is difficult to do. Something with ingredients that I have in my house. I would also like an application that tells me the most read books or the most viewed movies. I am not so interested in the social aspect, in quarantine it happened to me that I did not want to talk to people, on the contrary I wanted to be alone.
The following conclusions are a result of an interview research deployed on subjects representing our target group.
Three main attributes were derived from the data collected by the research.
The primary aspect conveyed among other characteristics discussed is the functionality of the app. Or in other words, “What does the app have to offer? Why should I download it?” With the “Why” being an important aspect.
The input expressed by the subjects was a gradually sense of disconnect from their daily routines and protocols, due to the pandemic. This became evident with main life activates such as, work life, gym and fitness routines etc. For obvious reasons. However, a much less noticeable impact was expressed concerning other daily routines and hobbies, varying based on the individual addressed and life choices, this change was conveyed by the majority of the applicants. Therefore elucidating the notion of a need for such app. Moreover, the app’s concept of fitness and outdoor activities resonated with 70% of the applicants, as they elaborated on the importance of such measures during these times.
As unveiled by the research conducted, the overwhelming majority of applicants concede to the vitality of appearance. Expressing an appreciation for the level of attractiveness and allure that they value in the apps they already like. Impressions aggravated by the design resulting to a perception of trendiness and glamour, these were a few descriptions of the examples mentioned by applicants.
Another prevailing characteristic mentioned is the ease of use, as 90% of the applicants expressed feelings of resentment towards “Click bait” apps as they described them, apps that shower the user with ads and other annoying, non-relevant content. Therefore, we conclude the detrimental importance of Ease of Use as an element towards the overall success of the project. An aim that can be achieved by creating an app that is “User Friendly”, and continuously reassessing this goal by seeking feedback form the users, and constantly improving the app.
After we were ready with the first ideas of the apps, it was now time to test these ideas. Since this was just a first round, we did not have a working or already designed prototype. All we had were just an ideas that we had to express to verbally to the people we interviewed. I interviewed my relatives and couple of my friends that I was in contact with. First, I explained the assignment to them even though most of them still remembered it from the empathy phase. Then, I described the ideas we had and the final two that we choose to work on. I also told them what was the reasoning behind this decision. I found ou that the feedback was different based on the age of the interviewed people. I decided to divide this feedback into two sections:
First ones asked were the people I live with. My mom switched to working from home in March. Even though she enjoys it, there are difficulties that she is experiencing. After explaining to her both of the apps, I could see the immediate excitement from the Healthy Lifestyle app. She told me that she is struggeling with time management and finds herself working more than she is supposed to. Also while working she isn't take a good care of her body because she is not drinking and eating enough as well as sitting in one position for too much time. She said that she would use this app if it was simple to use as she is not that good with mobile phones. Also she would like to be able to set her preferences on the beginning. (e.g. amount and intervals of notifications, priorities, etc.) My dad does not belong to the target group as he is not working from home but he said that if he was, he wouldn't use any app because he uses his phone mostly for communication.
After my relatives, I started asking my friends. I was able to see a clear difference in the results as most of my friends got more excited about the Social Challenges app. Since most of my friends are people of my age, we all lost the amount of a fun time we can have together. This way we could participate in same activities in a safe way. I can conclude that they enjoy the competition and it is something they are missing nowadays. All of them stated that they would use the app if it had enough diversity in challenges. Also if the challenges did not repeat themselves. One of my friends proposed that the app could have a leveling system in which the bigger the level is, the harder the challenge would be.
In the second round of feedback the target audience could see two different application designs. An application of "Challenges" and one of "Health". After seeing the prototypes they gave feedback that can be read in the following section.
Second round of feedback
To get feedback on the app design I went back to the people I asked about their initial needs for these apps and this is the feedback they gave me on the visual apps.
Tinet Eisma (translated)
Health app: I think the first one is nice and clear, and the personal aspect of the reminder also appeals to me." The day is almost over, have you called your parents yet...” looks friendly for a reminder. The layout is also calm and funny with those pictures.
Challenge app: In the second the background is very beautiful Zen. The types of activities are bundled per group/type and am I right in assuming more challenges have been added? I have a little less interest in that myself, but that is again personal. Is it also technically difficult to let people choose a background themselves? Or does that get complicated ... (yes)
Marit Hoekstra (translated)
Challenge app: Functional part is very much in line with my wishes, it is very clear visual and not too difficult to understand, it is very calm and peaceful. Makes me zen. Also has a nice attention to details
Health app: Ah yes that is nice. I’d rather install / buy this app. Purely because I am more focused on health. So, this is exactly something that connected to my life. It can be nicely integrated, it’s not too heavy, light-hearted app that supports you
Very yoga-y and flowy and Zen
In the second round of testing we started with creating the designs of the apps with the help of the feedback collected in the first round. After the designs were adapted I started to show the apps to the people I interviewed. Again, I chose to include the interviews with my mom and her boyfriend, and my mate in Dublin.
I showed both app designs to my mom and her boyfriend and they had mixed responses on the designs. My mom liked the designs since the colors were soothing and calm. Especially the Physical & Mental Wellness app stood out for her. She said: 'I love the style of the characters you've used'. Her boyfriend thought that both designs weren’t that special and would’ve loved a more modern approach to both app designs. He also mentioned that the colors for the Social Challenges App were too dark and a little depressing. He said: 'Fun' and 'enjoyment' are linked to brighter colors and shades.
My mate in Dublin responded with: ‘Ok, but not great.’ I asked him why he thought they weren't great and he told me that he would’ve never downloaded the apps. He said: 'they are not really eye-catching'. He also told me that he appreciates applications to have a more modern twist. According to him, our app designs weren’t going to stand out from other apps.
Second Round of Feedbacks
The second round of feedbacks I received were generally more positive because interviewee were able to look at the designs of the prototypes created. As I had been interviewing mostly the same people/relatives plus some new ones, the general idea stayed the same. People enjoyed the social and sporty app because it moved them to get out and do activities they wouldn't be able to think about, while their biggest concern would be the mare fact of going out during this unpredictable pandemic period.
The second app, the healthy one, was also a success, people loved the design and the ultimate goal of it. Most of them considered it to be very useful and original, while most of them were concerned about the amount of notifications they could have gotten by downloading it.
Since it already is a pretty stressful period, I explained them, that we wanted to make life easier with these two apps, not the opposite. All feedbacks were collected individually and anonymously, in order to further be discussed within the team. Final adjustments were made and, since the final round is coming up, the whole team will meet up for a feedback confrontation to create the final version of it.
Kevin Anderson (Translated Response)
Challenges App
If I want to register with google, it is not available in the challenges application. I always log into applications with my Google account. In the part of “To do” I think that some ideas are too simple and still include technology. Like calling a friend. I would delete “call a friend” and replace it with something like “Meditate 20 min”. I like the motivational phrase, I use the app "Momentum" that tells me a motivational phrase for the day. I really like the goal or achievements part. I don't like the part about looking at what your friends are doing because I feel like they might make you feel a little bad. If you compare yourself, you can feel bad. I would prefer something less to compare and something more to share with my friends.
Healthy app
I like the presentation. I would pay attention to the sign-up process issue because you can only log in with Social Media. I would add that you can register with google. It is hard that I register by filling in my information. I like being able to log in directly with one click. Otherwise I might not use the app. I also like the quote, but more than a Vincent Van Gogh quote, I would prefer health-related quotes, like quotes that are motivational for "Drink water." I don't like the design of the app. I also don't like the idea of receiving notifications. Kevin doesn't use notifications and I don't like receiving reminders.
Bea Darwell-Taylor (Translated Response)
Challenges App
Actually a really great App. I like that the “tasks'' or “goals” are really simple, and achievable such as “Take a photo of this” or “Call a friend”. I think it is actually a really good proposal. Maybe it would be nice to add a “Mood tracker” so you can rate each activity. It could be something like “Take a photo of the clouds”, and then after that you would have to rate the activity through a question such as: “Did you enjoy doing that?”
Healthy app
I think this app is a bit tricky. The objective is to reduce screen time but there are activities such as “Check your mail” which are still screen time if you think about it. I prefer the design of this app much more than the one for challenges, it is more relaxing and professional looking.
Aldana Marchiori (Translated Response)
Challenges App
I really like how it is designed. I like what it offers such as “Take 15 minutes to call a loved one”. But it seems to me that the things that proposes are not really possible to do on a working day, at least with my schedule. The time I have left afterwards is for me and I don't know if I would spend it doing things like “Taking pictures of a cloud”.
Healthy app
This application seems more compatible with my lifestyle. I like that they are simple reminders because I don't like doing complex things. I definitely choose this app. I also really like the visuals of this application because they are relaxing.
Aldana Castro (Translated Response)
Challenges App
I am not convinced by an application to do things because it frustrates me so I would not use it. However, I like the design of the application a lot because it is simple, you don't have to go around a lot, you press directly and you have the challenge. I also like the activity of taking photos, because I like to take photos. But overall, I'm not convinced that the app tells me to do a lot of things because it makes me nervous.
Healthy app
I like this application more than the one with challenges. I like the reminders, but I don't like the idea of progress because it bothers me. I would download it but I feel like something is missing. Something that other applications do not have. I already have specific applications for each health thing. I have an application to drink water and an application for my menstrual period among others.
Second round of feedback
The Imagery: Responses received amongst many of feedback heavily favored the consensus regarding the Choice of Imagery used for the app. As many described it as “Positive” and “Relaxing”. An impression we engineered in order stimulate such positive reactions amongst users in order to put in place the foundations for the success of our objectives.
“The Fonts Used Add a Classy Touch”: Other responders mentioned the effect that the fonts had on their overall view of the app. A few declared their unwillingness to make a similar choice of font for a similar project, describing it as “A tad unorthodox”. However, the majority of the responders conveyed feelings of admiration towards the font, describing it as a classy touch, and that the choice of wording for the in-app text is supportive, and nice with interesting quotes.
“Assignments and App Options Are Clear and Well Organized”: The feedback about the overall impressions regarding the ability to use the app aggravated by the prototype was very specific. People mentioned that the app seemed well organized and relatively easy to use.
“Some of the Assignments provided are Rudimentary but Interesting”: A few critiques of the app targeted the examples of assignments given via the prototype, however it was explained to them that these remain in a trial stage and may be adapted in the future.
"The app is well designed with a nice feature that gives the ability to make a personal profile": Another positive feature highlighted by responders, is the ability to create a personal profile within the app. Allowing users to track their progress and connect with other users in their network.
After the first round of testing, we collected all the feedback and went on to make an actual design of the apps. With these two designs, we went to get a feedback to improve it into the final version. Personally, in the second round, I asked for the feedback the same people I asked in the first round. In the first round of feedback, it was clearly seen which app is more exciting for which type of people. In this round, I showed them mainly the app they were interested about and then also the other one just so they can see how it looks like. Same as in my first feedback, I will divide the results into two parts.
The closest to me are people I live with, so naturally, they were the first ones that were offered a peek at our actual design. My mom was the first person to give me the feedback on the video of the app I showed her. She really liked the design of the app as it was very clear and also calming. She said that it would be funny if it also had some background sounds that would go with the design. She proposed water drops or some birds. This is a nice idea but we would need to include the option to turn it off because not everyone likes the same music/sounds. She also liked the idea of having a different quote everyday. She also proposed that it might be nice if she could confirm that she for example drank a glass of water. For this she could get like a notification saying "Good job! or Keep it up!".My dad liked the design but again, he is not the part of our target group. They both said that the other app is not really relevant for them.
Friends
With my friends, I focused more on the social challenges app. They liked the overall look af the app. They did not say anything particular about the design but all of them expressed that it was very easy to navigate. There were no excessive or unnecessary buttons which would distract them. They also liked the base challenges but one friend said that he would like them to be harder. This is however a personal preference and "hard" is a very subjective term when it comes to various activities. My other friend suggested that it would be nice if she could add friends within the app like for example on Facebook. She would also like to see the statistics of other users of the app regardless if they are her friends or not. She said that maybe some of her friends won't like the app but she would still like to use it. This way she could still get the competitive feeling even if it is not as strong as competing with friends. Overall, I received a lot of positive feedback with few ideas for improvements.
The feedback that we collected was very positive overall. Most interviewees were very excited about the app and liked the design changes we made for the final product. Especially the brighter colors were a success. Some described the colors of the app to have a sense of peace and serenity. Others mentioned that the application had a particular vibe that was positive and reinforcing. It was also said that the app is very clear and doesn’t bring up confusion.
Not only did the interviewees love the design and colors, they also loved the concept of the app. The app included all the necessary features. Most liked that when using the app, the user still has the ability to adjust the settings to their needs. Some expressed that they needed something like this to distract them from the increased pressure of working from home.
We also noticed that older interviewees appreciated that the app was easy to use. The simplicity of the application really helps the user to navigate easily through the different pages. The achievements were also a big success since they motivated the users to continue with more challenges.
Of course there were also some issues mentioned by the group of interviewees. Take for example the current regulations in foreign countries. Not all countries allow you to do a lot of things outside so outside challenges might not even be possible. Additionally, remote workers might get saturated with the amount of notifications they receive every day. They’re already dealing with a lot of messages, emails, and notifications. Receiving even more notifications might be very discouraging.
Nevertheless, almost all interviewees stated that they would definitely try out the app. The design mixed with the right colors were a big success according to the received feedback. Especially the ‘challenge’ aspect of the app was highly popular. They loved the fact that a user would be able to share and challenge other users. Most also identified the concept of the app to be original. They also appreciated being able to customize the application to their own needs.