Pilot Tests

Test #1 With ALST

For this first pilot test, I tested my ALST group and obtained data through a Google Form. Specifically, I was testing them on three scales of "likeability and ease of use" to help me understand if my solution is viable. I also asked an "any other feedback" question at the end of the survey where the participants were allowed to list other critiques for the website. Of the 16 responses that I received, 37.5% of them were seniors, 37.5% of them were juniors, and the remaining, 25% were sophomores. Overall, a very even spread of data.

User-Friendliness

Document

Among the 13 responders who said that they previously completed the Google Document method of understanding where they are in terms of pathway completion, 69.2% said the document was somewhat user-friendly. In comparison, 7.7% said the document was very user-friendly and the remaining 23.1% said the document wasn't very user-friendly at all. 0% of the responders said the document was extremely user-friendly.

Website

Among the 13 responders who said that they previously completed the Website method of understanding where they are in terms of pathway completion, 61.5% said the document was very user-friendly. In comparison, 15.4% of the responders said that the website was extremely user-friendly, while the remaining 23.1% said the website was somewhat user-friendly. 0% of the responders said the website was not user-friendly at all.

Overall

15.4% increase in the extremely user-friendly category.

53.8% increase in the very user-friendly category.

46.1% decrease in the somewhat user-friendly category.

23.1% decrease in the not user-friendly at all category.

Comfortability

Document

Among the 13 responders who said that they previously completed the Google Document method of understanding where they are in terms of pathway completion, 53.8% said they were somewhat comfortable in terms of pathway completion. In comparison, 15.4% said they were very comfortable and the remaining 30.8% said they weren't comfortable at all. 0% of the responders said they were extremely comfortable after completing the document method.

Website

Among the 13 responders who said that they previously completed the Website method of understanding where they are in terms of pathway completion, 46.2% said they were somewhat comfortable in terms of pathway completion. In comparison, 46.2% said they were very comfortable and the remaining 7.7% said they were extremely comfortable. 0% of the responders said they weren't comfortable at all.

Overall

7.7% increase in the extremely comfortable category.

30.8% increase in the very comfortable category.

7.6% decrease in the somewhat comfortable category.

30.8% decrease in the not comfortable at all category.

How much Information Did You Obtain?

Document

Among the 13 responders who said that they previously completed the Google Document method of understanding where they are in terms of pathway completion, 61.5 said they learned some information regarding pathway completion. In comparison, 15.4% said they learned quite a bit of information and 23.1% said they learned no information at all. 0% of the responders said they learned tons of information.

Website

Among the 13 responders who said that they previously completed the Website method of understanding where they are in terms of pathway completion, 69.2% said they learned quite a bit of information regarding pathway completion. In comparison, 30.8% said they learned tons of information. 0% of the responders said they learned some information or no information at all.

Overall

30.8% increase in the extremely tons of information category.

53.8% increase in the quite a bit of information category.

61.5% decrease in the some information category.

23.1% decrease in the no information at all category.

Any other Feedback?

From this data, a couple of main things emerge. While there were a couple of errors with certain classes, the main issue that arises is that students want the ability to change classes, without having to refresh and completely start over. Also, another thing that they would like to see is their total number of credits for both the supporting and foundation categories, so they know how many more classes they need to take.

Analysis

Overall, this test was extremely helpful and insightful. First of all, from the data, it is clear that my website, is overall, improving the numbers when it comes to comfortability, user experience, and amount of knowledge obtained in pathway completion. Of these three criteria, however, the main one I appear to be lacking a little in is comfortability. This, I mainly explain is because there is no current way to update or remove classes unless you refresh the entire page. My "any other feedback?" data also heavily mentions this. Also, some instructions weren't as clear as maybe they needed to be. Using this data and feedback, I can be sure to make my instructions more clear, and possibly create something to go back to and easily update lists on the website before my true, big test with the entire school.

Test #2 With Small Group

For this second test, my goal was to obtain statistics relating to the first part of my design criteria. I tested a small group of individuals and asked them a couple of questions relating to the number of clicks that each method was taking them, as well as how long it was taking them to complete each method while filling out a randomly selected academic planner. The overall spread of data was again very spread out with 55.6% of the responders being staff and 44.4% of the responders being students. In the following data, I will only be focusing on the 11th and 12th-grade academic planners for the pilot test, however, I did also test 9th and 10th-grade academic planners. I chose to only report the 11th and 12th-grade responses as they would have the most data variability since they have the most classes that needed to be input.

11th Grade Document Data

Document

Among the 2 responders who filled out the website method and tested for time, clicks, and highlights, the averages were...

68.5 total clicks
12.3 highlights
6.5 minutes

Website

Among the 3 responders who filled out the website method and tested for time, clicks, and highlights, the averages were...

51.7 total clicks
0 highlights
5.3 minutes

Overall

24% decrease in total clicks

100% decrease in total highlights

18% decrease in total time

12th Grade Document Data

Document

Among the 3 responders who filled out the website method and tested for time, clicks, and highlights, the averages were...

113 total clicks
35.5 highlights
9 minutes
Note: 1 Person Gave Up Here

Website

Among the 3 responders who filled out the website method and tested for time, clicks, and highlights, the averages were...

81.25 total clicks
0 highlights
7 minutes

Overall

28% decrease in total clicks

100% decrease in total highlights

22% decrease in total time

Debrief

Overall, this test was also extremely helpful and insightful. First of all, from the data, it is clear that my website, is overall, improving the numbers when it comes to the number of clicks, number of highlights, and amount of time to complete precheck. Of these three criteria, however, the main ones I appear to be lacking a little in are the number of clicks and time to complete. This, I mainly explain is because there is no current way to update or remove classes unless you refresh the entire page. Also, some instructions weren't as clear as maybe they needed to be, or maybe some human error was in the mix as well. Using this data and feedback, I can be sure to make my instructions clear, and possibly create something to go back to and easily update lists on the website before my true, big test with the staff who volunteered to help.

Page updated

Google Sites

Report abuse