A team of researchers and I in the Learning Strategy Lab conducted an evaluation of a non-profit's training and authored a paper about our evaluation approach which was published in the Performance Improvement Journal.
What was Thomas Gilbert really trying to birth into the world of performance? Coming Spring 2025
How can the Universal Design For Learning tools and techniques help a professor design instruction for online and in-person learning environments?
Coming Spring 2025
"Dreams unlocked" by glancs is licensed under CC BY-NC-SA 2.0.
Halah Mohammed
Before and throughout the Covid-19 pandemic (ongoing), I have been wondering about accessibility in terms of food deserts, wifi and tech access, cost and financial barriers to necessities and leisure activities, and how they relate to or are in discussion with the trend to digitize these facets of livelihood. Learning about WCAG 2.1 , actionable and evaluative guidelines and standards for how to make content online more accessible to a wider range of people with disabilities and the comformances associated with it, further amplified my motivation to look into that potential relatedness. Additionally, learning about POUR, an acronym for the four principles of WCAG which are perceivable, operable, understandable, and robust, made me think more deeply about how to evaluate and construct online versions of life’s necessities and other experiences.
Below I use the principles of WCAG 2.1, POUR, and the accessibility evaluation tool WAVE–powered by WebAim–to evaluate the accessibility of the websites for a grocery store and museum in Colorado.
Sprouts, as it is colloquially known, is a grocery store chain in Colorado that serves local and organic produce, food, and home and body supplies. It typically runs weekly discounts and happens to be one of the nearest grocery stores to my home in Colorado. Note, there are three grocery stores near that home and each of them are on average a 15 minute drive from it, making my neighborhood essentially a food desert. Throughout the pandemic I used Sprout’s website to review their inventory before submitting a grocery order through Instacart. I was curious about how accessible their website is according to WCAG, POUR, and WAVE, so I evaluated Sprout’s website for accessibility using those guidelines, principles and tools. Below is an image of the summary findings from WAVE.
As the picture depicts, WAVE identified a slew of errors. I will highlight two.
One of the four errors with the red box with white “x” symbol. One of those errors is an empty heading associated with a button, which means the button does not have any content associated with it. The lack of a header for this button is an issue because people who use assistive technology to read screens may not perceive a button is there or understand what the button is for without a heading.
One of the twelve contrast errors--two circles with one outlined in red and the other filled in with red-- refers to a low contrast between text and background colors for a label on the screen. This causes an issue for people with low vision or sight acuity. My takeaway from this shallow review is that the Sprouts website could improve its accessibility in a myriad of areas especially with regard to perception, operability, and understandability. In general, readability and transparency increase accessibility for all so it is important that they are present, capitalized on, and utilized in the construction of online content.
The MCA Denver (MCAD) is one of my favorite museums to visit in Denver because I value art, especially contemporary pieces because they tend to synthesize, bring attention to, and illustratively showcase current threads of ideas and happenings across the world. I tend to review their website for news about the latest installations, concert series updates, and much more. I know that structurally it is built to accommodate a few modes of traveling and navigating the space such as large elevators and wide staircases with railings. But, I was curious about how accessible their online website is too, so I again used WCAG2.1, POUR, and WAVE to evaluate the accessibility of MCAD’s website. Below is a picture of the summary of my findings from WAVE.
As the picture shows, WAVE noticed a number of errors especially with contrast and alerts. The former is most surprising because the MCAD deals with art so I assumed the contrast presented in the MCAD online site would be prioritized.
One of the contrast errors refers to part of a header “Upcoming Events.” This particular contrast error is problematic because again people with low sight or acuity would have difficulty understanding this part of the header, which is attempting to educate and invite people to come to or access the MCAD.
One of the alerts, indicated by a mustard yellow triangle with an exclamation point in white text color, refers to an issue with alternative text. It appears to be insufficient and full of extraneous details. I reviewed the four lined text and I agree. Alternative text should be programmatic in that assistive technologies can read them and should be concise, relaying the most important information for the reader. My takeaway is that the MCAD’s website could improve its accessibility in a number of ways, including editing the contrast for many parts of the page and the text for alternative text for images and other graphics to increase perception and understanding.
"'Please Return Shopping Carts After Use'" by B Tal is marked with CC BY-NC 2.0.
Halah Mohammed
It is Friday evening, and you are attending a 1-hour long training about creating online learning. The presenter clicks through slides highlighting some of the benefits of online learning and at the end gives everyone a handout that lists some of the latest platforms that could be used to teach students online. On a scale of 1-10 (1 - not likely and 10 - very likely), how likely are you to remember and apply what you learned in the training?
"Not likely" might be a generous response. The training was too quick, you didn’t get a chance to try out the suggested resources, and you probably zoned out after slide 7 (I know I did!). Simply put, the training was boring and not motivating enough for you to engage with it.
Motivation is what pushes and propels a learner into and through a learning experience. It is what incites and sustains a learners’ engagement. Without it, learning may occur, but it may not be as deep or rewarding of an experience as it could be.
It is important to note that not every form of motivation is the same. There is extrinsic or external motivation, like the Covid-19 Pandemic that prompted many instructors to learn how to teach remotely. There is also the intrinsic or internal motivation like Professor Jason Haffner’s research and innovation “with online delivery in [Rice’s] non-credit offerings before the pandemic” (Fitzgerald, 2022). Most instructional design and HPI practitioners consider intrinsic motivation to be more powerful in engaging a learner because it is self-activated, and I agree with them. At the same time, I also think both types of motivation are necessary for capturing a learner’s attention initially and potentially indefinitely.
For example, in a survey studying the ongoing impact of Covid-19 on teaching and learning in higher education, “four in five instructors said they had participated in professional development for digital learning to prepare for the [2020 fall semester]” (Lederman, 2020). The survey was taken after the instructors’ initial experience teaching virtually in the spring. Their interests in creating more and potentially better online learning could be the result of extrinsic or intrinsic motivating factors, such as the ongoing pandemic, their self-imposed desire to create more engaging online learning, or their institutions since “more than half of instructors credited their institutions with providing sufficient training for the fall” (Lederman, 2020).
As instructors’ motivation to learn about online learning increases, the demand for training on online learning will also increase. I think leveraging instructors’ motivation will be key to designing learning experiences that keep them engaged and excited about online learning. But how?
ARCS Model Graphic by Halah Mohammed
One way to do it is through John Kellers’ adult learning theory and model, ARCS.
The acronym ARCS stands for attention, relevance, confidence, and satisfaction, which are four components of motivation that need to be activated to engage the learner and make learning happen (Merriam & Bierema, 2014). When applied to designing training for online learning, it could look like:
Adults tend to be driven by their egos as they learn, which means they often try to avoid mistakes or opportunities in which they look incompetent (Rothwell, 2020). Keeping this in mind, it will be important for the trainer to set up a supportive learning environment to boost instructor confidence. One way to do that is to provide textual and visual support for complex processes or procedures such as how to use video conferencing software and learning management systems to create effective online learning. With these aids, instructors are more equipped to confidently practice translating their own course designs into virtual formats.
Satisfaction in ARCS is not just the happiness of the learner, but also the satisfaction of the performance goal (Steiha, n.d.). For example, the trainer could provide opportunities for instructors to show off what they have learned in the class by having instructors present on their in-progress or complete online learning course designs and give constructive feedback to each other. The trainer could also evaluate the instructors’ satisfaction with the training through reflective discussions and surveys. Finally, the trainer could set up a virtual community of practice that the instructors could engage with after the training. By doing this, the trainer moves the instructor from a state of satisfaction into a state of curiosity and motivation again.
Through ARCS, motivation begets learning and learning begets motivation. Unlike the training I describe at the beginning of this blog post, ARCS uses motivation to make a training on online learning engaging, supportive, deep, and rewarding. Now that you know about the two types of motivation and how motivation can be utilized to design learning experiences through the ARCS theory and model, how can you use motivation to craft your next learning project?
"Ski - Backside 360" by Sjoerd van Oosten is marked with CC BY-NC-ND 2.0.
Fitzgerald, M. (2022, February 15) How Online Learning Is Reshaping Higher Education. USNews.
Lederman, D. (2020, October 6). Faculty Confidence in Online Learning Grows. Inside Higher Ed.
https://www.insidehighered.com/digital-learning/article/2020/10/06/covid-era-experience-strengthens-faculty-belief-value-online
Merriam, S. B., & Bierema, L. L. (2014). Adult learning: Linking theory and practice. (1st ed.).
Rothwell, W. J. (2020). Adult learning basics. (2nd ed.).
Steiha, V. (n.d.). Arcs +V explanation. [Video]. Canvas@BSU.
Halah Mohammed
This week, I experimented with Articulate Rise, a versatile and comprehensive tool for creating e-learning lessons and courses. Rise simplifies the construction of e-learning into blocks that are stacked vertically to create scrolling pages worth of lessons. I think this style of e-learning design is very helpful for someone like me, a person who is new to using software to create e-learning lessons, because it starts out with an organized frame to build from.
You can create all types of lessons and courses in Rise. You could build courses and lessons from scratch or you can use one of many templates, fill in the content, and voila! You have created a course or lesson. But as we know from experience and my previous posts, not everything produced from a tool has the same quality or effectiveness. That goes for courses and lessons too.
A helpful principle to keep in mind and to ensure that your course is designed with quality and effectiveness in mind is CRAP, which stands for contrast, repetition, alignment, and proximity. See the graphic I created below!
is a course about how to design learning objectives. Although the sequencing of the content in the course appears to be simple and straightforward, macro (history of learning objectives) to micro (how to create learning objectives). The actual layout of the content is not as straightforward and lacks an effective use of some of the CRAP elements. For example:
Repetition: Content about learning goals, objectives, and outcomes are spread out in different sections and are repeated across sections without a reference (i.e. “we will discuss this more in part xyz”). To improve consistency and help learners better keep track of information throughout the course, it may be helpful to combine the separate sections regarding learning goals, objectives, outcomes and their differences into one section. This could help the learner navigate the course much more efficiently.
Alignment: Some of the graphics used in the course do not appear to be related to the text that appears next to them. To ensure that all elements on the page appear to be related to each other and have a purpose, it may be helpful to select a different graphic or change the text so that it better elaborates on what is conveyed in the graphic. This could help enhance the learning experience for the learner.
is a course that gives information about some of the most used and popular social media platforms. However, unlike its title suggests, it does not review how the power of these social media platforms has evolved over time. One CRAP principle that could use a tweak is:
Alignment:
The objectives and content in the lesson do not directly relate to the title of the course. Additionally, relevant content appears to be omitted such as why Facebook , Instagram, and Twitter (aka X) were created, how they have changed over time (i.e. Twitter’s character limit), and how those changes relate to growing power. It may be useful to include some more sections about those details to better align the course content with the overall objective of the course.
A graph is included that shows the most followed twitter accounts but there is no information about where the graph comes from and over what time period the data in the graph spans. It would be useful to include these details so that the learner easily comprehends the relevance and validation of the graph. Making the suggested changes could help the learner make connections between the content faster and more easily identify the importance and relevance of content.
is a course that reviews food allergies, the importance of knowing them and how to identify them as well as how to respond to them. This course does a good job using and incorporating all CRAP principles. Here’s how and why:
Contrast: The images used throughout the course are colorful, easy to see, and appear to match the tone of the text it is next to. For example, the picture of a stethoscope on a table begins the section about how to recognize a reaction.
Repetition: At the beginning of the course the learner is instructed to take a quiz about what they know regarding allergies and again at the end after learning more about allergies. The bookended exams help the learner consistently track and measure their learning progress. Additionally, a picture is included at the beginning of every lesson in the course. This helps the learner easily distinguish between sections and easily navigate through the course.
Alignment: Throughout the course flashcards are used to present vocabulary, accordions are used to present longer explanations, and a scenario is used to demonstrate the nuance and carefulness that is needed to have conversations about the difference between an allergy and an intolerance. These three elements of Rise design pair well with the content associated with them and ensure that the behavioral learning elements do not subtract from the cognitive learning the learner has to do throughout the course.
Proximity: Throughout the course relevant and related graphics and text are placed near each other. This helps the learner easily make connections without much demand on their cognitive processing.
I hope my review of the CRAP principle in three different courses created by Rise helps to highlight the importance of understanding how to use a tool to create an effective product. I applied the CRAP principle in my own project in Rise. Check it out here.