Core area 2: Teaching, learning and assessment

a) An understanding of teaching, learning and/or assessment processes

In my previous CMALT portfolio, I discussed my teaching experience at the University of Moratuwa - Sri Lanka and the University of Reading - UK. I have gained the Fellowship of the Higher Education Academy in December 2014.

In this section, I am going to use two examples: creating a new module for Postgraduate Research for students and creating an Accessibility Awareness course for the staff.

Fellowship of Higher Education Academy

Creating a New Postgraduate Research Module

Since moving to UCEM, I have worked in a non-student-facing role. I have developed so many modules as a learning designer over the years. However, I got the chance to develop the new Postgraduate Research module PRJ7PRA in collaboration with my colleague Dr. Graeme Whitehall in a capacity of an academic for September 2020 delivery.

This module is a double credit module (40 credits) and runs across two semesters and unlike other UCEM modules, this is mostly a self-driven research project with the allocated supervisor. Because this module's structure is different, students find it difficult to grasp and engage at the right points. After discussing with Graeme we decided to signpost students and make the engagement points very clear for the students.

In this module, we used Moodle Checklists to nudge our students to check their submissions (Gawande, 2011) meet all the requirements. This was the first UCEM module to use checklists as part of planned intervention to support students' learning. I also developed a "Module at a Glance" structure where it showed all the important submission points.

Module at a glance - this is hoped to provide a clearer view of the structure of the module and how each week fits into the module's topic structure

Each week is colour coded and named (colour may not be ideal for people with colour vision deficiency but with named sections hopefully they too will find this useful).

Notice the available checklists

Student Feedback

We used a Moodle anonymous survey to collect student views of checklists and how they found these. We only received very few responses (11) for the survey but the students who have responded have found the checklists really useful.

I have found the checklists to be a really helpful tool. Not only do they ensure you haven't forgotten to include anything in your final submission, they can also help you to plan what goes into it in the first place.

Sometimes; I have forgotten basic items in my submission and would have lost easy marks had it not been for the reminder provided by the checklists.

The checklists helped me know where i should be at each stage of the project

All checklists were very useful and should be attached to every assignment. they can mean the difference between a pass, credit of distinction. This is because, at times one forgets to add very basic items and the checklist provides a reminder.

I think checklists should always be included in the modules. Students can decide whether they want to use them but personally I have found them to be an excellent tool for staying on track

Staff Feedback

I received a UCEM excellence award for the creation of this course. The nomination is given below:

"I would like to nominate Tharindu for the award of excellence. We have been working closely together since June on the module development of the postgraduate project module as part of Transform. The module is a double credit forty week module and we committed to designing it without a VitalSource text. It turned out to be a real mammoth task but also a rewarding one. A great part of which has been the opportunity to work with Tharindu. It has been a real pleasure to work with someone of such a high calibre, with such a deep knowledge base, consistently exemplary attitude and wonderful disposition. I could of have nominated Tharindu for any of the values but feel that her excellence as an academic colleague can never be overstated - and I do think our collaboration has genuinely produced a really strong module for the students, informed by Thaler and Sunstein's Nudge Theory and Atul Gawande's Checklist Manifest, that is a definite step in the right direction toward the institutional aim of academic excellence. Luckily, we have agreed to evaluate the impact of checklists as part of a joint research project - so the collaboration goes on!"

Creating an Accessibility Awareness CPD Course for UCEM Staff

This course was created on my own initiative to raise accessibility awareness at UCEM. Unlike students, most professionals learn things that are relevant to them and at a point when it is required. Malcolm Knowles's adult learning theory is a study that aims to show how adult learning differs from that of children. He identifies several important features (assumptions) of the adult learner: self-concept, experience, readiness to learn, orientation to learn, and motivation to learn.

When creating the course I tried to use the ABC learning design (Young and Perović, 2015) to make sure that there different types of activities involved to provide variety. In the ABC learning design, there are different learning types defined: acquisition, investigation, collaboration, discussion, practice, and production. In this course, collaboration and discussion opportunities are minimal as it is a stand-alone, self-paced course. However, the ABC learning design guided the way to design the course.

I also wanted the activities to be active, short, and sharp. The activities require learners to "do" something - that is actively getting them involved. The course has a suite of eight open badges. Seven sections of the course have relevant quizzes which allow the learner to earn a milestone badge. Earning all milestone badges and providing a reflective account of their own learning allows the learner to earn the final accessibility awareness badge.

I made a presentation about this course at the ALT Winter Conference 2021. You can see the slides and presentation.

The learners were given the opportunity to provide feedback and a reflection on their learning to earn the final badge. Feedback on the course
(Password protected document)

The document is password protected and the password is made available to the ALT assessors.

This was one of many pieces of feedback I received from learners in the Accessibility Awareness course.

1. The colour contrast software is great and something I will use whenever creating documents or resources for students.
2. The information about structuring documents was really helpful in understanding how to create accessible docs. This will be very useful for day-to-day tasks.
3. I hadn't really considered how to make images accessible before but I will be taking this forward. It's good to know when you can mark something as decorative and when it needs a description.
4. I'd often found describing a link difficult before in emails etc but the guidance was really helpful and has made me feel more comfortable.
5. It was interesting to understand more about how assistive technology interacts with accessibility. This will be really useful when talking to students and creating resources for them.

Great course - thank you!

You can view here email feedback about the course.


Email feedback

UCEM STAR Awards 2021- Passion

I am so touched to have received this amazing feedback from my colleagues at the UCEM Star awards 2021 for my #accessibility work.
• Everything she does is to an exceptional standard.
• Her passion for accessibility is simply extraordinary, evidenced by all the training she has done and recent development of the VLE course.
• She is so passionate about this topic and engages and informs all staff on her mission.
• The course she created was thoroughly enjoyable to work through, the time and effort she puts into the project is evident.
• She is integral to ensuring UCEM is head and shoulders above its competitors in terms of online content and digital accessibility.
• Her research work demonstrates impact and influence and her collegiate approach supports her colleagues superbly.
• She is a hidden gem, working without fuss but having a real impact in so many areas

Analysis and Reflection

Technology is changing continuously and these changes open up new opportunities for teaching and learning. For example, up until broadband was commonplace it was not possible to have streaming videos or webinars, and today we can't think of working without online meetings. Until the COVID-19 pandemic changed the "normal" to a new normal, many traditional institutions snubbed the idea of online teaching/learning. But when there was no possibility of continuing the traditional ways of teaching-learning, they all had to adapt and even embrace the new normal. UCEM has sent printed packs of learning materials to all its students in the past. With the advancement of technology now UCEM has become an online learning institution. As the technologies and the ways of learning change, if we try to stick with the same old methods of instruction it is not going to work well. That is we need to adapt to the changes in technology, ways of life, and in general to the changing world. While in the past teacher was looked upon as the ultimate authority of knowledge and content, today content is available in an abundance. The role of the teacher has changed to be more like a coach or a mentor who guides the learners. The learners' role has changed from being passive consumers of content to co-designers of content and courses. There is much more of a need to develop digital literacy where the learner is able to identify and distinguish authentic sources and authentic content from the rest. We as learning technology professionals must support both educators and learners in adapting to their new roles.

I think I have a good understanding of teaching, learning and assessment having worked in the area for over 15 years now. While teaching in a face-to-face setting could be viewed by some as the ultimate experience, the effects of the pandemic showed us that life has to go on even without face-to-face contact. In a face-to-face teaching session, you can see your learner's faces and gauge whether they have understood what you are teaching. This we cannot do in an online environment (unless it is a synchronous event with quality video) and therefore, the materials have to be very clear in explaining the content. This is why content creation in online environments or in fact any distance teaching has to be done with care and attention.

In this situation, you need to give learners a chance to interact and provide feedback because otherwise, it will be too late when they face exams and not do as well as they could have. It is important to have quizzes and other formative ways where the learner is able to gauge their knowledge and understanding of a topic. Learning analytics also provides some help in this respect by identifying resources that are most or least accessed and time spent.

On the other hand, when it is a self-directed self-paced course such as the Accessibility Awareness CPD course, there is not a cohort doing the course with you. It could become a lonely experience. This is why I designed the course with open badges to keep learners motivated (hopefully). There are many other initiatives that support the Accessibility Awareness course at UCEM. For example, I run online workshops, badge achievement is acknowledged in the institutional bulletin. If the staff member is happy to make social media posts these are promoted and most of all the staff members are aware that they can directly approach me should they have any queries.

Looking back at the experience of creating the accessibility awareness course, I am really glad I invested the time and effort to do this work. I applied for VocTec Seed funding in 2020 to create an open accessibility awareness course. However, I was not successful in my bid. As a regular blogger writing for the UCEM Online Education Blog I had authored a lot of accessibility-related posts, which I could use in creating the learning materials. When I did not get the funding, I tried to reuse these posts to create the learning content by myself. Having created so many modules as a learning designer and an instructional technologist it was not difficult to put it all together. However, this took a long time as I was working on this as a pet project.

This course could have been good as an open course given there is so much need for upskilling staff with accessibility awareness, especially with the new Public Sector Bodies (Websites and Mobile Applications) Accessibility Regulations 2018 coming into effect. However, as I was not able to secure the funding I wasn't able to do this. Now that the course is created and has received favourable feedback, I am in the process of putting together a case for offering this course as an open course on UCEM Online Academy.

The take-home message from this experience is that you need to identify and connect with your learners and their purpose for learning. Once these can be complemented you can create an effective course. This leads nicely to the next topic of understanding your learners.

Reference

Gawande, A. (2011). The Checklist Manifesto: How to Get Things Right, Profile Books: London.

Knowles, M. S. (1968). Andragogy, not pedagogy. Adult Leadership, 16(10), 350-352.

Young, C and Perović, N. (2015) ABC Learning Design method available from https://abc-ld.org/

b) An understanding of my target learners

In my previous portfolio, I discussed my target audience from the University face to face sessions and a MOOC. This included learners who have English as a foreign language, learners with disabilities, adult and elderly learners, as well as young university undergraduates.

At UCEM, our learners tend to be part-time, much older (the average age is 30 years) and more than a quarter of them are international learners. We also have a considerable proportion of students (about 11%) who have declared disabilities. The common characteristic of our students is that they all are time-poor learners. Most of our students are in full-time employment and they take part-time studies while also managing their households. All these make our learners very time-poor. According to Butcher (2015) "part-time higher education students are marked by their heterogeneity – they cannot be considered as a single homogeneous group" (P6). They also suggest that a higher proportion are female students with caring responsibilities for children (38%) or older relatives (12%). Furthermore, Butcher (2015) states that "choosing part-time was effectively an illusion because students were faced with ‘Hobson’s choice’ – it was either part-time or nothing. Most respondents admitted to preferring the idea of full-time study, but believed the cost was too great; they could not afford to give up a job when they had extensive family outgoings, and in many cases they were debt-averse".

How can we support time-poor learners? There are various case studies and approaches documented in the literature (Royal College of Physicians, 2018; Karwowska and Tse, 2019). Royal College of Physicians (2018) highlights the importance of "creating brief learning opportunities" for medical trainees. Karwowska and Tse (2019) highlight the importance of distributing information in ways that is easier for the participants to access. For example, they reported that while email and printed material were readily accessed a wiki site was less likely to be used by the respondents who were also postgraduate medical trainees.

At UCEM we already follow the practice of creating bite-sized learning opportunities. Larger longer activities are broken into small chunks to help engage the learners. We provide a "Module Map" which highlights the topics per week and assessment weeks.

However, something we have not been doing so well in the research project modules is providing the learner with a good outline apart from the Module Map. Because the module runs across two semesters, by providing a module map for each semester we were not giving our students the full overview of the module. Also, when the module map only contains topic weeks students may miss-interpret that to be the only work needed. But in the project modules, most weeks are self-directed research. It is important to provide learners with a clear outline of what is essential along with a structure of the module and where they should be at a given point. This is what I tried to do in the new Postgraduate Research Project module with module overviews and checklists. At each submission point, we included a checklist, which allows our students to check whether they have covered all criteria required to make a successful submission.

Checklist example

Checklist examples

For example in this checklist, the student can see whether they have covered all the required sections in their project outline submission.

This way, just before a student makes their submission they have a tool to check and confirm that they have taken all necessary steps to get a good mark. If they find they have not covered a section, they could go back to improve it and submit which gives them an opportunity to improve their work before submission. As you can see from the second checklist where appropriate, links are given so that the students can quickly go back to the relevant sections easily.

Time-poor learners are not just our students. When introducing the staff CPD course I was also thinking of the time-poor staff who may procrastinate a course on Accessibility Awareness due to demands on their time. Thinking of these learners, I approached the course in bite size chunks. Each section would not take longer than 30-45 mins maximum. Each video is less than 5 mins and most videos are around 2 minutes in length. This way I keep the subject very focused and short and sharp. Also, there are quizzes in each section that will test memory recall in cases where regulation needs to be memorised but mostly asking them to apply it to an everyday office situation. When adult learners can 'see' that what they are learning is directly relevant to their work it is more likely to keep their interest.

A question to test knowledge of accessible colour

A question to test knowledge of accessible colour

Below are some of the feedback recieved in the accessibility course that related to its design

"...Overall, I think this course is brilliant and very easy to follow and navigate. I thoroughly enjoyed it and didn't feel there was an overwhelming amount of text to read. The videos to accompany the text was very useful and enlightening."

"I really enjoyed this course the six different sections that took you through the various learning styles from text, web, tools, videos and added websites to 'dip into' along the way helped significantly..."

"... This has been a breath of fresh air, and one that I could not leave, as once I started I wanted to finish it. Each level drew me in further and as I did each section I was thinking how I could use this with my students..."

As an accessibility champion at UCEM, I am very aware of accessibility challenges posed to students with disabilities. The whole campaign to raise awareness about accessibility is to help students with disabilities.

I use English as a second language. Therefore, I understand and empathise with students who are learning in their second or subsequent languages and how important it is to provide content in easy to digest manner. As a migrant, I was not always aware of some cultural and contextual events, and scenarios relevant to the UK. Therefore it is also important where possible not to depend on a learner's context knowledge. For example, in the UK Construction industry if someone refers to Grenfell it is understood that they are referring to the tragic fatal fire at Grenfell tower block which was exacerbated by combustible cladding. However, given that we have international students, it is unfair to make the assumption that those students too will be aware of the specific case. Therefore, it is important to make sure to give a reference and a short background to a case when writing content for a wider global audience.

The UK Construction industry is begging for diversity. According to Government statistics, the working-age BAME population is about 14%. However, in the construction industry, it is about 6%. Women comprising half the population represent about 15% of the construction sector. UCEM has helped attract a more diverse workforce into the industry by opening its flagship Level 3 Surveying Technician apprenticeship programme. However, as learning designers and learning technologists, we too have a responsibility to show the diversity in the content we present. When we use images in eLearning do we use diverse learners in our images or do we show a white man in a suit reinforcing the traditional industry norm and alienating the few minority ethnic students and females who were brave to join a sector seen as white male-dominated? When using case studies are we looking for UK-only case studies or are we looking more widely? When giving our students an assignment are we asking them to consider their environment or are we restricting them by giving a UK case study? When you are doing a podcast or voice-over screencast are you using voices that reflect our diverse learners? These are some questions we can think about when designing our learning to suit our learners.

I was republishing an old case study used in many property management modules and I noticed that all images contained white middleaged men whenever there were images used. I used a recorded female voice and included a female's image to go with this resource. This is just one example of how I have tried to show diversity in the images used. I have also spoken about this in a learning technology meeting encouraging other learning designers to see what their materials look like when reviewing and republishing content and if possible to select images that represent all our learners.

Analysis and Reflection

Understanding your learners is of great importance to providing a fulfilling learning experience. When I started as a new lecturer at the University of Moratuwa, Sri Lanka we had an almost homogeneous group of students in terms of learning ability (the University of Moratuwa Computer Science and Engineering attracts the top Maths Advanced Level students in the country), age, and all being second language learners. In Sri Lanka, in those days, learning disabilities were hardly identified/recognised.

Billiard like mobile game

Billiard like game

When I was the lead facilitator of the University of Reading's first MOOC, Begin Programming: Build your first mobile game on the FutureLearn Platform, I was teaching a huge learner base of over 50k registered students, from all over the world, in all walks of life and with various abilities. It was in one of the discussions in this course that a learner said she could not "see" how the ball moves on screen and that she has to ask her partner to tell her whether it works as intended.

This was the first time I came across a learner with colour vision deficiency. I was able to help her change the background colour of her mobile game by changing the image file very easily. But this experience ignited my passion for accessibility, which has led to the creation of the accessibility awareness course and championing accessibility at UCEM.

As an international student studying at the University of Reading, I experienced how difficult it was to learn in a second language among those who are native speakers of the language. There were many words that I had never heard of used in discussions. I vividly remember looking up the word "diaspora" in a postgraduate taught class as I had never heard of this word before. While others think less of people with accents, I believe they are very brave to be working in a second or subsequent language. This applies to many of our international students studying with us. They may hesitate to ask or answer questions in a webinar but that does not mean they are not engaged. It could be cultural as well as lacking the confidence to speak in front of others in a second or subsequent language. I can relate to this from my own experience.

The ability to post questions, thoughts in an asynchronous way where you can take time to compose your reply could be an opportunity for those learners to engage. On the other hand there could also be the barrier or the fear of being seen as the one to have posted the "imperfect" response which is going to be on the VLE forever. We at UCEM are investigating the possibility of offering anonymous posts to forums in an attempt to encourage students who are lacking the confidence to post. UCEM has a branch in Hong Kong and students who join us from there are very reluctant to engage actively. However, we also have a duty of care to prevent any abuse on forums. Therefore, this has to be done with great care.

Sometimes things beyond you dictate what can or can't happen. When I launched the face-to-face accessibility workshops at UCEM, they were very successful. We always had full participation in the sessions. I did a very successful activity at the start of the workshop to show the need for accessible content. The task was to navigate to UCEM website's accessibilty statement blindfolded using the Windows Narrator. Everyone struggled to just use the keyboard to navigate to the said page. This was very impactful.

However, as the Covid restrictions were imposed we had to move online. Therefore, I could not ask participants to do this task on their own because even in the face-to-face sessions they needed lot of help. Instead, I created a video to show how a screen reader works, which I then shared in the session.

When the accessibility awareness course was launched there was sudden flurry of activity and badge earning. However, this died down. I realised that the staff who are too busy to invest the time are reluctant to go into the course because it is available indefinitely they procrastinate. I organsied an accessible colour workshop which was 40 minutes and within two hours of the workshop six accessible colour badges were earned on the course. These six learners participated in the session and then completed the accessible colour component of the course and subsequently completed the whole course. This shows that the UCEM staff requires an impetus or stimulus to get them started. So I am planning to run a few more accessibility online sessions where I can direct the staff to the online accessibility course.

Take-home message here is whether it is online or in-person you need to know your learners. You have to empathise with them and understand your learners, their backgrounds, and their experiences to be a good educator/facilitator.

Reference

Butcher, John (2015). 'Shoe-Horned And Sidelined’? Challenges For Part-Time Learners In The New HE Landscape. Higher Education Academy, York.

Karwowska, A., & Tse, S. (2019). Keeping busy learners informed: email is most useful for medical residents!. Canadian medical education journal, 10(3), e78–e81.

Royal College of Physicians. (2018). Never too busy to learn. London: RCP.