Introduction Video
Dr. Paul Lynch
University of Glasgow
Slideshow presentation on Measuring Training Outcomes for Emplyoment
Many persons with disabilities face multiple barriers to labour market participation and encounter high levels of disadvantage, which converge to increase the likelihood of low confidence and self-esteem. It is important for projects to not only address common barriers such as long term unemployment or low literacy and numeracy levels but also low-esteem and lack of lack confidence in young persons with disabilities when providing training for those furthest away from from the labour market. Young persons furthest from the labour market often require intensive support and specialist interventions in key areas including developing assistive technology skills, mobility skills, ability to communicate needs and associated adjustments to potential employers. Projects, therefore, need to work towards measuring these outcomes to show the real and full impact of their efforts.
‘Employability skills’ focus on the personal, social and transferable skills seen as relevant to all jobs, as opposed to job specific technical skills or qualifications. The acquisition of employability skills may be seen as a necessary first step in path towards long-term employment.
Measuring outcomes is essential for improving quality. Outcomes frameworks provide a context for defining relevant outcomes and performance indicators. They provide a means of accountability to the government, commissioners and providers. They can also act as a catalyst to drive up quality by encouraging a change in culture and behaviour. With pressure on resources and funding, services are expected to combine clinical outcomes with other service level outcomes such as efficiency, productivity and safe practice.
There is interplay between indicators and outcomes, in that indicators are the means by which we can measure whether the outcomes have been achieved. The term soft indicators therefore can be used when referring to the achievements which may ‘indicate’ acquisition or progress towards an outcome. A project may wish, for example, to explore whether an individual’s motivation has increased over the length of the project or intervention. However, this is, to all intents and purposes, a subjective judgement, indicators (or measures) such as improved levels of attendance, improved time keeping and improved communication skills, can suggest strongly that motivation has increased. Not all indicators will be suitable for all target groups, and some will be target group specific, for example persons with disabilities.
This module looks at ways of measuring training outcomes for employment purposes of persons with disabilities. It covers some of the main ideas and debates about measuring outcomes related to being ‘work ready’ or moving towards a position of being ‘work ready’.
Persons with disabilities are less likely to be employed and face barriers to employment opportunities. This is particularly the case for persons with learning disabilities who experience higher rates of being economically inactive compared with persons who have other disabilities. Employment is not the responsibility of any single service or department. Employment levels for people with learning disabilities remain low, with less than 10% of people in the UK known to services in paid work and very few of them working more than a few hours a week of people with learning disabilities can only improve if there is a shared expectation that they can and will work, and if the adjustments are made in the way services work together to achieve this.
The Sustainable Development Goals (SDGs) explicitly include persons with disabilities in several of their targets and indicators, including on full and productive employment and decent work. To measure the progress of countries in achieving the SDGs and effectively include people with disabilities in their efforts it is crucial to disaggregate labour market statistics and other data by people’s disability status. The International Labour Organisation(ILO) is promoting the inclusion of the Washington Group on Disability Statistics methodology in the application of labour force surveys. Furthermore, the ILO has drafted a dedicated module on persons with disabilities to be used in labour force surveys. Finding reliable data on the employment of persons with disabilities is difficult to find globally, but there is a strong need for employers to understand the benefits of not only employing non-disabled persons.
There are few tools that have been adapted to training and employment contexts in low and middle income country contexts, but there are some universal principles that can be applied to measuring the extent to which a project or training programme has created new opportunities for persons with disabilities to prepare for the labour market. The most useful tool below is a ‘Guide to measuring outcomes and distance travelled’. This guide sets out useful ways to inform the development of a specific soft outcome monitoring system tailored to the organisation’s aims and objectives. Secondly, the Network for Europe, in ‘A practical guide to measuring soft outcomes and distance travelled’ has produced helpful guidelines on how to draft indicators.
Given the broad range of specific needs of the participants on the project, it is important to consider a range of outcomes which could be linked to increasing levels of confidence or reducing depression as a result of not being actively involved in seeking an employment or work-related experience. The ESRC-GCRF Inclusive Employment and Social Participation Bhutan project has implemented an adapted employment assessment tool which measures distance travelled which is a term used to measure the progress that a person makes towards employability or harder outcomes, as a result of an intervention. Methods to measure outcomes and distance travelled are numerous and varied and we must reiterate that one system will not suit all. What may work well for one project may not work for another. The system that you choose, and how you implement, will depend very much on the activities and objectives of your project, your target group, the length of the project, and the resources you have at your disposal. The options we provide here represent some of the methods you may wish to consider when designing a soft outcome monitoring system for your project.
Some examples of ways to measure employability skills include:
baseline and subsequent interviews with learners/assessors
self-completion questionnaires
personal journals
tests
portfolios
staff assessments/ reviews
numerical scaling to track progress (i.e. rating perceived skills from 1 to 10 at baseline, exit and possibly points in between)
recorded observations of learners applying skills in work-based scenarios •
commercially developed tools
More generally, it is highly desirable that tools are easy to administer and meaningful to participants and do not cause added distress.
During the ESRC-GCRF Inclusive Employment and Social Participation Bhutan project, we were able to follow the progress of individuals who had benefited from microfinance to set up their own enterprise or work project. Please watch a short interview and observation of Suk Raj.
The 3 videos uploaded feature Suk Raj Lepcha, a micro grant recipient of the ESRC-GCRF Bhutan project. Suk Raj was born with physical challenges and discarded by his parents. His maternal uncle took care of him and supported him in pursuing schooling until grade 12. After his higher secondary education, he was interested in finding skills and vocational trade that could match his abilities. Knowing that there are no particular skills or vocation training available that he could pursue, he was keen on finding employment. Upon meeting during our initial research survey, Suk Raj has constantly kept in touch with project personnel and sought mentoring on what could be possible for him to begin independent living. His proposal was selected for micro-grant funding of a Printing Shop in a remote community called Gesarling under Dagana Dzongkhag. With the micro-grant, he currently runs a Print Shop where services like printing, photocopying, lamination and online public services are provided. Suk Raj owns and runs his print shop for the last 6 months now. He has accumulated a profit of Nu. 7500 ($100 USD) after deducting all his expenses.