As part of our systematic program evaluation, we engage in systematic follow-up studies of our graduates, as well as their supervisors and employers. We request feedback from graduates via an alumni survey that we collect two years after graduation. We also submit feedback surveys to professional supervisors in the area known to work with our graduates, and a separate survey to employers who frequently employ our graduates. Below is a summary of our review of these data and any subsequent programmatic changes.
Systematic Follow-Up Studies: Graduates
We review our alumni survey data during our annual Data Review Day prior to the start of the Fall term, and continue to discuss these data in follow-up department meetings. The survey is sent out to alumni who graduated two years prior. In our most recent alumni survey (for which responders graduated in June, 2020), approximately 67% of responders reported being employed in a position directly related to their training program. Responders noted a range of program strengths, most often involving a) diversity of fellow cohort students, and b) training on multicultural considerations. Responders also noted several areas they would like to see improved in our program, including a) more coursework on trauma, and b) more advanced clinical skill training. As a result of this feedback, our department has taken the following steps:
Focus on advanced clinical skill training in Practicum
Offering additional trauma-related elective coursework
Systematic Follow-Up Studies: Supervisors
We send a survey annually to clinical supervisors in the area known to work with our alumni. For context, in Oregon, the post-masters, pre-licensure process takes a minimum of two years and generally averages two-to-four years. As such, supervisors who complete the survey are generally reflecting on the work of supervisees with zero-to-four years of professional clinical experience. In our most recent Supervisor Survey, supervisors were highly positive of their supervisees who graduated from our program. They quantitatively rated our graduates as having advanced competence with regard to working with diverse populations and to use evidence to guide clinical decisions. Qualitatively, supervisors frequently noted strengths in our graduates with regard to multicultural competence, addressing issues of equity diversity and inclusion, social justice orientations, and overall clinical skill relative to graduates from other programs. In terms of growth opportunities, some areas noted included practical applications of counseling theory, understanding and working with insurance reimbursement, and issues of self-care and work/life boundaries. In terms of action steps, department faculty are presently discussing ways we can enhance training in these areas.
Increase the response rate and overall sample size of this survey.
Systematic Follow-Up Studies: Employers
We send a survey annually to employers in the area known to regularly work with our alumni, mostly including P-12 school systems, community mental health agencies, and other agency-based providers in outpatient and inpatient settings. In our most recent Employer Survey, employers were positive of our graduates. They quantitatively rated our graduates as having advanced skill competence overall. Qualitatively, employers frequently noted strengths in the well-rounded nature of our training and with regard to multicultural competence. In terms of growth opportunities, issues noted included professional confidence and a desire for more focus on multicultural counseling considerations. Based on our review of the employer survey, we have determined the following action step:
Increase the response rate and overall sample size of this survey. To do so, next year we are planning to incentivize participation via a gift card drawing. We are also going to add a question to our alumni survey asking alumni if they are willing to provide contact information for their present employer.