Evaluation Approach

Identification and Description of the Evaluation Approach

The approach that will be taken for this impact evaluation is an 'evaluation for learning and use', more specifically known as Utilization-Focused Evaluation (UFE). This approach is based "on the principle that an evaluation should be judged on its usefulness to its intended users" (Better Evaluation, n.d.).

As explained by Greene (2017), this approach is flexible in that it focuses on the evaluation questions themselves - and the evaluation design is created to fit these questions. In this way, UFE serves to impact and contribute to the quality of the program and the usefulness of the evaluation itself. Thus, it is an extremely practical approach to program evaluation since it values learning and utilization.

Furthermore, UFE focuses on positively impacting the learning and experiences of human resources involved in the program: the participants, the leadership and the staff. Like impact evaluation, the UFE approach aims to "benefits future programs and policy" (Unite for Sight, n.d.).

Rationale for this Approach

Impact evaluation determines whether a program is attaining its goals and objectives. This can be done quantitatively or qualitatively and can be done pre and/or post-program to measure to short terms goals. It can also look at the sustained effectiveness of a program over time. Impact is defined as ‘a strong effect on someone or something’, which means that impact evaluation assesses the effect that a program is having on its subject and goals.

Hence, since The Grocery Foundation's School Breakfast Program is an intervention that relies on the cooperation, commitment and front-line work of many diverse stakeholders, UFE is a very fitting approach for this evaluation. Unique to this approach is the fact that its intended audience are the stakeholders beyond the policy-makers.

This approach is aimed at contributing to the quality of the program and providing learning for the leadership, staff and "people on the ground" (Greene, 2007) of a particular program. For a program like The Grocery Foundation's School Breakfast Program, wherein the stakeholders are so intrinsically involved in every level of the program, UFE will result in an extremely meaningful and impactful experience for all.

How this Approach Will Operate in the Program Context

There are many layers of stakeholder involvement in The Grocery Foundation; these stakeholders work to ensure that the program runs on both the macro and the micro levels. Whether it is selling tickets for the yearly gala, namely A Night to Nurture, or toasting bread every morning at a specific school site, the program relies heavily upon the "meaningful and consequential experiences of the people in the program" (Greene, 2017). The program also addresses the needs of its participants, namely the school-aged children who rely on its day-to-day operation.

Thus, an evaluation that is aimed at learning would allow stakeholders and participants to benefit from the evaluation in many different ways. These people would have the opportunity to share their voices during the evaluation process, and also utilize the findings of the evaluation to improve the operation and experience of the program.

Specifically, within the UFE approach, "the evaluator’s job is not to make decisions independently of the intended users, but rather to facilitate decision-making amongst the people who will use the findings of the evaluation" (Better Evaluation, n.d.). The intended users, in this way, will be active rather than passive agents in the evaluation.

Specific Key Evaluation Questions

In her video, Greene (2017) reinforced the idea that, when using the 'Evaluation for Learning and Use" approach, the questions themselves are central to the practice, not "the technical quality of the design and methods." This means that the evaluation design is not only flexible, but it is shaped around the evaluation questions.

With that said, according to The Rainbow Framework (2018), the key questions within an evaluation should assess whether the program is appropriate, effective and efficient. Hence, the specific key evaluation questions for impact evaluations are as follows.

• How well did the program work?

• Did the program produce or contribute to the intended outcomes in the short, medium and long term?

• For whom, in what ways and in what circumstances? What unintended outcomes (positive and negative) were produced?

• To what extent can changes be attributed to the program?

• What were the particular features of the program and context that made a difference?

• What was the influence of other factors?