Sub - CPMK 2

CIPP (Context, Input, Process, Product)

The CIPP Model (Context, Input, Process, Product) is a detailed framework for evaluating programs systematically. It begins with the Context phase, which looks at the background, needs, target groups, problems, and environmental factors that justify starting the program. The Input phase focuses on planning elements, including stakeholder participation, strategy choices, budget allocation, program scope, relevant research, and resources such as Material, Man, Machine, and Money. The Process phase evaluates how the program is carried out and managed, reviewing development activities, monitoring systems, and feedback effectiveness. Finally, the Product phase assesses the program’s results by measuring impact, overall success, transferability, sustainability, and identifying areas for improvement or necessary changes. 

JICA Training Evaluation

Here is a detailed paraphrase of the Five Steps of Training Evaluation by JICA and Kirkpatrick’s Four Levels of Evaluation:

1. Identify the Purpose of Evaluation
   The initial step is to clearly define the reasons for conducting the evaluation. This involves understanding whether the goal is to determine if the training met its objectives, enhanced participants’ abilities, or addressed specific performance improvements. Clarifying the evaluation’s purpose ensures the process is focused and relevant.

2. Select the Evaluation Method
   After the purpose is set, evaluators decide which data collection methods will best capture the necessary information. These methods can include surveys, interviews, observations, or tests. Choosing the right method aligns the data-gathering approach with the evaluation goals.

3. Design Evaluation Tools
   In this phase, evaluators create the instruments required for data collection, such as questionnaires, forms, or rubrics. These tools must be carefully designed to ensure systematic, reliable, and valid data gathering that accurately reflects participant experiences and training outcomes.

4. Collect Data
   This step involves gathering information from all relevant parties—participants, trainers, and stakeholders—regarding their experiences, engagement, and results during and after the training sessions. Comprehensive data collection provides a solid foundation for meaningful analysis.

5. Analyze and Report Results
   Finally, the collected data is thoroughly examined to extract key insights. The evaluator interprets the findings, prepares a detailed report including conclusions, and offers actionable recommendations to enhance future training programs. This ensures the evaluation process supports continuous improvement.

Kirkpatrick’s Four Levels of Evaluation expand on these steps by examining training impact in depth:

Level 1 (Reaction) measures participants’ immediate satisfaction and engagement with the training, often using feedback forms.

Level 2 (Learning) evaluates the increase in knowledge, skills, or attitude changes through assessments like tests or demonstrations.

Level 3 (Behavior) assesses how well participants apply their new skills in the workplace, indicating the transfer of learning.

Level 4 (Results) looks at the broader organizational effects, such as productivity gains, quality improvements, and employee satisfaction.

Conclusion

Both the Five Steps of Training Evaluation by JICA and Kirkpatrick’s Four-Level Model emphasize the need for a thorough and systematic approach to assessing training programs. JICA’s five-step process offers a clear, practical roadmap for carrying out evaluations, starting from defining the evaluation’s purpose to analyzing data and reporting results. Kirkpatrick’s model complements this with a conceptual framework that explores training effectiveness across four levels—participants' reactions, learning achievements, behavior changes in the workplace, and overall organizational impact. Together, these methods provide a comprehensive means to evaluate both immediate and long-term outcomes, ensuring training programs are not only effectively measured but continuously enhanced for greater success.

The manual is one of six training operation and management manuals developed under the PILAC project.
Its primary purpose is to provide guidance on how to evaluate training programs and how to prepare training reports, ensuring that each training activity is directly connected to capacity-development objectives and that lessons learned can be applied to improve future training cycles.

The manual acknowledges that training evaluation represents the final stage of the Training Management Cycle—which consists of Planning → Implementation → Evaluation.
The insights and findings gained from evaluation are then used to inform and enhance the next planning phase, creating a continuous process of improvement.

The Five Steps of Training Evaluation

Regarding the Five Steps of Training Evaluation, the manual organizes the evaluation into five orderly phases aimed at promoting consistent assessment and learning:

> Identify the Purpose of Evaluation
This first step requires clearly defining why the evaluation is being done. This could include checking if the training met its goals, how participants apply what they learned, measuring changes in behavior or final results, spotting program strengths and weaknesses, and maintaining accountability to stakeholders. The purpose helps determine what data to collect, the timing, and methods.

> Select the Evaluation Method
The manual incorporates Donald L. Kirkpatrick’s well-known four-level model focusing on Reaction, Learning, Behavior, and Results as essential aspects of training effectiveness. It also stresses the value of participatory, collaborative evaluation methods that actively involve stakeholders and encourage organizational learning through shared reflection and feedback.