Adaptive Evaluation
A Complexity-Based Approach to Systematic Learning for Innovation and Scaling in Development
IMAGO
Year: 2022
A Complexity-Based Approach to Systematic Learning for Innovation and Scaling in Development
IMAGO
Year: 2022
English
Exploratory/Prototyping Phase - this phase involves the initial design and testing of an intervention on a small scale. It includes rapid prototyping, iterative learning, and refining based on feedback to develop a robust design.
Experimental/Piloting Phase - during this phase, the intervention is implemented on a slightly larger scale than the exploratory phase to test its effectiveness and feasibility in different settings. This phase aims to refine the intervention further before a broader rollout.
Pilot - a small-scale implementation of an intervention designed to test its feasibility, effectiveness, and impact. It helps identify potential issues and refine the intervention before broader rollout.
Test - involves evaluating an intervention under real-world conditions to determine its effectiveness and identify areas for improvement. It is a critical step in the iterative process of refining and scaling innovations.
Partnerships - involve collaborating with other organizations or entities to expand the reach and impact of an intervention. This approach combines resources, expertise, and networks to facilitate scaling.
Adaptive Leadership - refers to the ability to guide and manage change in complex environments. It involves creating conditions that enable innovation, learning, and adaptation to address emerging challenges and opportunities.
General Theory Of Behaviour - this theory provides a broad understanding of how people behave in relation to the problem being addressed by the intervention. It includes foundational principles and assumptions about human behaviour that guide the design of the intervention.
Specific Theory Of Behaviour - specific theories of behaviour are detailed explanations of how particular interventions are expected to influence the behaviour of target populations. These theories are tailored to the specific context and objectives of the intervention.
Needs Assessment Of Organisation - identifies the gaps and requirements within an organisation that need to be addressed to successfully scale an intervention. It includes evaluating capacities, resources, and readiness for scaling.
Interpretation Of System - this involves understanding the history, theories, and characteristics of the system in which the intervention is implemented. It includes mapping out the system's components, relationships, and dynamics to inform the evaluation and adaptation processes.
Interpretation Of Processes - this refers to analyzing how processes within the system function, including identifying enablers and resistors to change, feedback loops, and the interaction of various components. This understanding helps in refining and scaling interventions
Assessing Innovation - assessing innovation involves evaluating the design, implementation, and impact of new ideas or interventions. It includes prototyping, testing, and refining the innovation to ensure it meets the desired objectives and can be effectively scaled.
Systems Mapping - systems mapping involves creating visual or conceptual representations of the components, relationships, and dynamics within a system. It helps identify key actors, feedback loops, and potential points of intervention.
Descriptions Of The Context - this refers to detailed accounts of the environment in which an intervention is implemented, including historical, social, economic, and political factors that may influence its effectiveness and scalability.
System Diagnosis Of Potential Regions To Scale - this involves analysing different regions to understand the factors that may influence the success of scaling an intervention. It includes identifying enablers and resistors to change, local needs, and capacities.
Building Learning Mechanism - involves creating systems and processes that facilitate continuous learning and improvement. This ensures that feedback is regularly collected and used to refine and enhance the intervention.
Building Feedback Mechanism - involves establishing processes to collect, analyse, and act on feedback from stakeholders and beneficiaries. This helps in making necessary adjustments to the intervention during scaling.
Initial Rollout - the initial rollout refers to the first broad implementation of an intervention after the prototyping and piloting phases. It aims to test the intervention on a larger scale while still allowing for adjustments based on feedback.
Intermediate Rollout - this phase involves expanding the intervention to a broader audience or additional regions. It focuses on further refining and standardising the intervention to ensure consistency and effectiveness across different contexts.
Large Scale Rollout - the large-scale rollout is the final phase of scaling up, where the intervention is implemented on a wide scale, often nationally or internationally, ensuring it reaches a substantial part of the relevant population.
Evaluations - evaluations are systematic processes to determine the effectiveness, impact, and sustainability of interventions. They involve assessing processes, outcomes, and contexts to inform decision-making and improve future implementations.
Adaptive Evaluation - an adaptive evaluation is an approach that combines elements of realist and developmental evaluations, focusing on understanding the context, supporting innovation, and facilitating scaling. It emphasises continuous learning, adaptation, and the use of various techniques depending on the complexity of the task.
Overall Theory Of Change - an overall theory of change outlines the pathways through which an intervention is expected to lead to the desired outcomes. It includes assumptions, intermediate steps, and the relationships between different components of the intervention.
Hypothesis Testing - hypothesis testing involves systematically evaluating specific predictions about the outcomes of an intervention. This process helps determine whether the intervention is having the expected effects and informs adjustments.
Data Assessment - data assessment is the process of collecting, analysing, and interpreting data to evaluate the effectiveness of an intervention. It includes identifying relevant data sources, ensuring data quality, and using data to inform decision-making.
Reflect - the process of critically analysing the outcomes and processes of an intervention to understand what worked, what didn’t, and why. It informs future decisions and adjustments to improve the intervention.
Scaling Up - process in which innovations are extended to reach a substantial part of the relevant population.
Adaptation Phase - the adaptation phase involves modifying the intervention based on feedback from initial implementations to better fit different contexts and address any emerging challenges.
Scaling - scaling is the process of expanding the reach and impact of an innovation, ensuring it affects a larger population. This involves adaptation, standardization, and addressing challenges that arise as the intervention is implemented in new contexts.
Development Of Scale-Up Strategy - this refers to creating a comprehensive plan to expand an intervention. The strategy includes identifying the most appropriate methods of scaling, such as expansion, replication, or partnerships, and addressing potential challenges.
Expansion - a method of scaling up that involves growing the current operations of an intervention to reach a larger population or new regions.
Replication - replication concept is implemented effectively in different contexts
Adapt Design And Process For Scale - involves modifying the design and implementation processes of an intervention to ensure it can be effectively scaled. It includes making necessary changes to fit new contexts and addressing any emerging challenges.
Adaptive Implementation - involves using flexible and iterative approaches to put interventions into practice. It emphasises rapid prototyping, experimentation, and continuous learning to adapt to changing contexts and need.
How can we test our new idea on a small scale to see if it works?
How can we try out our project with a few people to see if it’s effective?
How can we try out our project with a small group before using it everywhere?
How can we check if our project works in real life?
How can we work with other people or groups to make our project bigger?
How can leaders help guide changes and improvements in our project?
What are some basic ideas about how people usually act?
How do we think people will act in this particular situation?
What does our group need to make our project bigger?
How can we understand all the parts and people involved in this project?
How can we understand how different parts of our project work together?
How can we check if our new idea is working and useful?
How can we draw a picture to show how all the parts of our project connect?
How can we explain the environment where our project is happening?
How can we figure out which places would be good for expanding our project?
How can we set up ways to keep learning and getting better at our project?
How can we get and use feedback to improve our project?
How can we start using our project with more people for the first time?
How can we expand our project to even more people after the first try?
How can we spread our project to a very large number of people?
How can we check if this project is working well?
How can we learn and improve our project continuously as we go?
How do we believe our project will make things better?
How can we test our guess to see if it's correct?
How can we collect and look at information to see if our project is working?
How can we think about what went well and what didn’t in our project?
How can we make this project bigger so more people can benefit from it?
How can we change our project to make it better for different situations?
How can we grow our project to help more people?
How can we make a plan to grow our project?
How can we make our project bigger?
How can other places or groups use our project idea?
How can we change our project so it works well when it's bigger?
How can we put our project into action in a flexible way that allows us to make changes as needed?