ELRC 7501 Evaluation in Educational Technology

Module 4: Evaluation Models & Data Sources

Module 4 focused on the selection of evaluation models and data sources that align with our project goals. This step was critical in ensuring that our evaluations accurately measures what it intends to. We also reflected on how the choice of data sources impacted the reliability and validity of our evaluations, exploring the balance between data quality and practical constraints. These reflections deepened our understanding of evaluation integrity and effectiveness.

I went with Option 1 and created an infographic showcasing 2 different Evaluation Models, I'll explain my model and data source choices.

I went with the CIPP Model (Context, Input, Process, Product) because it provides a structured and ongoing evaluation framework that aligns with the objectives for my program. The CIPP Model allows for context evaluation (C), which ensures that the program addresses actual needs in PE, input evaluation (I), which ensures that resources like the actual Ed Tech & training are appropriate, process evaluation (P), which identifies strengths and areas for improvement in implementation, and product evaluation (P), which measures short- and long-term impacts on learner fitness and engagement. This continuous assessment makes it so the program continues to evolve based on data-driven feedback and insights, making it adaptable.

The CIPP model, combined with reliable data sources, strengthens the assessment by providing a comprehensive approach, from program design to final outcomes, ensuring a stream of feedback, allowing real-time adjustments for improvement. It uses a mix of quantitative and qualitative data, so it's a well-rounded evaluation, and it minimizes biases and errors through the use of different data types. This all helps in ensuring long-term success when integrating technology into PE.

The data sources in the infographic ensure accuracy and validity through multiple methods. Wearable fitness devices provide objective, real-time tracking of learner activity levels, minimizing human biases. Teacher and learner surveys offer qualitative insight into engagement, using standardized questions to ensure consistency. Classroom observations document how well technology is integrated into PE instruction, verified through multiple observations. The observations should be done by trained evaluators, so admin will have to have some time in PD to know what to look for. Often times during observations admin has no idea what's going on or what to look for. Learner fitness assessments provide measurable data on physical improvements over time, aligning with national PE standards. Program participation logs ensure technology use is accurately recorded across different PE classes. By combining objective and subjective data sources, the evaluation maintains reliability.