Piloting and evaluation
TIMING: from 11th September 2023 to 30th May 2025
Project pages 45-50
Main objectives:
Test Videos 1, 2, 3 (5 teachers)
Test Videos 4, 5, 6 (5 teachers)
Test Videos 7, 8, 9 (5 teachers)
Create visualization reports for evaluation
Pilot the videos with a group of students (number 20)
Agree video enhancements among all partners
Design video evaluation forms
Create Decision Tree Evaluation Form
Create scenarios display reports
Create virtual meeting satisfaction surveys
Create satisfaction surveys of transnational meetings
Create evaluation forms on the LTT
Create LTT satisfaction surveys
Create pre-screening forms for LTTs and multiplier events
Create Post-Assessment Forms for LTT Multiplier Events
Design satisfaction surveys for multiplier events
Indicators for WP4
For the dossiers and the evaluation forms of the videos, the following indicators will be taken into account:
- Load time, that is, the time it takes to load the video completely in the viewer, in order to discern which type of internet connection is better.
- Resolution, image quality and sharpness.
- User experience, if it is easy to navigate and the experience is fluid and intuitive.
- Immersion, depth and perspective.
- Time that has been used to follow the entire video
- Information; Hot spots provide necessary information, they provide too much information...
Indicators for decision trees:
- the objectives are clear
- all decision options are identified
- assigned criteria
- assigned values
- clear display of options
Meeting satisfaction questionnaires should have indicators such as:
- Satisfaction scales, duration, participation of the different partners, ideas for improvement, objectives achieved The pre-evaluation and post-evaluation reports will contain very specific questions about the contents of different procedures that appear in the 360º videos and the stations in order to make a report objective of what are the benefits fo the technologies proposed in this project compared to more traditional educational methodologies.
Tasks and roles for partners
Cal·lípolis: Create templates, video testing, reports testing, students piloting on videos, students report, pre-evaluation and post-evaluation of LTT
KVK: Create templates, video testing, reports testing, general evaluation reports, satisfaction surveys, analysing surveys, questionnaires delivery
FLX: video testing, reports testing, students VR scenarios testing, students report, questionaires delivery
Budget for WP4: 29,000€
Cal·lípolis: 9,000€
Details:
Creation of documents for piloting and evaluating: 5,000€
Reports on teachers piloting videos 2,000€
Report on students piloting videos 500€
Quality report of Tree decision quality: 500€
Report comparing methodologies: 500€
Reports multiplier events: 500€
FLX: 6,500€
Details:
Reports on teachers piloting videos 2,000
Quality report of Tree decision quality: 1000€
Reports of VR scenarios piloting: 3,000€
Reports multiplier events: 500€
KVK: 13,000€
Details:
Creation of documents for piloting and evaluating: 5,000€
Reports on teachers piloting videos 2,000
Analysis and reports of the quality management of the different steps in the project: 5,000€
Quality report of Tree decision quality: 1000€
OneBonsai: 500€
Details:
Quality report of Tree decision quality: 500€