What is it? A measure of the accuracy with which the independent variable is instituted as planned
Why do we measure it? Without this information, it would be difficult to tell if the plan is working. If we are not getting the results we hoped for, it is important to be able to determine if the plan has even been implemented as intended.
How do we measure it?
Teacher Self-Report survey for all staff
Direct Observation completed by observer and teacher for 25% of instructional staff
Tiered Fidelity Inventory (optional for schools)
When do we measure it? At least once each school year, fall (required) and spring (optional).
What is it? The social significance of the goals, the social acceptability, and the social importance of the effects produced
Why do we measure it? This information helps schools reach consensus on what areas to target, establish the difference between where we are and where we want to be, and inform professional learning.
How do we measure it?
Primary Intervention Rating Scale (PIRS) survey for all staff
When do we measure it? At least once each school year, fall (required) and spring (optional).
Each school will be send a randomized staff list from Director of Academic Intervention.
This will tell you how many teachers to observe at each grade level/dept. and what order you will observe them.
Groups include one for each grade level, general education teachers (related arts, support staff) and special education teachers.
Print copies of the rubric for observers. Teachers who are observed do not need copies of this.
Be sure to know the master schedule, room numbers, and any absences before beginning the process described next.
Go to the classroom of the staff member listed as #1 on the randomized staff list. You may begin at any grade/dept.
If the teacher has a sub or they will not be teaching the day/time you observe, you can skip. When possible, try to adjust your schedule to avoid too many skips.
During spring observations, it is preferred that schools observe the same teachers as in fall whenever possible.
Use the full rubric and the digital form to rate the teacher as instructed during calibration. Spend approx. 30 minutes observing. Submit the digital form.
After the observation, ask the teacher to rate themselves using the digital form or paper copy of the teacher rating scale.
If it is not a conducive time for them to rate, leave a paper copy of the rating scale for them to complete. Return later in the day to collect it and then enter the paper scores into the digital form.
Turn in any paper copies of forms, rubrics or randomized lists to your Ci3T AP Coach.
To train future observers, they must go through the calibration process with someone who calibrated with district trainer. For example, a principal who calibrated with district trainer could then train members of the Ci3T Leadership Team by calibrating. Periodic recalibration is recommended.
Director of Academic Intervention will create school-specific reports with your data after the observation window closes.
It is a best practice to share this data in a staff meeting to celebrate accomplishments and determine areas for professional learning.
The school can use this data to inform any action plans they would like to create as a result of this data. This may also be used to support school or district strategic planning goals.
Alert staff that surveys will be sent from the district from noreply@qemailserver.com.
If possible, schedule a staff meeting or dedicated time for staff to complete the surveys in order to increase response rates.
District will email survey link that embeds two survey collection tools:
Teacher Self-Report: This is a treatment integrity resource and aligns with the data collected in the direct observations.
Primary Intervention Rating Scale (PIRS): This is the social validity measure.
Anyone who does not receive survey or who is unsure if it was completed can contact the Director of Academic Intervention.
Regular reminders will be sent to non-responders until the survey window closes. These windows are established for fall and spring and will be communicated annually.
Director of Academic Intervention will create school-specific reports with your data after the surverys are complete.
It is a best practice to share this data in a staff meeting to celebrate accomplishments and determine areas for professional learning.
The school can use this data to inform any action plans they would like to create as a result of this data. This may also be used to support school or district strategic planning goals.