TFI 3.14 EVALUATION: Data Systems

Aggregated (i.e., overall school-level) Tier 3 data are summarized and reported to staff at least monthly on (a) fidelity of support plan implementation, and (b) impact on student outcomes.

Valued outcomes are specified, endorsed, emphasized and monitored frequently and regularly because of their social and educational significance.

TFI 3.14 Big Ideas

As defined in:

  • TFI 3.2, the Tier 3 Systems Planning Team meets monthly to review data for the purpose of supporting each unique Student support Team and identify new students.

  • TFI 3.14, the Tier 3 Systems Planning Team meets monthly to review plan implementation fidelity data and student outcome data for the purpose of making informed decision regarding plan implementation supports and reporting data back to the staff.

This process will provide a higher level of accountability and support to the Tier 3 Systems Planning Team.

Plan Fidelity

Fidelity data measures the degree to which the elements of the plan are being implemented consistently and correctly. Measuring fidelity is an extremely important part of plan implementation and assists the Tier 3 Systems Planning Team and Unique Student Support Team in determining the effectiveness of the supports and modifications being made.

Fidelity data will be collected by the Tier 3 Consultant throughout plan implementation. The Tier 3 Consultant will use the Plan Fidelity Form to collect implementation data.

Through observation and discussion the Tier 3 Consultant and staff member responsible for plan implementation, will assess execution of: Environmental Modifications, Rewards/Reinforcers, Reactive Strategies, and Tier 2 Supports/Interventions.

Each behavior plan will be scored for overall implementation:

Full Implementation = a score of 100 - 80%

Partial Implementation = a score of 79-50%

Not in Place = a score of less than 50%

Each month Tier 3 Consultants will review each active plan's fidelity data with the Tier Three System's Planning Team for the purpose ensuring student's are receiving Tier 3 supports in the manner the plan intended.

Overall results of the total number of plans implemented with Full, Partial or Not in Place will be shared with the staff monthly. It is important to note that total numbers, not student names, be shared in this larger forum.

Student Outcome Data

Student outcome data refers to the desired learning skills that unique Student Support Teams want students to achieve.

Each month Tier 3 Consultants will gather student outcome data daily/weekly/monthly. As part of the monthly Tier 3 Systems Planning Team meetings each Tier 3 Consultant will review their assigned students' outcome data with the Team.

Additionally the total number of students making positive/questionable/poor progress towards their goals should be shared with staff monthly. It is important to note that total numbers, not student names, be shared in this larger forum.

There are multiple ways the Tier 3 Consultant and Team can gather, track and analyze student outcome data.

To the left Teams will find fillable google documents that can be used to both collect total numbers and graph student progress towards their goals.

To the right is a link to the Advanced Tiers Spreadsheet (google sheets). This instrument can be used to track the data of up to 20 students who are on behavior plans. By using this spreadsheet Teams can look at multiple students at a time.

Regardless of which tool Teams decide to use, ALL student data must be reported back to staff monthly.

How to Score 2 Points on TFI 3.14

To receive a 2 Point Score Teams must be able to say yes to the following set of questions.

a) The Tier 3 Systems Planning Team adopted a tool to track fidelity to behavior plan implementation - i.e., Plan Fidelity Form,

b) Each Tier 3 Consultant collected and analyzed implementation fidelity data for each of their assigned students,

c) The Tier 3 Systems Planning Team reviewed implementation fidelity data for all students on a behavior plan each month,

d) The Tier 3 Systems Planning Team shared implementation fidelity data with staff monthly,

e) The Tier 3 Systems Planning Team adopted a tool to track student outcome data - i.e., Student Outcome Data Collection Form/Student Outcome Data Graph or The Advanced Tiers Spreadsheet

f) Each Tier 3 Consultant collected and analyzed student outcome data for each of their assigned students,

g) The Tier 3 Systems Planning Team reviewed student outcome data for all students on a behavior plan each month, and

h) The Tier 3 Systems Planning Team shared student outcome data with staff monthly.

2 Point:

Data are collected on student outcomes AND fidelity and are reported to staff at least monthly for all plans.

1 Point:

Data are collected on outcomes and/or fidelity but not reported monthly.

0 Point:

No quantifiable data.

Information adapted from: MO-SWPBIS Handbook/Tier Three Implementation Guide; Center on PBIS/PBIS.orgImages obtained from Google Images and/or created by J. Patrick