TFI 3.17 EVALUATION: Annual Evaluation
At least annually, the Tier 3 systems team assesses the extent to which Tier 3 supports are meeting the needs of students, families, and school personnel; and evaluations are used to guide action planning.
Valued outcomes are specified, endorsed, emphasized and monitored frequently and regularly because of their social and educational significance.
Data are used to develop plans and actions that respond to what is really occurring in the school rather than reaching at straws and making assumptions. Data that are kept current provide a real-time look at your school climate. Data is used to select, monitor, and evaluate outcomes, practices and systems.
TFI 3.17 Big Ideas
Each year the Tier 3 Systems Planning Team will write an implementation action plan based on the results of the Tiered Fidelity Inventory (TFI) - Tier 3: Intensive SWPBIS Features and the Self Assessment Survey (SAS) - Individual Student Systems results.
The TFI is completed by the Tier 3 Systems Planning Team annually (minimum). It is recommended that an external evaluator be present during the annual scoring of the TFI in order to ensure validity to the results. The site's Student Wellness and Support Services (SWSS) Point of Contact has been trained to act as the external evaluator.
The SAS is completed by >80% of the staff annually.
Tiered Fidelity Inventory
The Tiered Fidelity Inventory (TFI) is a validated SWPBIS fidelity of implementation measure that assesses all three tiers of support.
Completion of the TFI produces scale and sub-scale scores indicating the extent to which Tier 1, Tier 2, and Tier 3 core features are in place. As a general rule, a score of 70% for each tier is accepted as a level of implementation that will result in improved student outcomes, but research is currently underway to identify a specific criterion for each tier of the TFI.
SWPBIS Tiered Fidelity Inventory
Each year the Tier 3 Team will need to determine how frequently and when they will review the Tiered Fidelity Inventory (TFI) for scoring and/or action planning.
Some Tier 3 Teams may choose to review the TFI in November/December for action planning and preparation for their end of year evaluation.
Some Tier 3 Teams may choose to only review the TFI 1x per year for their end of year evaluation. Keep in mind that end of the year evaluations take place in March/April, so make sure your Tier 3 Team (with your SWSS Tier 3 PoC) schedules a special (1 hour) meeting for this evaluation.
One of the requirements to score Platinum through the the California PBIS Coalition is a 70% score in Tier 3. This is equivalent to scoring 24 out of the total 34 points possible.
Tiered Fidelity Inventory - Tier 3: Intensive SWPBIS Features
Tier 3 of the TFI consists of four sub-scales - Teams, Resources, Support Plans, and Evaluation.
In order for the Tier 3 Systems Planning Team to score each element, a number of documents/resources will need to be reviewed:
Tier 3 Team meeting minutes & agendas
Tier 3 meeting member roles & attendance
Tier 3 action plan(s)
Tier 3 Screening data decision rules used to identify students
Admin. plan (time & funds to support plan implementation)
PD calendar, agendas, minutes
Staff handbook
Student outcome data
Plan implementation fidelity data
3 randomly selected behavior support plans
In order to score TFI elements 3.4, 3.6, 3.8, 3.9, 3.10, 3.11, 3.12, 3.13, and 3.15 the Tier 3 Systems Planning Team will need to randomly select three behavior plans written in the last 12 months.
For General Education Students the following plans apply: Tier 3 Behavior Support Plan (T3BSP), Behavior Intervention Plan (BIP), and
For Special Education Students the following plans apply: Special Ed. - Behavior Intervention Plan (BIP).
The Tier 3 Systems Planning Team will then utilize the TFI Tier 3 Support Plan Worksheet (found in the back of the TFI - Appendix C) to score each element.
Partial view of Appendix C: TFI Tier 3 Support Plan Worksheet
Once all Tier 3 elements have been scored, the Tier 3 Systems Planning Team will prioritize elements to include in action planning.
Self Assessment Survey
The SAS is an annual assessment used by schools to identify the staff perception of the implementation status and improvement priority for school-wide, classroom, non-classroom and individual student systems.
The Tier 3 Systems Planning Team will focus on the results of the Individual Student Systems. Within this section staff are asked to rank and prioritize system elements, such as:
Identifying students needing Tier 3 supports
Referring students needing Tier 3 supports
Responding to requests
Conducting Functional Behavior Assessments
Involving family/community in the student supports
Training options for families
Monitoring behavior and responding accordingly
The Tier 3 Systems Planning Team should use the results of the SAS and compare them to the results of the TFI. Together both fidelity measures should be used to inform the Team's action plan.
Action Planning
An Action or Solution Plan is a way to identify what needs to be done to implement strategies and provides a system for the Team to hold themselves accountable for completing a series of steps. Action plans indicate what needs to be done, who is responsible, and by when tasks will be completed.
Tully, 2008; McIntosh and Goodman, 2016A good action plan includes a defined outcome, action steps, timelines, and evidence of completion. To the right is a blank action plan that can be used by the Tier 3 Team to set immediate and long term goals.
At the start and/or end of each academic year, the Tier 3 Systems Planning Team should develop an action plan. This action plan will support the implementation of the TFI features identified as areas of need through the site's annual assessment - TFI and/or SAS results. Action plans should be reviewed/updated monthly during the Tier 3 Systems Planning Team meeting.
How to Score 2 Points on TFI 3.17
To receive a 2 Point Score Teams must be able to say yes to the following set of questions.
a) The Tier 3 Team completed the Tiered Fidelity Inventory (TFI) for Tier 3
b) The Tier 3 Team developed an Action Plan based on the results of the TFI