Student Wellness & Support Services Dept. - TFI 2.13 Annual Evaluation

TFI 2.13 EVALUATION: Annual Evaluation

At least annually, Tier 2 team assess overall effectiveness and efficiency of strategies, including data-decision rules to identify students, range of interventions available, fidelity of implementation, and on-going support to implementers, and evaluations are shared with staff and district leadership.

SYSTEMS to Support Staff Behavior

Systems support the accurate and durable implementation of practices by staff, the efficient use of data for decision-making, and achievement of outcomes. Staff are trained to prevent many student behavior problems as well as to deal with disruptive behaviors in a proactive and positive manner. Systems provide the procedures and infrastructure to support and maintain new evidence-based practices.

TFI 2.13 Big Ideas

In this element, TFI 2.13, the Team will meet to assess their overall effectiveness to Tier 2 and identify the stakeholders that should receive the annual fidelity and program effectiveness results and next steps.

Action planning includes: Scheduling the end of year evaluation meeting, inviting the site's SWSS Tier 2 PoC to attend evaluation meeting, identifying stakeholders who should be informed of annual implementation fidelity and effectiveness progress and using a variety of methods to communicate results in a meaningful and usable format stakeholders.

TFI Evaluation

Each year the Tier 2 Team will need to determine how frequently and when they will review the Tiered Fidelity Inventory (TFI) for scoring and/or action planning.

Some Tier 2 Teams may choose to review the TFI in November/December for action planning and preparation for their end of year evaluation.

Some Tier 2 Teams may choose to only review the TFI 1x per year for their end of year evaluation. Keep in mind that end of the year evaluations take place in March/April, so make sure your Tier 2 Team (with your SWSS Tier 2 PoC) schedules a special (1 hour) meeting for this evaluation.

One of the requirements to score Gold through the the California PBIS Coalition is a 70% score in Tier 2. This is equivalent to scoring 19 out of the total 26 points possible.

Special Note for Tier 2 Teams: For the purposes of the end of year TFI evaluation, Tier 2 Teams will assess how well the school has implemented each Tier 2 intervention identified in TFI 2.5. Scoring Tier 2 is unique in that Teams must:

Identify how many interventions their site has - TFI 2.5
Score each of those identified interventions through all TFI elements 2.3-2.14
Score each intervention identified in TFI 2.5 separately

If both interventions receiving a 2 point or 1 point score, than that is the score assigned to that TFI element

However, if one of the interventions receives a 2point score on a TFI element and another intervention receives a 1 point score on the same TFI element, the Team must record that TFI element as a 1 point

Making Alterations to Tier 2

Sample TFI 2.1 & 2.2 Action Plan

At the end of each TFI review, Tier 2 Teams will develop an action plan with clearly defined additions/alterations to their Tier 2 Systems. Implementation action planning should be based on the results of either the Tiered Fidelity Inventory (TFI) and/or the Self Assessment Survey (SAS).

Once the Team agrees on the action planning steps necessary to achieve their goals, these action items should be added to the Tier 2 Teams monthly agenda and their end of year communication with stakeholders.

Blank Action Plan

Communicating with Stakeholders

Because schools are accountable to stakeholders to report the fidelity and effectiveness of their implementation efforts, it will be necessary to identify which stakeholders to communicate the annual PBIS evaluation results.

Stakeholders to consider:

District Level: school board, superintendent's cabinet, departments, cluster schools, parent groups & advisory committees
School Level: administration, leadership, instructional staff, non-instructional staff, students, parents/caregivers, advisories/councils

Methods of Communication

When communicating with stakeholders it is important to tailor the information to address the unique interests and questions of the audience. Intentionally creating a system to produce an end-of year report will assist the Team in dedicating adequate time to ensure the information is distributed to all the appropriate forums and is presented in a usable format.

Hard copies: Office, Wellness Center, Family Engagement Center, Health & Wellness Fair

Digital: emails, school website, social media, etc.

Communicating Annual Results - Criteria & Examples

According to TFI 2.13, staff and district personnel should be updated at least annually regarding the school's Tier 2 implementation progress and plans. Results should be communicated in an easily accessible format and include the following information:

current fidelity and effectiveness of Tier 2 interventions with year-by-year comparisons (TFI results for three years), and
a clear statement of the alterations that will be made as a result of the findings.

Additional Data Sources to Share: Depending on the stakeholder group being targeted, additional implementation specifics as well as data sources may be shared. These include: Panorama Climate & Culture, Average Daily Attendance (ADA), academic outcomes, suspension rates (by subgroup), and office referral totals.

The goal when communicating annual fidelity and effectiveness results is to keep the interests of the stakeholder group in mind.

How to Score 2 Points on TFI 2.13

To receive a 2 Point Score Teams must be able to say yes to the following set of questions.

2 Point:

Evaluation conducted at least annually, and outcomes shared with staff and district leadership, plus clear alterations in process proposed based on evaluation.

1 Point:

Evaluation conducted, but outcomes not used to shape the Tier 2 process.

0 Point:

No data-baed evaluation takes place.

Information adapted from: MO-SWPBIS Handbook/Tier Two Implementation Guide; Center on PBIS/PBIS.orgImages obtained from Google Images and/or created by J. Patrick