TFI 1.14 EVALUATION: Fidelity Data

The Tier 1 Team reviews and uses SWPBIS fidelity (e.g., SET, BoQ, TIC, SAS, Tiered Fidellity Inventory) data at least annually.

Data are used to develop plans and actions that respond to what is really occurring in the school rather than reaching at straws and making assumptions. Data that are kept current provide a real-time look at your school climate. Data is used to select, monitor, and evaluate outcomes, practices and systems.

TFI 1.14 Big Ideas

In this element, TFI 1.14, the Team will collect and analyze fidelity data.

By collecting data to measure fidelity to implementation, the Team will have a better understanding of how to proceed with implementation.

Action planning includes: ensuring all staff have access to and at least 80% take the Self Assessment Survey (SAS), completing the Tiered Fidelity Inventory (TFI), at least annually, and developing action plans.

On-Your-Own Learning

Coming Soon!

Culturally Responsive - TFI 1.14 Elaboration

Teams, staff, and stakeholders are committed to enhancing SWPBIS implementation with culturally responsive components. Teams use additional measures, beyond the nationally recognized SWPBIS assessments, to examine the fidelity of their school-wide system specifically with regard to the equity of outcomes for all students.

What is Fidelity Data?

Definition: Fidelity of implementation is the delivery of an intervention, program or curriculum in the way in which it was designed to be delivered.

PBIS Apps: It's More Than a Score

Source: Implementation fidelity refers to the degree to which an intervention or program is delivered as intended. Only by understanding and measuring whether an intervention has been implemented with fidelity can researchers and practitioners gain a better understanding of how and why an intervention works, and the extent to which outcomes can be improved.

Tiered Fidelity Inventory (TFI)

Tier One of the Tiered Fidelity Inventory consists of 15 Features. Each Feature requires Tier 1 Climate & Culture Teams to create products, develop policies, and implement procedures. It is important for the Team to become familiar with each Feature so they can see the progression of implementation actions that need to be taken in Tier 1.

Team Handout:

Tier 1 Fidelity Inventory Features: Overview


Implementation/Scoring Guide:

The Tiered Fidelity Inventory (TFI), v. 2.1, 2019

TFI Companion Guides:

Restorative Justice TFI Companion Guide

Description & Purpose: The Tiered Fidelity Inventory is a valid and reliable self-assessment of all three tiers of implementation. The team that works with a specific tier takes the scale for that tier. The tier 1 scale is informed by a building walk, as well as staff and student interviews. It is recommended that an external coach or facilitator conduct the building walk, and facilitates the administration of the TFI. A team member enters the TFI results into PBIS Assessments. This survey replaces several PBIS Surveys, including the Benchmarks of Quality (BoQ) and the Benchmark for Advanced Tiers.

MO Implementation Guide


Self-Assessment Survey (SAS)

Description and Purpose

Additional Fidelity Tools

PBIS: Benchmarks of Quality (B0Q); School-Wide Evaluation Tool (SET)

Climate & Culture: Panorama - Climate & Culture

Walkthroughs: walkthrough forms can be designed or an existing form adapted to include evidence-based SW-PBS practices. For example, the form can include a space for monitoring counts of specific positive feedback, non-specific positive feedback, and critical feedback. The observer records the number of times that staff members give each of the respective kinds of feedback during a 10-minute time segment, and a ratio is calculated. Across many observations, the average ratio provides an accurate assessment of the rate at which staff provides specific positive feedback throughout the building. Trends over time can also be calculated, and indicate progress over time in the level of implementation of this evidence-based practice.

Observations

Surveys & Interviews

Source: (MO Handbook p 251) - standardized frameworks, Action Plan Check lists, walkthroughs, observations, surveys

Using Fidelity Data for Annual Planning - Implementation Action Plan

Annual Planning Worksheet (refer to TFI 1.2)

Implementation Action Plana

Additional Readings and Supports

2 Point:

Tier 1 fidelity data collected and used for decision making annually.

1 Point:

Tier 1 fidelity collected informally and/or less often than annually.

0 Point:

No Tier 1 SWPBIS fidelity data collected.

Possible Data Sources: School policy, Staff handbook, School newsletters, School website

SWSS Department: S. Johns, J. Patrick 2020
Information adapted from: CO-PBIS; FLPBIS; PBIS of Georgia; MO-SWPBIS Handbook/Tier One Implementation GuideImages obtained from Google Images and/or created by Johns/Patrick

Types of Fidelity Data