Congratulations to the 2021-2022 Award of Excellence Schools!

Schoolwide Evaluation Tool (SET)

Sugai, G., Lewis-Palmer, T., & Horner, R. (2005). Schoolwide Evaluation Tool. Version 2.1, Education and Community Supports, University of Oregon.

What is the SET?

The School-wide Evaluation Tool (SET) is designed to assess and evaluate the critical features of schoolwide effective behavior support across each academic school year. The SET results are used to: 1. assess features that are in place, 2. determine annual goals for school-wide effective behavior support, 3. evaluate on-going efforts toward school-wide behavior support, 4. design and revise procedures as needed, and 5. compare efforts toward school-wide effective behavior support from year to year. Information necessary for this assessment tool is gathered through multiple sources including review of permanent products, observations, and staff (minimum of 10) and student (minimum of 15) interviews or surveys. There are multiple steps for gathering all of the necessary information. The first step is to identify someone at the school as the contact person. This person will be asked to collect each of the available products listed below and to identify a time for the SET data collector to preview the products and set up observations and interview/survey opportunities. Once the process for collecting the necessary data is established, reviewing the data and scoring the SET averages takes two to three hours.

The results of the SET will provide schools with a measure of the proportion of features that are 1) not targeted or started, 2) in the planning phase, and 3) in the implementation/ maintenance phases of development toward a systems approach to school-wide effective behavior support. The SET is designed to provide trend lines of improvement and sustainability over time.

Results are reported as a percentage of total implementation and a percentage of the Expectations Taught category.

For state-wide recognition, a score of 80/80 is required.

Who completes the SET?

The SET is completed each year by external consultants or coaches (usually your SW-PBS consultants from your local RPDC) in coordination with school building administration and Tier 1 Leadership Teams. The SET has a number of components including: an administrative interview, staff interviews, student interviews, a document review (see list below), and a building observation. At the end of the SET, your evaluators will provide your team with a report and a score.

When should the SET be completed?

Generally, the SET is conducted during February or March of each school year. For regocnition purposes, SET assessments must be completed before the recognition deadline.

Completing the SET

Pre-Implementation of the SET

Review available SET resources:
Schedule a date and time for the SET assessment for your building. Administrators and/or Tier 1 Leaders usually take care of this detail. Adminstration of the set takes between two and three hours.
Begin to assemble the documents involved in the document review. Most schools provide evidence digitally allowing the consultants an opportunity to review documents before the SET begins. This shortens the amount of time needed for the SET assessment at your school. Work with your RPDC consultant to coordinate the sharing of these documents. Here is list of the required documents:
- Discipline Handbook (student, staff, PBIS)
- School Improvement Plan Goals with PBS listed in top 3 goals
- Annual Action Plan for meeting school-wide behavior support goals (2018)
- Social Skills (Matrix-based lessons) instructional materials
- Social Skills instructional timeline
- Behavioral incident summaries or reports (Big 5 Data will suffice)
- Office Discipline Referral forms
It is useful to prepare your students and staff for the evaluation with information about the event. Use the SET Protocol to read and learn about the interview questions that will be posed to the administrator, staff, and students.
Arrange for a space for the consultants to collaborate after the assessment.
Plan for an exit interview. It is appropriate for an administrator, Tier 1 leader, or Tier 1 team to attend an exit meeting.
Provide a map of the building to the evaluators.

On the Day of the SET Assessment

Remind staff and students of the presence of the evaluators.
Provide a space for the consultants to act as a home base and an area in which they can collaborate privately.
Arrange for an exit interview space.
Typical scheduling considerations:
- The consultants will likely arrive about 20-30 minutes before the scheduled time to acclimate to the environment and recieve instructions on where to go.
- We will begin with an administrative interview. The interview generally lasts around 30 minutes.
- We will briefly and randomly interview at least ten staff members and at least 15 students. We will not interrupt classroom instruction for interviews. We generally find staff in the hallways, workroom, or on their plan time. The same with students, we will not interrupt them in class. Staff interviews take approximately 3-5 minutes. Student interviews take less than one minute each. The whole interview process takes about one hour. We will not interrupt classrooms or instruction to conduct interviews.
- If arrangements have not been made to share documents before the day of the SET, time will need to be set aside to do so. Please provide all of the documents listed above and a space to review them.
It will be necessary to tour the building including some classrooms. We will not interrupt instruction. There are several items on our checklist to view within your building.
When all of this is completed, we will need a few minutes of your time for a short feedback session. We are happy to have this exit-meeting with whomever you choose. At some schools, we meet with the administrator while at others, we meet with the Tier 1 Team.
A day or so after the evaluation, we will send you a full report.

After the SET

A day or so after the evaluation, we will send you a full report.
Results will also appear under Schoolwide Evaluation Tool on your PBIS dashboard.
Use the results as a source of celebration and action planning for your Tier 1 team.
Be sure to constact your consultant if you or your team should have any questions.

Page updated

Report abuse