The Internal Review (IRV) process is the Pacific East District’s process for monitoring schools’ work toward continuous improvement and quality assurance. Although the concept of IRVs has been implemented in the district as precursor visits for external reviews since SY 2010-2011, the Pacific East District reshaped the IRV in SY 2015-2016 to focus on quality assurance and continuous improvement and implemented the IRV process as an annual activity in SY 2018-2019.
The Pacific East District’s IRV process includes six components:
Document Review
Stakeholder Feedback
School Presentation on School status and Supporting Data
ELEOTs
Debrief / Report
Next Steps
Each year, the district utilizes feedback and insights gleaned from IRV participants to modify and strengthen the IRV process. The IRV process has also become an essential catalyst for building capacity throughout the district in continuous improvement, collaboration, continuity in district initiatives, and fulfilling the district’s vision: One Team, One Vision. The most significant modification the Pacific East District made in using the IRV process to build capacity is evidenced by the dedication of resources to have administrators, CSI chairs, and data chairs participate in multiple IRVs throughout the district. Consequently, an IRV team now averages 20 team members, which enables colleagues to have first-hand observations of the great work underway in schools throughout the district, gain insights of practices to carry back to their prospective schools, and collaborate.
The Pacific East District’s Internal Review Visit (IRV) process has had a positive impact on continuous improvement, building capacity, and monitoring quality assurance as evidenced by:
Utilizing IRV data to inform continuous improvement decisions and modifications
Monitoring and adjusting the IRV process yearly to support continued improvement in the Pacific East District
Providing opportunities for administrators and educators to visit other schools and observe best practices through the IRV process
Improving IRV outcomes each year to include schools addressing next steps
The Pacific East District transitioned the IRV to focus on continuous improvement and quality assurance. Since this school year was the first school year that IRVs were conducted in all schools throughout the district, the focus was on developing an understanding of the district as a whole.
The Pacific East District implemented a group of communication tools and expectations in response to the data gleaned from the IRVs conducted in SY 2015-2016 that suggested that communication was a pattern of concern throughout the district.
Since the first system’s external review occurred this school year, the IRV process was not implemented.
Based on the Pacific East District’s reflection of information gleaned from our preparation for our first system review, from the External Review Report, and the status of our four district goals, district leadership committed district resources in SY 2017-2018 to the implementation of the rigorous DoDEA College and Career Ready Standards (CCRS) and the implementation of the CCRS Summative Assessments, two cornerstones for our improvement journey.
In the spring of 2018, Cognia provided a district-wide training to introduce the revised Cognia standards and School/System Quality Factors (SQFs).
Due to the committing resources on implementing our CCRS system and Cognia Training, the district did not implement IRVs for SY 2017-2018.
The Pacific East District implemented the annual IRV process. In spring of 2019, the Pacific East District engaged in IRV for 11 of the 20 Pacific East Schools. Due to the cost involved in conducting IRVs, district leadership at the time determined to conduct the first round of IRVs over two school years.
The outcomes of the IRV indicated that the areas of greatness need were:
Building capacity with Focused Collaboration (91% of schools visited indicated a need)
Continuing to build communication processes (72% of schools visited indicated a need)
Strengthening the goal process (45% of schools visited indicated a need)
For SY 2019-2020, the Pacific East District addressed the needs identified from the IRVs conducted in SY 2018-2019:
Focused Collaboration (FC) by reshaping our FC process, implementing a “tight” structure, dedicating district-wide professional sessions to FC, and having all job-alike sessions throughout the district
Communication by embedding communication monitoring and discussions in the IRV process
Strengthening the goal process by having professional learning instructional systems specialists (PL ISSs) take the lead in continuous-improvement work with their schools
In the fall of 2019, Cognia presented training on the i3 Rubric to CSI chairs, administrators, and the ISSs.
In the spring of 2020, the district completed IRVs for 6 of the Pacific East District schools. The district had planned on engaging in visits for the remaining 9 schools that did not host IRVs in SY 2018-2019, but the outbreak of the COVID-19 pandemic prevented the completion of the internal review visit plan. A positive outcome as a result of the COVID-19 challenge was that the district implemented a IRV hybrid approach, which resulted in having IRV team members from the local area conduct ELEOTs and students interviews IRV team members located in other parts of the district conduct the school discussion, teacher feedback sessions, and parents feedback sessions virtually.
In March of 2020, the Pacific East District had to redirect attention to maintaining quality learning for all students as our schools transitioned to remote learning in response to the COVID-19 pandemic. In addition, the PL ISSs and the Assessment and Accountability ISS initiated the work of League 2022 to conduct a deep dive in the Cognia standards, which resulted in the Forward Journey Report.
The observation was made from IRV participants that the components of schools leading a discussion about their progress on the improvement journey was too general and needed to be tightened and better aligned with the improvement journeys of the district.
For SY 2020-2021, the Pacific East District addressed the needs identified from the IRVs conducted in SY 2019-2020 by strengthening our IRV process. The team embedded the i3 Rubric in our process and identified four Cognia Standards as “Power Standards.”
In spring of 2021, the Pacific East District engaged in IRVs for all 20 Pacific East Schools.
The Pacific East identified four Cognia Standards as “Power Standards” (1.3, 2.7, 2.11, 3.2) that are aligned with the overarching work of the district:
1.3: Continuous Improvement Process: Aligned with:
Pacific East Strategic Plan:
21st-Century Goal
Two measurable objectives
Three Strategic Themes
Seven Critical Working Groups
Pacific East Data Management System (PEDMS)
2.7: Monitoring and adjusted instruction for individual learners’ needs: Aligned with:
Pacific East Strategic Plan
Professional Learning Critical Initiative Working Group
Focused Collaboration
2.11: Gather, analyze, and use data: Aligned with:
Data Usage Critical Initiative Working Group: Pacific East Data Management System (PEDMS)
Focused Collaboration
3.2: Professional Learning Collaboration: Aligned with:
Focused Collaboration
Professional Learning Critical Initiative Working Group
The outcomes of the IRVs conducted in SY 2020-2021 indicated that the areas of greatest need were:
Making data readily available to educators (100% of schools visited indicated a need)
Implementing a process for collecting, analyzing, monitoring, and using data to impact student learning (100% of schools visited indicated a need)
Strengthening the professional learning structure (75% of schools visited indicated a need)
Increasing stakeholder (students, parents, faculty) in the educational and decision-making process (35% of the schools visited indicated a need)
Based on a score produced from the IRV findings, the district initiated the Level of Supports.
For SY 2021-2022, the Pacific East District addressed the needs identified from the IRVs conducted in SY 2020-2021:
Making data easily available to education by developing the Pacific East Dashboard
Implementing a process for collecting, analyzing, monitoring, and using data to impact student learning by implementing the Pacific East Data Management System (PEDMS)
Strengthening the professional learning structure by implementing the Professional Learning Critical Initiative Working Group
Increasing stakeholder (students, parents, faculty) participation in the educational and decision-making process by increasing stakeholder in the IRV process and adding faculty members to the components of the Pacific East Strategic Plan
The Pacific East District is proud of the capacity we have built over the last five years. We further built capacity through the IRV process by increasing the IRV team and having school administrators, CSI Chairs, Data Chairs, and Instructional Systems Specialists (ISSs) each serve on multiple IRVs throughout the district. Consequently, the Pacific East District committed resources to make the IRV process an essential catalyst for building capacity. In addition, the IRV process was modified by having faculty and parent stakeholders provide feedback through a questionnaire, which greatly increased the number of stakeholders who participated in the feedback process.
The outcomes of the IRVs conducted in the fall of 2021 indicated that the areas of greatest need were:
Continue to implement the Pacific East Data Management System (PEDMS) consistently with fidelity (85% of the schools visited indicate a need)
Continue to formalized and documented implemented processes (45% of schools visited indicated a need)
The Pacific East is addressing these two areas of greatness need by implementing professional learning of and support with PEDMS and by continuing to implement the Pacific East Strategic Plan.
LInk Graph
Utilizing IRV data to inform continuous improvement decisions and modifications
Monitoring and adjusting the IRV process yearly to support continued improvement in the Pacific East District
Providing opportunities for administrators and educators to visit other schools and observe best practices through the IRV process
Pacific East District's data-informed continuous-improvement decisions and modifications to our improvement journey
16 of the 19 (84.21%) schools included in the IRV process had next steps associated with communication.
The Pacific East implemented communication resources and expectations:
These components were an expectation through SY 2019-2020, when schools were encouraged overall communication approaches in response to the amount of communication occurring in regards to COVID-19:
Quality Schools Council
10 of 11 (91%) schools included in the IRV process had next steps associated with Focused Collaboration.
The Pacific East reshaped our approach to Focus Collaboration by establishing a well-defined structure with clear expectations, guidance, training and support.
Eight of 11 (72%) schools included in the IRV process had next steps associated with communication (a decrease from the 84.21% of the schools that had next steps during the previous round of IRV in SY 2015-2016).
The Pacific East embedded a review of the communication resources (Communication Matrix, Communication Detail, Communication Plan) in the IRV process and made all schools’ matrices, details, and plans available to all schools as resources.
Five of the 11 (45%) of the schools included in the IRV process had next steps associated with the school goal process.
The Pacific East District redesigned the Goal Template and Goal Process.
Feedback from IRV participants suggested that the approach of engaging in the school overview with the continuous school improvement leadership team by asking questions without providing specific information for the school to have prepared was too ambiguous and did not enable in-depth discussions to occur with clear data provided.
The Pacific East District modified the IRV process by having schools lead the IRV team engagement with the continuous school improvement leadership team discussion with guidance and topics provided by the district office.
The observation was made from IRV participants that the components of schools leading a discussion about their progress on the improvement journey was too general and needed to be tightened and better aligned with the improvement journeys of the district.
The Pacific East District identified four Cognia Standards as Power Standards aligned with our improvement journey and embedded the i3 Rubric in the process of monitoring the schools’ work with the four Power Standards.
Twenty of the 20 (100%) of the schools included in the IRV process indicated a desire to improve educators’ accessibility to data.
The Pacific East District implemented the Pacific East Data Dashboard.
Twenty of the 20 (100%) schools included in the IRV process had next steps associated with implementing a process for collecting, analyzing, monitoring, and using data to impact student learning.
The Pacific East District implemented the Pacific East Data Management System (PEDMS)
Fifteen of the 20 (75%) schools included in the IRV process had next steps associated with strengthening the professional learning structure
The Pacific East District implemented the Professional Learning Critical Initiative Working Group
Seven of the 20 (35%) of the schools included in the IRV process had next steps associated with Increasing stakeholder (students, parents, faculty) in the educational and decision-making process.
The Pacific East District increased stakeholder participation in the IRV process and added faculty members to the components of the Pacific East District Strategic Plan
Seventeen of the 20 (85%) of the schools included in the IRV process had next steps associated with continuing to implement the Pacific East Data Management System (PEDMS) consistently with fidelity.
The Pacific East is implementing professional learning of and support with Pacific East Data Management System (PEDMS).
Nine of the 20 (45%) of the schools included in the IRV process had next steps associated with continuing to formalize and document implemented processes.
The Pacific East is continuing to implement the Pacific East District Strategic Plan.
IRV Process
IRV School Reports
IRV Presentations and Outbrief Recordings