OVERVIEW OF THE EVALUATION PLAN
During the 2020-2021, 2021 - 2022, and 2022 - 2023 school years, Kankakee School District 111 piloted several new programs with an anticipated recommendation for adoption during the 2022 - 2023 school year.
The programs were piloted at various grade levels in ELA, Math, Science, and EL to provide teachers and students with more rigorous, engaging, culturally diverse, and aligned instructional materials and resources to ensure they have the knowledge and skills to be College and Career Ready.
EVALUATION GOAL AND OBJECTIVES
The primary goal of the evaluation is to determine which pilot programs are having the greatest impact on student learning outcomes.
The objectives of the evaluation are to determine to what extent the program:
aligns to the curriculum and increases access to grade-level assignments
provides enough rigor for student assignments and work based on CCSS and TNTP protocols.
has impacted student achievement as measured by STAR.
provides differentiation for instruction.
offers multiple types of assessment (formative, summative, self, and authentic) and opportunities for feedback to the student.
is relevant, engages, and connects students to the program.
addresses multiple learning styles.
is user-friendly for teachers, students, and parents.
includes a digital component.
Additionally, the program should:
1. Enrich and support the curriculum;
2. Stimulate growth in knowledge, literary appreciation, aesthetic values, and ethical standards;
3. Provide background information to enable students to make informed judgments and promote critical reading and thinking;
4. Depict in an accurate and unbiased way the cultural diversity and pluralistic nature of American society; and
5. Contribute to a sense of the worth of all people regardless of sex, race, religion, nationality, ethnic origin, sexual orientation, disability, or any other differences that may exist
EVALUATION METHODOLOGY
The evaluation will continue to utilize a mixed-method data collection approach. Qualitative and quantitative data will be triangulated and analyzed to determine if the program goal and objectives have been met:
Qualitative Data Sources
Surveys (see Appendix B Survey Questions)
Check-In Surveys
Curriculum Alignment Surveys (based on IMET) Late Fall 2022.(see notes)
Student work assessment surveys for Fall 2022 (based on TNTP protocols)
Engagement Surveys (Teachers and Students)
Parent Surveys for Fall 2022.
Focus Groups for Fall 2022 (see Appendix C Focus Group Questions)
Admin (Principals, AP’s, Curriculum Content Specialists, Directors)
Teacher
Student
Parents
Quantitative Data Sources
Aims Web (1st)
STAR Assessments (2nd-8th)
State Assessments (when available) 3-8
EVALUATION QUESTIONS
is the program being implemented as planned? By building - grade level ? Subject ?
what are students and families saying about the curriculum materials/ assignments
did the pilots improve the problem ? increasing access to grade-level assignments?
did the pilot program improve student achievement?
who did the pilots work for ?
is it culturally responsive and relevant?
FINAL EVALUATION REPORT
The final evaluation report will be compiled by the evaluator and presented to the Assistant Superintendent of Curriculum. Surveys, questions, and other data will be shared with the Instructional Programs department to provide feedback and collaboration throughout the evaluation process.
EVALUATION TIMELINE
Month
Tasks (for more detail see Task Planning)
Use this to think about our process
Link to Achieve the Core IMETS Survey Information
https://achievethecore.org/page/1946/instructional-materials-evaluation-tool
Summer 2022
Analyze ECRISS and IAR Data
Add TNTP Data to Report
Receive a list of pilot teachers and programs (Send list of Teacher Names and Course/Section Jenny)
September
Send email out to recruit for committees
Identify and Meet with Committees
K-3 ELA/ Math/MiVision
4-6 ELA/ Math/MiVision/Adelante-(6th grade only)
7-8 ELA/ Math/Science/MiVision
9-12 Math/ ELA
Develop Check-In Survey
Send Out Check-In Survey
Determine needs from Check-In Survey and plan for PD
Plan and Host Material Preview Fair for Parents/Community (contact Vendors to get promotional items for give aways for parents)
Thursday Night of Student Intervention Days
October
Update Materials Usability, Engagement, Digital Components, Surveys Designed
Send out IMETS Surveys
Connect Pilot Teachers to students and send to ECRISS
November
Develop Focus Group Questions
Conduct focus groups
Obtain quotes for next year’s purchases
Update Curriculum Board Members on November 9th
December
Compile IMETS Data for Report
Add Focus Group Data to Report
Add ECRISS Fall Data to Report
January
Finalize report and presentation for the BOE with recommendations for adoption approval on January 9th
Committee Meets: Tuesday
February
Order Materials
ELA
Amplify CKLA
Amplify ELA
Eureka ELA 9-12
Learn Zillion EL
MATH
Eureka
Illustrative Math
SCIENCE
Amplify Science 6-8
Amplify Science K-5 (Pilot 23-24 for possible adoption 24-25)
English Language Learners
Mi Vision
Adelante through Benchmark (6th grade)