Embedded Files
Need help entering SLO rubric data in Canvas?
Helpful Tips:
The assignment must be published in order to enter scores.
The SLO rubrics are set at zero points for most courses. After selecting each rubric criterion you will need to manually enter a score of "0" in the score field before clicking save.
After clicking "save", you will need to manually advance to the next student.
OAP analysis
OAP analysis
and planning
and planning
(Summer 2023)
(Summer 2023)
FACULTY
Practical Nurse
&
Aviation Maintenance Technology
Got Data?
Got Data?
Institutional curricular assessment data is collected via rubrics and tests in the Canvas Learning Management System.
Use the checklist below to ensure that data is generated at the end of term.
Before the term
Before the term
Is the correct assessment (rubric/quiz) present in the Canvas blueprint course? Refer to the OAP in WIDS for assessment information.
Verify that outcomes are aligned to Tests/Quizes (New Quizzes in Canvas), and that rubrics contain outcome rows.
Are there "hidden" assessment instructions present in Canvas? This is not required but can be very useful information for full-time and adjunct faculty. Contact Shelby Lowen if interested in adding the instructions.
Be sure to publish all assessments so that students can complete the assessment and instructors can enter grades.
During the term
During the term
Be sure to administer the assessment prior to the end of term. Institutional Assessment activities are required.
Is the assessment a test? Students will need to complete the test in Canvas (not paper/pencil).
Is the assessment a rubric? Instructors will need to evaluate each criterion of the rubric in Canvas.
Learning outcome data is generated by each individual test question or rubric criterion, not the overall score.
After the term
After the term
Assessment data will be available within 24 hours after students complete a quiz or the instructor enters rubric scores. A link to the report can be found in your myWSUtech dashboard in the Faculty links section!
Data Analysis & Assessment Planning
Data Analysis & Assessment Planning
Use the timeline below to guide your analysis and planning work.
This is especially helpful for programs participating in Program Review this upcoming year.
Click on the arrow in the upper right corner to view the entire timeline and see a list of key terms.
The timeline is set for "summer", but you can download and customize your own timeline by clicking on the "customize" tab at the bottom. You can also adjust the "Status" setting using the dropdown.
Timeline & Checklist
Timeline & Checklist
Details & Instructions
Details & Instructions
🔍Review the OAP (Outcomes Assessment Plan) & identify the target outcomes being assessed.
Contact Shelby Lowen slowen@wsutech.edu to request a copy of OAP
📊 Anaylze the Data
Navigate to the Learning Outcomes Report - A link to the report can be found in your myWSUtech Faculty links section!
Review the information in the "Report Navigation" and "Report Overview" tabs on the left side.
Select the visualization/table you would like to view and apply filters, dropdown menus at the top, to view the data relevant to your program. There is a visualization and a table for 3 different outcome levels.
Use the Student Learning Outcomes visualization and table to view data related to the four institutional learning outcomes.
Use the Program Learning Outcomes visualization and table to view data related to the Knowledge-based and Skills-based assessments.
For the Academic Year filter...select 2025. This will include fall 2024, spring 2025 and summer 2025.
Use the visualization to arrange the data and capture the overall student performance on the outcome(s).
Use the table to view the assignment(s) associated to the outcomes and export OR use the snipping tool to capture screenshots of the data you are using for your analysis.
Look for outcomes with low or high performance, identify learning gaps.
Evaluate the effectiveness of past interventions or instructional changes.
Using the CRN filter, compare to the interactive schedule and identify sections that did not capture data
Complete the OAP Analysis Table using the guide below.
Submit OAP Analysis Report to CQI Canvas course. Don't forget to include the data sets you exported from the the Learning Outcomes Report!
🎯 Planning & Action - Determine what is working well and should be continued OR is it time to make a change?
If making a change, Shelby will work with you on completing the tasks listed below.
Refer to the most recent curriculum map for a menu of courses that are aligned to the PLOs. Update the map if needed.
Identify the PLOs to assess for Knowledge-based and/or Skills-based assessments
Identify courses, learning activities, at least one CLO, and any applicable ILOs to include in the rubric/quiz.
Identify courses and learning activities to assess the SLOs. Be sure to include at least one CLO in addition to the SLOs in the rubric/quiz.
Finalize the OAP (Outcomes Assessment Plan).
🚀Canvas - Update all rubrics/quizzes with the appropriate outcomes prior to associating blueprint courses to live sections!
🤝 Collaborate
Discuss findings and plan with your program faculty team
Ask questions and reach out for help if needed
Reflect on how the data can inform meaningful improvements
Share the plan and review the rubrics in Canvas blueprint courses
OAP Analysis Guide
OAP Analysis Guide
The first 5 columns of the analysis document are identical to the original OAP plan:
Assessment
Target Outcomes (aka PLOs-Program Learning Outcomes)
Standard for Student Success
Quality Objective
Assigned to
The remaining 5 columns are the added "Analysis" columns. See below for guidance on completing these sections of the document.
Results Score
This is a drop-down in WIDS. The options are Met or Not Met. Refer to Standard for Student Success in original OAP and the data to determine status.
NOTE: If status is MET, then a new assessment and/or course may need to be identified for the next academic year OR the same assessment may be used if more data is needed to make a well-informed decision for change (continue to monitor).
Results Analysis Summary
What is the data "story"?
Refer to the Standard for Student Success in the original OAP and the data sets to reflect upon student learning and the effectiveness of the interventions implemented to address the learning gaps identified the previous year. The data story is a narrative that references significant data pieces.
Be sure to include the following in the summary:
% - Percentage of students that met the standard of success for EACH outcome
SLOs - Total percentage of students that performed "proficient" and "exemplary"
PLOs - Total percentage of students that performed "mastery" and "exceeds mastery"
Data collection: Was data collected from ALL sections? Identify the number of sections that did collect data and the number of sections that did NOT collect data.
Trend data - Compare the current year's data to at least the two previous years if the same assessment is utilized throughout. Do you see an increase or decrease? By how much? Use percentages since the actual number of data points differ year to year. If a new learning activity or course is specified in the plan, indicate this year's data as "benchmark" data.
Beginning AY25, data reports will reflect student performance on learning outcomes associated with learning activities, not the overall performance or grade on the activity itself. This will impact trend data. If the assessment is the same as the previous year, compare/describe both student performance in AY23.24 (refer to AY23.24 OAP analysis) AND student peformance on the related outcomes in AY24.25.
Effectiveness of Interventions - Describe the interventions implemented this past year and if the data indicates an improvement.
Learning opportunities - Identify any gaps in learning and/or opportunities for improvement. The "Students Achieving Mastery by Assignment" section on the visualization ranks student peformance on outcomes aligned to assignments. This is a good place to start when identifying learning gaps and areas for improvement.
Improvement Interventions
Every program is unique, and there is no "one-size-fits-all" intervention. Be specific, intervention statements are actionable! Avoid statements like "the instructor will help students to better understand" or "better prepare the students", etc. HOW will the instructor help the students? HOW will the instructor better prepare the students? What instructional strategy or learning activity will better prepare the students or help them understand the content better?
An intervention should have both an instructor component and a student component. Chad Littlefield said it best, "Two words to communicate more clearly are so that (click to view video)" Here is a simple "so-that" formula that can be used to craft an intervention statement:
The Instructor will __________ so that the students can __________"
Things to think about when determining appropriate interventions for the next academic year:
Prioritizing the use of instructional time to increase student opportunities to learn
Providing additional instruction for students who are struggling to learn particular content
Modifying delivery strategies
Refining instruction
Determining if the curriculum needs to be adapted based on student strengths and weaknesses
Notes
Items related to attendance, participation, missing data, input data errors, assessment process, environmental, etc. are issues but NOT interventions. Use the “Notes” column to record these types of items if you so choose.
Feedback Rubric
Feedback Rubric
Page updated
Google Sites
Report abuse