Data Literacy includes the ability to read (analyse), write (create) and communicate data in context. It is about understanding where the data has come from (source) and how best it can be presented to provide a deeper insight in to the teaching and learning in our classrooms.
Good data provides a narrative and invites us to ask questions that enables us to learn even more, and good data literacy gives us the tools to ask the right questions. In doing so, we can drill down and find the information we need to implement actions that will have the biggest impact for our students in our schools and classrooms.
This page includes support for collecting, presenting and analysing school based data. For further support please contact Alana.
This above video has been created to support local schools to analyse their SSSR NAPLAN data in Excel and provides a brief overview and limited examples of how you might use this data.
If you would like support to access this data for your school, please reach out to your EIL or paul.mcaloon@education.vic.gov.au .
Key Link: VCAA Data Service: https://dataservice.vcaa.vic.edu.au
Here is a link to the recording: https://drive.google.com/file/d/1JFJ3h4uQjMZ71as2kQD1NS6yNjWCuP0R/view?usp=sharing
Traditionally, learner data consisted of the final summative marks on an end of unit or semester assessment. We now know learner data is much more than this, and teachers can draw on many different types of learner data to improve their practice and to assess the effectiveness of a task or a new way of teaching and learning.
Continue reading about Using Learner Data (aitsl) here: https://www.aitsl.edu.au/teach/improve-practice/practical-guides/using-learner-data
Topics include:
Tips for collecting and using learner data
Types of learner data
Learner perception surveys
What to ask learners
Consistency and accuracy in learner data
Tracking data
A simple table like this can help identify student, class, cohort or school trends in achievement.
In this instance it is mapping Teacher Judgment score, across the top, with NAPLAN achievement Bands (left axis) in Writing.
You could choose to use any two pieces of data for students to help find any trends, patterns or inconsistencies in student achievement.
Completing a table like this is a good starting point for further discussions around student achievement and identifying which data points to interrogate further.
For example you might notice a nice correlation between the NAPLAN scores and Teacher Judgements (TJ) or you may have some 'outliers' of students who have exceeded expectations in NAPLAN and this doesn't correlate with their TJ score or vice versa.
By identifying students by name in a table like this you will be able to develop a broader context of the level of achievement of your students.
What is a data wall?
A data wall allows us to visualise individual students’ achievement over time on a physical or virtual wall.
Why use a data wall?
Building a data wall is a practical and powerful way to focus the work of every teacher on the growth and achievement of every student.
Any grouping of students, from a single class to the whole school, can form the basis of a data wall. The power of a data wall comes from including every student in that group – not just those struggling, flying or doing okay. This shifts the conversation from ‘my students in my classroom’ to ‘our students in our school’; and it shifts the motivation from ‘improving my practice’ to ‘improving our practice’.
A data wall can become the place where teachers gather to tame the torrent of data coming at them and transform it into actionable classroom strategies. Over time, this not only builds teachers’ confidence with incorporating evidence into everyday teaching – it also builds their belief in collective efficacy, that is, teachers’ collective power to improve learning outcomes for all students.
Continue reading about data walls by accessing Professional Practice Note 5.
Data driven dialogue is a useful tool to help facilitate discussion with staff about what a set of data might be showing. By moving thorough a protocol like this you provide an opportunity for all staff to have equity of voice and removes the temptation to make assumptions about what you think the data might be telling you without first interrogating it further.
After this process you and your staff should have a clear and shared understanding of what the data is telling you, data-based facts, and patterns and trends that can help lead towards identifying a 'root-cause' to help improve student learning outcomes.
Protocol Overview
Review Protocol (3 minutes)
Presentation (5 minutes)
“Owner” of the data provides overview of the context and focus
Clarifying Questions (4 minutes)
Phase 1: Predictions
Group fills out predictions sheet (3 minutes)
Round-robin report-out of predictions (one item each person, one round only — 3 minutes)
May be charted by the facilitator or other member of the group
Distribution and Examination of Data (7 minutes)
Additional Clarifying Questions, if necessary (3 minutes)
Phase 2: Go Visual (10-30 minutes)
Participants mark up and re-organize the data to better understand it. May be done individually, in pairs, or in small groups depending on group size and amount of data. Highlighters, chart paper, and calculators are helpful to have on hand.
Phase 3: Observations
Group fills out observations sheet (5 minutes)
Round-robin report-out of observations may (one item each person, continue rounds until new ideas are spent — 5 minutes)
Check in with Presenter (2 minutes)
Do we need to refocus our attention?
Phase 4: Inferences
Group fills out inferences sheet (5 minutes)
Round-robin report-out of inferences. May be charted (one item each person, continue rounds until new ideas are spent — 5 minutes).
Response from the Presenter — What new thoughts are you having about the data now? What are your next steps? (5 minutes)
Implications for teaching and learning (10 minutes)
Debrief the protocol (3 minutes)
A Guttman Chart (or ZPD Chart) is a quick and easy tool to help identify trends in your student achievement data. The three videos below will step your through how to make a Guttman Chart in Excel and help explore your student achievement data on a deeper level.
Colour Coding the data using Conditional Formatting (1:04)
Organising the data to make it easier to read using the formula =sum and the Excel tools Sort & Filter and Custom Sort. (2:55)
Noticing patterns and analysing the data. (1:48)
Sankey charts can be a great way to visualise the 'flow' of student achievement and can be used as another tool to help identify patterns and trends in cohorts and schools.
In Panorama the NAPLAN Comparison to Teacher Judgement Dashboard is a great tool to check student performance in NAPLAN compared to Teacher Judgement scores. Watch the 'how to' video to find out more about this Panorama resource.
Item Analysis is identifying individual questions from an assessment and digging deeper to understand why students may have answered the way they have. If for example a question has been answered correctly by only 10% of the cohort then we need to undertake an Item Analysis to understand why. Some possible questions worth considering include:
Did the students understand the question?
Is there a misconception that needs to be rectified?
Was there a common 'incorrect' answer that a large % of students chose? if so, why?
Have the students undertaken learning in that part of the curriculum?
What is the difficulty of this question? Is 10% a good achievement for this cohort (compared to State, National or standardized data)?
Now What? What is the plan for future teaching and learning?
This Bump It Up Wall was developed with Small Schools in our area. We encourage you to use the template and use writing samples from your own school to display in classroom and use to develop student goals. This can support your school with moderation and student agency with the area of writing - sentence structure. If you made an adaptation of this, please let us know. We would also love photos of Bump It Up Walls in your school.
Email Alana, Karen or Paul for an editable copy.