2nd international workshop on

Personalising Feedback

March 2019

Tempe, Arizona as part of the LAK19 conference

The provision of effective and timely feedback of and for learning has been shown to be essential in influencing students’ achievement and promoting autonomy and self-regulation. While assessment practices have received considerable attention over the past two decades, the focus on feedback to students has remained relatively scarce.

The provision of feedback at scale and the personalisation of feedback (using Learning Analytics) has become a sort of holy grail for educators aspiring to improve their students’ learning and their satisfaction with the learning experience.

However, students and educators do not hold the same perception of what constitutes quality feedback. In most cases, the idea of providing feedback is reduced to a summative, corrective and transmissive process, which gives a final judgement on students’ submitted assignments.

Although LA have made tangible connections with critical aspects that can strongly shape learning, such as learning design and self-regulation, the provision of feedback to students has been relatively neglected. This is despite the affordances of LA to leverage the generation of theoretical and technical mechanisms for understanding and improving learning by "informing and empowering instructors and learners" (Siemens & Baker, 2012).

To allow this to happen, teachers need concrete tools and approaches to bridge the gap between LA research and classroom practice. LA systems are starting to support teachers with means to provide rich feedback beyond typical early warning messages (e.g. SRES, Ontask), but it is clear that there is a need and appetite in the LA community of research and practice to further explore data-informed student-centred pedagogies to provide feedback at scale.

While the first workshop with this topic at LAK’18 focused predominantly on tools and their applications, this second workshop shifts the attention to data-driven approaches supporting the provision of feedback, and we encourage submissions to pay more attention to the students, especially considering how they perceive the feedback and what they do with the feedback.

Scope of the workshop

This workshop brings together scholars and practitioners to explore interesting examples of effective feedback and explore what and how data can be used to improve the process and richness of feedback for both learners and educators. The workshop has three primary goals:

  • Provide a multidisciplinary theoretical foundation for practitioners and researchers in LA for the effective provision of data-informed feedback practices in HE;
  • Showcase extant or planned approaches that provide feedback to students and consider students’ reception of the feedback, with a focus on approaches that are data-driven and personalised;
  • Promote reflection on both pedagogical and technological approaches to improve feedback practices targeted at the improvement of student learning and their ability to self-regulate learning.

Who is the workshop for?

Those who wish to understand and apply principles of feedback of and for learning. Given the explicit multidisciplinary nature of the workshop we expect that it will provide an opportunity to discuss and share innovations, impact on learning, and explore future directions in the application of learning analytics (LA) to personalisation of feedback. Likely interested participants are:

  • Educators/teachers and researchers
  • Technologists and educational developers
  • Learning scientists and data scientists/analysts
  • Academic managers
  • and anyone else interested in personalisation of learning and teaching

Outcomes for attending participants

We expect a range of presentations that will cover practical, evidence-based approaches to personalising data-driven feedback at scale. Participants will be able to:

    • Obtain a broad perspective of different approaches to using data for personalising feedback
    • Enhance their understanding of the forms of feedback that could improve student learning
    • Gain an appreciation of the range of contexts where feedback can be valuable, and how data can inform these
    • Discuss cases, issues, and potential solutions to implementing LA-enhanced feedback practices
    • Connect with researchers and practitioners working to provide personalised feedback, yielding opportunities for collaborating on approaches and tools across attending institutions.

After the workshop, given the commitment to further collaborations, contributors will be invited to consider more substantial submissions with the intention to collate the works into either a special issue of a journal, or CEUR proceeding, or an edited book on the topic.

Some References

Bienkowski, M., Feng, M., & Means, B. (2012). Enhancing teaching and learning through educational data mining and learning analytics: An issue brief. US Department of Education, Office of Educational Technology, 1, 1–57.
Black, P., Harrison, C., & Lee, C. (2003). Assessment for learning: Putting it into practice. McGraw-Hill Education (UK).
Brown, S., & Knight, P. (1994). Assessing learners in higher education. Psychology Press.
Carless, D. (2006). Differing perceptions in the feedback process. Studies in Higher Education, 31(2), 219–233. https://doi.org/10.1080/03075070600572132
Carless, D., Salter, D., Yang, M., & Lam, J. (2011). Developing sustainable feedback practices. Studies in Higher Education, 36(4), 395–407. https://doi.org/10.1080/03075071003642449
Crisp, G. (2011). Rethinking assessment in the participatory digital world – Assessment 2.0 (National Teaching Fellowship Fil Report).
Forsythe, A., & Johnson, S. (2017). Thanks, but no-thanks for the feedback. Assessment & Evaluation in Higher Education, 42(6), 850–859. https://doi.org/10.1080/02602938.2016.1202190
Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. routledge.
Hattie, J., & Timperley, H. (2007). The Power of Feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487
Higgins, R., Hartley, P., & Skelton, A. (2002). The Conscientious Consumer: Reconsidering the role of assessment feedback in student learning. Studies in Higher Education, 27(1), 53–64. https://doi.org/10.1080/03075070120099368
Hounsell, D. (2003). Student feedback, learning and development. Higher Education and the Lifecourse, 67–78.
Hounsell, D., McCune, V., Hounsell, J., & Litjens, J. (2008). The quality of guidance and feedback to students. Higher Education Research & Development, 27(1), 55–67. https://doi.org/10.1080/07294360701658765
King, C., Kinash, S., Kordyban, R., & Pamenter, J. (2014). Personalising student learning through education. Bond University. Retrieved from http://epublications.bond.edu.au/tls/87
Krause, K. L., Hartley, R., James, R., & McInnis, C. (2005). The first year experience in Australian universities: Findings from a decade of national studies. Centre for the Study of Higher Education, University of Melbourne Melbourne. Retrieved from http://www.cshe.unimelb.edu.au
Liu, D. Y.-T., Bartimote-Aufflick, K., Pardo, A., & Bridgeman, A. J. (2017). Data-Driven Personalization of Student Learning Support in Higher Education. In Learning Analytics: Fundaments, Applications, and Trends (pp. 143–169). Springer, Cham. https://doi.org/10.1007/978-3-319-52977-6_5
Lizzio, A., & Wilson, K. (2008). Feedback on assessment: students’ perceptions of quality and effectiveness. Assessment & Evaluation in Higher Education, 33(3), 263–275. https://doi.org/10.1080/02602930701292548
McDowell, L., Smailes, J., Sambell, K., Sambell, A., & Wakelin, D. (2008). Evaluating assessment strategies through collaborative evidence‐based practice: can one tool fit all? Innovations in Education and Teaching International, 45(2), 143–153. https://doi.org/10.1080/14703290801950310
Nicol, D. (2009). Assessment for learner self‐regulation: enhancing achievement in the first year using learning technologies. Assessment & Evaluation in Higher Education, 34(3), 335–352. https://doi.org/10.1080/02602930802255139
Nicol, D. (2010). From monologue to dialogue: improving written feedback processes in mass higher education. Assessment & Evaluation in Higher Education, 35(5), 501–517. https://doi.org/10.1080/02602931003786559
Orsmond, P., Maw, S. J., Park, J. R., Gomez, S., & Crook, A. C. (2013). Moving feedback forward: theory to practice. Assessment & Evaluation in Higher Education, 38(2), 240–252. https://doi.org/10.1080/02602938.2011.625472
Pardo, A. (2017). A feedback model for data-rich learning experiences. Assessment & Evaluation in Higher Education, 0(0), 1–11. https://doi.org/10.1080/02602938.2017.1356905
Pardo, A., Jovanovic, J., Dawson, S., Gašević, D., & Mirriahi, N. (n.d.). Using learning analytics to scale the provision of personalised feedback. British Journal of Educational Technology, 0(0). https://doi.org/10.1111/bjet.12592
Pitt, E., & Norton, L. (2017). ‘Now that’s the feedback I want!’ Students’ reactions to feedback on graded work and what they do with it. Assessment & Evaluation in Higher Education, 42(4), 499–516. https://doi.org/10.1080/02602938.2016.1142500
Poulos, A., & Mahony, M. J. (2008). Effectiveness of feedback: the students’ perspective. Assessment & Evaluation in Higher Education, 33(2), 143–154. https://doi.org/10.1080/02602930601127869
Radloff, A., Coates, H., James, R., & Krause, K.-L. (2011). Report on the Development of the University Experience Survey. Higher Education Research. Retrieved from http://works.bepress.com/hamish_coates/79
Rowe, A. D., & Wood, L. N. (2009). Student Perceptions and Preferences for Feedback. Asian Social Science, 4(3), 78. https://doi.org/10.5539/ass.v4n3p78
Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. https://doi.org/10.1007/BF00117714
Sadler, D. R. (2010). Beyond feedback: developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35(5), 535–550. https://doi.org/10.1080/02602930903541015
Siemens, G., & Baker, R. S. J. d. (2012). Learning Analytics and Educational Data Mining: Towards Communication and Collaboration. In Proceedings of the 2Nd International Conference on Learning Analytics and Knowledge (pp. 252–254). New York, NY, USA: ACM. https://doi.org/10.1145/2330601.2330661
Tempelaar, D. T., Rienties, B., & Giesbers, B. (2015). In search for the most informative data for feedback generation: Learning analytics in a data-rich context. Computers in Human Behavior, 47(Supplement C), 157–167. https://doi.org/10.1016/j.chb.2014.05.038
Vigentini, L., Liu, D. Y.-T., Lim, L., & Martinez-Maldonado, R. (2018). Personalising feedback at scale: approaches and practicalities. In Companion Proceedings of the 8th International Conference on Learning Analytics & Knowledge (LAK’18).
Weaver, M. R. (2006). Do students value feedback? Student perceptions of tutors’ written responses. Assessment & Evaluation in Higher Education, 31(3), 379–394. https://doi.org/10.1080/02602930500353061
Williams, J., & Kane, D. (2008). Exploring the National Student Survey Assessment and feedback issues. The Higher Education Academy, Centre for Research into Quality.