Little work has been done in proposing the steps that other researchers or designers can use as a guidance to structure participatory sessions to understand critical aspects of the envisaged use of LA tools and the actual data needs that stakeholders may have. This workshop aims at consolidating the subcommunity of LA researchers and practitioners interested in the human factors related to the effective design of LA innovations. In doing so, we plan to address questions such as: What has been done so far in HCLA, and what have we learned from these experiences? Within the context of our field, how do we define some fuzzy concepts such as "participatory", "co-design" and "human-centeredness"? Finally, as a community, what do we want to know (research agenda) from now on?
Thus, the intended outcome of this workshop is twofold:
Outcome 1: A plan for the consolidation of a new Special Interest Group dedicated to the study and practice of HCLA within the larger TEL, LA and HCI community, within EATEL (https://ea-tel.eu/) at the European level, and eventually under the umbrella of IAALDE (International Alliance to Advance Learning in the Digital Era: https://alliancelss.com/); and
Outcome 2: The publication of a report summarising the workshop experience and, hopefully, a “roadmap manifesto” setting a research agenda for HCLA.
The workshop is envisioned to be a half-day, fully online workshop. This workshop welcomes everyone with an interest in the field, from beginners to experts. We will not have a call for papers. Participants can range from researchers and practitioners in the TEL and LA fields, including both experienced and novel ones. We welcome with special interest graduate students from these fields, as well as researchers with experience in the Human-Computer Interaction (CHI) field. Instead, participants will be asked to fill a survey which will capture previous experiences in HCLA as well as current understandings of design aspects that will be relevant for the discussions during the workshop. In particular, participants will be asked to share their experience with Human-Centred Design or Human-Centred LA; to define Human-Centred Design; to share what design methods they are familiar with; future plans to adopt Human-Centred Design methods in LA projects.
Workshop activities
The workshop is divided into four parts:
1. Overview of HCLA. In the first part of the workshop, and based on the survey results, we will present a number of processes, frameworks and examples for engaging in participatory/co-design processes with students, faculty or administrators, emphasising both opportunities and challenges.
2. Human-Centred Design challenge. The second part of the workshop is a collaborative design challenge. Participants will engage in creating a research design plan by using human-centred methodologies. They will be grouped in teams of 4-5 people, and go to virtual breakout rooms. They will be presented with a design need and asked to work together designing a human-centred design project to handle the need. Groups will be prompted to consider methodologies such as Value-Sensitive Design, Co-design and generative tools in planning their projects.
3. Sharing and guided critique. The third part will be a discussion based on the experience co-designing the human-centred plans. A number of discussants from other communities (e.g. human-computer interaction, interaction design, participatory design and information visualisation), and some that critique Human-Centred Design methods, will be invited to the workshop to give their critical points of view on the ideas posed in the design plans. We expect that this will lead to a discussion of the pros and cons of Human-Centred Design techniques, what needs to be adapted to fit LA purposes and the differences of meaning of Human-Centred Design for different people.
4. Discussion on next steps. All participants will be invited to contribute with ideas to set a potential HCLA research agenda and the potential configuration of a dedicated Special Interest Group (SIG).
University of Valladolid, Spain
Graz University of Technology, Austria
Universitat Pompeu Fabra, Spain
New York University, US
New York University, US
University of California Irvine, US
Monash University, Australia
Buckingham Shum, S., Ferguson, R. and Martinez-Maldonado R. (2019). Human-Centred Learning Analytics. Journal of Learning Analytics, JLA, 6(2): 1-9.
Dimitriadis, Y., Martínez-Maldonado, R., & Wiley, K. (2021). Human-Centered Design Principles for Actionable Learning Analytics. Research on E-Learning and ICT in Education: Technological, Pedagogical and Instructional Perspectives, 277-296.
Ochoa, X., & Wise, A. F. (2020). Supporting the Shift to Digital with Student-Centered Learning Analytics. Educational Technology Research and Development, 1-5.
Sarmiento, J. P., Campos, F., & Wise, A. (2020). Engaging Students as Co-Designers of Learning Analytics. Companion Proceedings 10th International Conference on Learning Analytics & Knowledge (pp. 29–32). Frankfurt, Germany: SoLAR.
Dollinger, M., Liu, D., Arthars, N., & Lodge, J. (2019). Working Together in Learning Analytics Towards the Co-Creation of Value. Journal of Learning Analytics, 6(2), 10–26.
Wise, A. F., & Jung, Y. (2019). Teaching with Analytics: Towards a Situated Model of Instructional Decision-Making. Journal of Learning Analytics, 6(2), 53-69.
Holstein, K., McLaren, B. M., & Aleven, V. (2019). Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher–AI Complementarity. Journal of Learning Analytics, 6(2), 27–52.
Ahn, J., Campos, F., Hays, M., & Digiacomo, D. (2019). Designing in Context: Reaching Beyond Usability in Learning Analytics Dashboard Design. Journal of Learning Analytics, 6(2), 70–85.
Rehrey, G., Shepard, L., Hostetter, C., Reynolds, A. M., & Groth, D. (2019). Engaging Faculty in Learning Analytics: Agents of Institutional Culture Change. Journal of Learning Analytics, 6(2), 86–94.
Carlos G. Prieto-Alvarez et al., "Co-designing learning analytics tools with learners". In Jason M. Lodge, Jared Cooney Horvath, & L. Corrin (Eds.), Learning analytics in the classroom: Translating learning analytics research for teachers. (London: Routledge, in press,2018).