SUBVERSIVE LEARNING ANALYTICS WORKSHOP
LAK22 - MARCH 21-25 2023
LAK22 - MARCH 21-25 2023
WORKSHOP SUMMARY
The challenges that emerge from the use of educational data in sociotechnical systems have received increasing attention in recent years. However, much of the discussion has centered around analysis of problems, such as issues of ethics and equity, or solutions to specific local quandaries. We lack holistic examination of embedded assumptions and values contributing to such problems and radical innovation of LA that might shift us away from such paradigms. In this half-day interactive workshop, we take up the idea of a “subversive stance” as a tool for generative discussions and insights around these questions and to spur ideas for unorthodox possibilities in LA that support equitable educational practices. Participants will reflect about deep seated assumptions of our discipline, consider alternatives, and ideate LA artifacts that could deal with these challenges.
FORMAT & PARTICIPATION
This first Subversive Analytics workshop will be a half-day workshop. It will be held as a highly interactive synchronous remote event with up to 25 participants. We choose to enact this workshop remotely since it allows for more equitable participation by those who may not be able to travel to Texas for the conference. No application is required, simply click here to register through the LAK'23 website.
Participants can be academics, researchers, practitioners, or students with an interest in Learning Analytics and values-based innovation, as well as critical frameworks and education. Because of the nature of the topic, both those who are highly specialized in LA and those who are beginners in the field are equally welcome. We particularly encourage participation of those who have experience and expertise in considering questions of equity in education. A survey will be distributed amongst participants before the event to better understand their backgrounds and what value systems or experiences they can bring to the discussion.
The workshop activities will introduce the community to the subversive LA approach, exploring together some of the deep seated assumptions in educational practice, and collectively imagining unconventional tools and artifacts. We do so in this instance with a particular focus on equity and the support of equitable practices, noting that a subversive stance could also be taken with respect to other foci.
OBJECTIVES & OUTCOMES
The workshop activities will be guided by three objectives:
Inquire collaboratively into some of the deep seated assumptions and values embedded in educational systems that currently guide LA work.
Explore how different forms of thinking, questioning, or valuing can open spaces of possibility for future LA design.
Generate novel avenues for development of LA to support equitable practice.
This work will lay the foundation for both people- and idea-focused outcomes.
Kickstart a community of LA practitioners, researchers and educators interested in exploring how different educational frameworks and value systems can contribute to, and be used to innovate the practice of LA
Develop the foundation for a publication that disseminates key ideas about the relationship between values, design and LA that emerged in the workshop.
BACKGROUND & RATIONALE
Innovation has been said to stem from one of two processes. Incremental innovation emerges from evaluating existing situations and pragmatically detecting the gaps for improvement which themselves depend on its embedded value systems (Norman & Verganti, 2013). “Scaling up” an existing practice, or making it “more efficient” are examples of this. To date, the bulk of LA work has been conducted within this tradition, accepting the frame of existing educational institutions and their historical value systems and attempting to use data for “understanding and optimising” their practice (Siemens et. al., 2011). There is another way to innovate, however. A radical approach to innovation creates the possibility for bigger change: a change in core meaning or a shift in paradigms (Norman & Verganti, 2013). One way to foster such innovation is by consciously calling into question the values that are embedded in a system. Instead of being restricted to operating from within, such a process for innovation invites critical change by reflecting on the whys behind practice, meaning behind assumptions, and unorthodox possibilities for futures that might support alternative value systems.
The current landscape of, socio-technical challenges surrounding the generation, analysis and use of data in education, including critical concern with the intersecting ways we engage with algorithms (Noble, 2018), AI (Broussard, 208), ethics(Prinsloo, 2017), surveillance (Benjamin, 2019) and equity (Scholes, 2016) suggest that although an incremental approach to LA development has value, it is not enough. To move towards developing a space for radical innovation in the field, Wise, Sarmiento and Boothe Jr. (2021) presented the idea of a “subversive stance” for LA. The concept draws from a number of critical traditions, including speculative design (Wong & Khovanskaya, 2018), the study of socio-technical systems (Achiume, 2014), feminism (D’Ignazio & Klein, 2021) and design activism (Costanza-Chock, 2018) and proposes ways to help us identify taken-for-granted assumptions-in-practice, ask generative questions about design processes and consider new models of creation to produce tools that may operate differently in educational ecosystems.
Such activities can help us move beyond recognition of problems related to the use of data in education and narrow attempts to ameliorate them in a specific application to take a broader perspective on the different roles that LA could play in educational data ecosystem; for example illuminating the boundaries of where technology can and cannot help, making the dimensions of problems more salient and vivid (Abebe et. al., 2020), or being an agent for equitable practices (Williamson & Kizilcec, 2022).
PREPARATION RESOURCES
Subversive Learning Analytics.
LAK'21 paper by Wise, Sarmiento & Boothe Jr conceptualizing subversive LA approach
Open Access Book by Costanza-Chock (2020) describing community-led practices to build the worlds we need
Design Justice Network Principles
A short, living document, summary of 10 principles for design justice
Open Access Book by D'Ignazio & Klein (2020) describing a new way of thinking about data science and data ethics informed by the ideas of intersectional feminism.
Organizers
Juan Pablo Sarmiento
New York University
Alyssa Friend Wise
New York University