What do I need to bring to this workshop?
You can bring your laptop, especially if you plan to participate in workshop activities where that will be useful (e.g., Python coding). No other tech is needed.
I'm just one researcher, do I need to have a team with me to this workshop?
No. You can come by yourself. For activities that require both computational and qualitative methods, we will partner people accordingly.
How exactly does the QRF app tell me when to conduct an interview?
Interviews can be prompted by different kinds of interactions with an online learning system--as long as that data is available in the back-end of the learning system. They have been prompted by complex machine learned models (e.g., affect detectors and carelessness detectors) as well as by simple actions (e.g., placing blocks in Minecraft). What you use to prompt your interviews depends upon your research question.
Isn't this process disruptive to the students?
Talking to an interviewer is a lot like having another adult talking to you while you are working on your assignments. No student is ever required to let us interview them, but most usually seem to enjoy it. In fact, if students are struggling, they usually have a lot to say about their learning experience and they are sometimes relieved to have someone to talk about it with! Interviewers try to keep each interview relatively short and can sometimes tell a lot just by sitting next to the student and observing them if the student pauses the interview to keep working. Although the interview questions vary depending on your research question, each interview almost always asks the student about what they're working on. Talking about their work can sometimes be beneficial to learning!
How do students feel about this process?
We tell students that we are there to learn how to make the software better, and most students like to be helpful. Other than the interview recordings, QRF does not require or collect sensor data, and the interviewers are not there to get students in trouble. In fact, our job as interviewers is to keep students at ease so that they can tell us why they are struggling with the software or what they dislike about it, if that is part of our research question.
How do I choose what to use to prompt an interview?
DDCIs are very adaptable to a wide range of research questions, so in many ways this depends upon your research goals. Learning theories can inform the type of behavioral indicators you would like to investigate further. Data-driven analyses can be used to determine behaviors that are highly correlated to the construct(s) you are investigating.
What happens to the recordings of these interviews?
Interview recordings are stored either locally on the phone (behind password-protection) or behind firewalls in the research team's data server. In our labs, all recordings are destroyed once transcription is complete, further insuring student privacy.