Join us for a unique Reproduction Hackathon (ReproHack) on language learning! This is your chance to take a deep dive into current language acquisition research, sharpen your reproducibility skills, and collaborate with students, early-career and seasoned researchers in a constructive, low-pressure environment. You will make a valuable contribution to the research community and will have the opportunity to publish your findings in a peer-reviewed journal.
📅 Wed 7 July 2027
📍 University of Cologne & Online
Join us in Cologne and stay on for WoReLa 2 or join an online team and participate from anywhere in the world 🗺️
A ReproHack is a one-day event during which students, early-career and senior researchers collaborate to reproduce and verify the results of published studies to assess their reproducibility and robustness. We will pre-select a list of recent language acquisition studies from international journals including Applied Psycholinguistics, Cognition, and Language Learning that feature open data and, where applicable, open code.
Get in touch with your team (we can assign you to a team or you can apply as a team).
Select an article from our pre-selected list of suitable papers.
Familiarise yourself with the article and its associated materials (data, code, annotation scheme, etc.).
Work with your team to reproduce the results, collaborate to solve problems, and document your process.
Benefit from the support and expertise of the organising team and all other participants.
Write a report on your reproduction success and/or the challenges that you encountered.
Have a great time!
You will share your finalised report with the organising team.
If necessary, you will revise your report based on our feedback.
We will then share your report with the original authors and, if necessary, you will revise it based on their feedback.
You will publish your revised report either on an online repository or submit it to a journal for peer review. There will be the opportunity to publish high-quality reports in a special issue of the diamond open-access journal Replication Research.
We will invite you to co-author a big-team-science paper summarising our collective experiences on the reproducibility of current language learning publications.
This is not about criticising colleagues; it's about strengthening the robustness of language learning research. Your report will be checked by the organising team, shared with the original authors for feedback, and ultimately published to improve the transparency and reusability of future language learning research.
Never conducted a reproduction study or robustness test before? No problem! We will provide an onboarding meeting, online workshop demonstrating how to reproduce a study and conduct robustness checks, and educational materials to get you up to speed. Only a genuine interest in language learning research and basic coding skills in either R or Python are needed to participate.
You can choose to publish your report with your name or anonymously. You may also submit your report to a peer-reviewed journal. There will be the opportunity to publish in a special issue of the diamond open-access journal Replication Research.
Everyone who has submitted a revised report will receive an invitation to co-author a big-team-science paper summarising our collective experiences on the reproducibility of current language learning publications.
Date: Wednesday, 7 July 2027
Location: University of Cologne & Online
Participants: Linguistics students and researchers of all career stages with at least some experience in R, Python or another programming language and an interest in language learning research
Funding: We are applying for funding to cover a handful of travel stipends for students and linguists with limited resources to attend the hackathon and/or WoReLa 2.
Organising committee: Elen Le Foll, Luca Leppert, Onur Özsoy, Job Scheppens, Gabriele Schwiertz, Gina Reinhard, Eva Scheel, Mara van der Ploeg, Anya Vinichenko.
All images from libreclipart.org (CC0)