Bonnes pratiques / Good practices materials

2018-2019 materials

On 2018-09-21, we covered basic good practices & reading empirical literature, with a special visit by STAN co-creators Mitzi Morris & Bob Carpenter, where we discuss Bayesian and frequentist statistics (slides in pdf, slides in pptx, audio1, audio2, audio3).

M2s: Remember you can begin thinking about your pre-registration!!

2017-2018 materials

The first session took place on 2017-09-15 and covered basic good practices & reading empirical literature (slides, mp3-1 and mp3-2).

The second session took place on 2017-09-28 (slides, self-assessment, speed-dating 2017)

M2s: Remember you can begin thinking about your pre-registration and come with questions!!

2016-2017 materials

We had three sections:

1. Section 1: "Lecture", with some easily-implemented solutions for common issues (biased lit review, data/code/idea loss)
2. Section 2: Work on science versus pseudo-science, an applied example, and authorship issues through some text extracts.
3. Section 3: Work on pre-registration for an ongoing project (all in situ).

Train yourself to detect good and suboptimal research practices

2015-2016 materials

How to do this exercise:

1. Download the 2015 materials (a lab notebook, some raw data and an analysis script)
2. Read the lab notebook once over. You can also replicate the analyses and explore the data yourself.
3. Re-read the lab notebook paying close attention to it, in order to detect both good and questionable research practices. Make a list of them, perhaps annotating the pdf.
4. Once you think you have found them all, look at the solutions here. If you find cases of disagreement (e.g., where the solutions mark something as questionable, but you don't see the problem), go back to the overviews of biases and questionable research practices and use this disagreement to reflect on these issues.

Acknowledgments: The notebook was prepared mainly by Hannah Metzler; data created and analyzed by Alex Cristia; solutions made independently by Christina Bergmann, and augmented with feedback from students. Hannah, Alex, and Sylvain Charron presented the exercise to students in the 2015 Journée.

2014-2015 materials

How to do this exercise:

1. Download the 2014 materials (a lab notebook, some raw data and an analysis script)
2. Read the lab notebook once over. You can also replicate the analyses and explore the data yourself.
3. Re-read the lab notebook paying close attention to it, in order to detect both good and questionable research practices. Make a list of them, perhaps annotating the pdf.
4. Once you think you have found them all, look at the solutions here. If you find cases of disagreement (e.g., where the solutions mark something as questionable, but you don't see the problem), go back to the overviews of biases and questionable research practices and use this disagreement to reflect on these issues.

Acknowledgments: The notebook was prepared mainly by Alex de Carvalho; data created and analyzed by Alex Cristia; solutions made completely independently by Emmanuel Dupoux. All three presented the exercise to students in the 2014 Journée.

2013-2014 materials

How to do this exercise:

1. Download the 2013 materials (a lab notebook, some raw data and an analysis script) (coming one day!)
2. Read the lab notebook once over. You can also replicate the analyses and explore the data yourself.
3. Re-read the lab notebook paying close attention to it, in order to detect both good and questionable research practices. Make a list of them, perhaps annotating the pdf.
4. Once you think you have found them all, look at the solutions here (coming one day!). If you find cases of disagreement (e.g., where the solutions mark something as questionable, but you don't see the problem), go back to the overviews of biases and questionable research practices and use this disagreement to reflect on these issues.

Acknowledgments: The notebook, data, and data analyses were done by Alex Cristia; solutions made completely independently by Emmanuel Dupoux. Emmanuel Dupoux and Sylvain Charron presented the exercise to students in the 2013 Journée.