Why your code doesn't reproduce: Lessons learned from the journal Meta-Psychology
Channel: Center for Open Science
Date: 2023-04-05

In this workshop, the editorial assistant and editor-in-chief of Meta-Psychology share their experience with reproducing code and analysis during the editorial process. We explain the pitfalls and good practices we discovered during the past five years of conducting these reproducibility checks. We provide a guide on how to make the reproducibility of code smoother and how to make it accessible to everyone who wants to be able to reproduce the results. We go through the entire process from the start, including data management, naming conventions, repositories (e.g., OSF), containers (e.g., Code Ocean), code format (e.g., markdown), and software choices (e.g., R), as well as how the code output corresponds to the results reported in the manuscript. We aim to make this workshop accessible to people with different levels of coding experience. We also show how reproducible GUI software (e.g. Jamovi) can be a good alternative for those without any coding experience. During the workshop, participants will have the opportunity to try and reproduce code from accepted articles on educational research topics.