The Preregistration Challenge, a new competition announced today by the Center for Open Science (COS), incentivizes transparent research by awarding 1,000 researchers with $1,000 for publishing the results of their preregistered studies.
“Scientists value objectivity and transparency in the practice of science,” says David Mellor, project manager at the Center for Open Science. “However, we are rewarded at nearly every step for making results both cleaner and more surprising. Preregistration helps keep our motivated reasoning in check when analyzing data and presenting our results.”
“There are so many decisions that take place during the analysis of a typical research project,” says Courtney Soderberg, Statistical and Methodological Consultant at COS, “and seeing the data can affect those decisions, steering the researcher toward more exciting looking results. Preregistration simply requires making some of the analysis decisions upfront, before the data are known, so that reasoning biases cannot affect what analyses and results to take seriously.”
COS increases transparency and reproducibility in research by lowering barriers and increasing incentives to practice open science. This mission led to the creation of the Preregistration Challenge. Researchers will be rewarded for publishing the results of studies preregistered on the Open Science Framework, a free and open source scholarly commons designed to support researchers with tools for project management, sharing, and archiving.
Though required by law for clinical trials, preregistration is virtually unknown in pre-clinical and basic research. The goals of the Preregistration Challenge are to increase awareness of preregistration, educate the research community about its potential, and initiate it as a normal part of the research workflow.
“We’re using cash prizes to motivate this new behavior because it is a new step for a busy group of people. We believe that researchers will find this process valuable once they give it a try, so we are trying to help them get over the initial hurdle to do so,” according to Jolene Esposito, project manager at COS.
In addition to a guided process for preregistration, the Preregistration Challenge offers education and support materials to teach researchers about preregistration and help them through the process. Those interested in the Preregistration Challenge can visit the project page to learn more and initiate the process.
Center for Open Science
The Center for Open Science (COS) is a non-profit technology startup founded in 2013 with a mission to increase openness, integrity, and reproducibility of scientific research. The Center for Open Science has a variety of initiatives to increase the transparency and reproducibility of scientific research. Recently published in the journal Science, the Transparency and Openness Promotion (TOP) Guidelines are a set of standards designed for academic journals and funders to increase the transparency and reproducibility of research. Badges to acknowledge open practices allow journals to signal and reward transparent research. Finally, journals that adopt Registered Reports take preregistration one step further and reduce publication bias by conducting peer review prior to data collection. This improves the likelihood that journals publish the most accurate and methodologically rigorous research, instead of the flashiest findings. Learn more at cos.io and osf.io.
Responsible stewards of your support
COS has consistently earned a Guidestar rating of Platinum for its financial transparency, the highest rating available. You can see our profile on Guidestar. COS and the OSF were also awarded SOC 2 accreditation in 2022 after an independent assessment of our security and procedures by the American Institute of CPA’s (AICPA).
We invite all of our sponsors, partners, and members of the community to learn more about how our organization operates, our impact, our financial performance, and our nonprofit status.