Replicability Project: Health Behavior (RP:HB)

Advancing Scientific Integrity Through Replication in Health Research

Overview

The credibility of scientific findings is essential to public trust and evidence-based decision-making. In health research, published studies shape policy, guide clinical practice, and influence funding priorities, underscoring the importance of credible findings in those literatures. Although replication studies can be resource-intensive, they play a critical role in strengthening the evidence base. By re-examining the same research questions using new data, replication efforts can contribute to theoretical understanding, reduce uncertainty, and increase confidence in reported conclusions.

The Center for Open Science (COS) is launching the Replicability Project: Health Behavior (RP:HB), a large-scale, multi-team effort to replicate a diverse sample of published quantitative studies to help support a transparent and trustworthy foundation in health research. The project aims to assess the robustness of findings and promote best practices in research transparency, methodological rigor, and reproducibility.

This project is supported by grant funding from the Robert Wood Johnson Foundation and XTX Markets.

Who should get involved?
We are seeking researchers with experience in quantitative methods, particularly in the social scientific study of health behavior and related fields, such as public health, epidemiology, health policy, and behavioral science. We welcome individual scholars, labs, and research teams across all career stages and institutions to join the effort.

What studies are being replicated?
Replications will focus on a sample of studies published between 2015 and 2024 in the following journals:

How to Participate

There are two ways you can get involved with this initiative, and you may participate in either or both activities:

Replication: Perform a replication of an original study by investigating the same empirical claim selected from the original paper by collecting new data or secondary data sources independent from the data used in the original study.
Rapid peer-review: Review preregistrations describing the planned protocol for these replication studies to ensure rigor and transparency; can serve as a Reviewer and/or as an Editor.

If you are interested in joining this initiative, please complete the general interest sign-up form. If you have any questions, feel free to reach out by filling out the contact form below.

Key Information for Replicators

Expertise: We are looking for quantitative researchers with the expertise to conduct good-faith, high quality replications in the research domains outlined above.
Timeline: All replication studies must be completed and reported to COS by December 1, 2026.
Funding: We have limited funding that will enable us to support replication projects. Based on available funds, COS is offering $750 USD for each complete secondary data replication study. We are currently limiting each research team to a maximum of three replication studies.
Transparent research practices: Replicators will be asked to preregister their replications, upload all of their materials and outputs to a repository of their choice, link their outputs to their preregistration, and report their outcomes to the project team. COS employees will be available for guidance with carrying out these open science practices.

Process & Timeline

We are accepting general interest sign-ups until November 1, 2026. The current round of the initiative will focus on secondary data replications (e.g. use of existing longitudinal surveys, public health databases, or case surveillance systems). Replication sign-ups and funding will be approved on a rolling basis, so we recommend signing up as soon as possible to secure a replication study you are interested in. All replications must be completed and reported to COS by no later than December 1, 2026.

Sign-Up
If you are interested in joining this initiative as a replicator, please begin by viewing the available replication studies on our replication sourcing sheet. To sign up for the replication(s) of interest to you, follow the link provided in row K. We will be in touch within a few days with additional information.

Approval & Onboarding
Once we confirm that the study you are interested in replicating is feasible given the projected timeline and budget, we will send you additional instructions and next steps to get started on your replication. One of the first steps will be signing an agreement through your institution in order to receive your honorarium once your replication is complete. You will also be asked to complete a priori analysis to estimate the approximate power of your replication study before completing your preregistration and carrying out your study. Templates and other resources you will need to carry-out your replication are provided on the RP:HB OSF project.

Preregistration & Ethical Review
If your study requires ethical review, you must submit your study for review via your local institution as soon as possible as you will need to receive approval before beginning data collection.

To foster transparency and careful planning, you will complete a preregistration of your replication protocol to document the details of your methodological and analytical approach. We will provide you with a template to use along with guidance on how to fill it out. After your preregistration draft is complete, it will go through a review process where peers will have one week to review and provide comments on your protocol. Once you have addressed the reviewers feedback, your protocol will be approved by an editor to move forward (pending ethics approval if required).

Following preregistration and ethical approval, you will register your study on the OSF (instructions will be provided).

Data Collection
You may begin data collection as soon as your study has been registered on the OSF. Please keep COS informed on the progress of your data collection, and let us know if you encounter any setbacks or difficulties with achieving your target sample size.

Analysis & Outcome Reporting
Once your study is registered on the OSF, you will be able to conduct your pre-planned analysis with the dataset approved by COS. Then you will complete a reporting form to document your outcomes, and upload all sharable outputs (including deidentified data) to a repository of your choice, linking your data, code, and materials to your OSF preregistration. A team member from COS will validate your outcomes and verify that you have linked your materials. All replication studies must be complete and reported to COS by December 1, 2026.

Frequently Asked Questions

Will funding be provided for these replication studies?

Researchers will receive a $750 USD honorarium upon completion of each replication. Replication studies and funding will be approved on a rolling basis, so we recommend you sign-up as soon as possible to secure a replication study you are interested in.

Can I change the identified claim from the paper?

No, the claims were identified following an established process, and maintaining the same claim is important for the goals of this project.

Why health research?

Replication challenges have been well-documented across disciplines, yet health research stands out in its direct implications for human health and well-being. By revisiting published findings systematically, this project contributes to broader efforts to strengthen research credibility and better understand characteristics of studies that remain consistent (or not) when independently replicated.

Can we publish our replication outcomes as a preprint? Or submit our study for publication in a journal?

Replication teams are encouraged to publish their replication outcomes publicly as a preprint, however we ask that you wait to do so until December 2026, at which point all of the outcomes from the replication effort will be made public. Teams are also free to submit their replication study for publication in a journal - we just ask that you notify us before you do so, and keep the OSF project, outcomes, and drafts of the publication private until we are ready to make all replication outcomes public.

Will there be other authorship opportunities (for this replication effort at large)?

COS plans to lead a collaborative paper/report to summarize all of the replication outcomes included in this effort. We will invite all researchers who participate in the replication effort to be co-authors on the paper (this includes all replicators, as well as preregistration reviewers and editors).

What is the OSF?

The OSF is a free, open-source platform for creating and linking transparent research records. OSF enables researchers to register study plans, publish preprints through community-run services, and link externally to related data, materials, code, publications, and other results.

As part of this project, replicators will use OSF to preregister their study, not to upload their outcomes or study materials.

Learn more at cos.io/products/osf.

What do we mean by replication?

We use the term replication, in the context of this project, to mean investigating the same empirical claim from an original study in a new sample (i.e., by collecting new data, or by using secondary data sources independent from the data used in the original study). More broadly, replication can be understood as a study for which any outcome would be considered diagnostic evidence about a claim from prior research. The purpose of replication is to advance theory by confronting existing understanding with new evidence. See this article for a more comprehensive discussion of replication.

How do I determine the sample size for my replication study?

The replication team will be responsible for conducting an a priori power analysis to determine the target sample size. The collaborator should conduct an appropriate power analysis for their study design and analytical approach, and use an alpha level of .05 to achieve 90% power to detect the claim’s focal effect or analytical result. We will provide resources (R scripts, templates) to assist you with calculating your sample size. If needed, we are available to consult and assist with your power analysis. Your preferred dataset, power analysis, target sample size, and justification will be submitted to COS for review before moving onto next steps. These items, along with the rest of your methodology and analysis plan, will be reviewed by peer researchers during the ‘Preregistration Review’ process.