--- title: Measuring Research Transparency description: Measuring the transparency and credibility of research is fundamental to our mission. By having measures of transparency and credibility we can learn about the current state of research practice, we can evaluate the impact of our interventions, we can track progress on culture change, and we can investigate whether adopting transparency behaviors is associated with increasing credibility of findings. image: https://www.cos.io/hubfs/transparency%20blog%20image.png --- - Our sites: - [OSF](https://osf.io) - [TOP Guidelines](https://www.cos.io/initiatives/top-guidelines) - [* *Bluesky](https://bsky.app/profile/cos.io)[* *Mastodon](https://fosstodon.org/@CenterforOpenScience)[* *Linkedin](https://www.linkedin.com/company/center-for-open-science/)[* *YouTube](https://www.youtube.com/@CenterforOpenScience) - [**  Shop](https://www.redbubble.com/people/OpenScience/shop) - [**  Donate](https://www.cos.io/support-cos) [![Center for Open Science](https://www.cos.io/hs-fs/hubfs/Logos/COS%202024/cos-full-tag-h.png?width=2000&height=293&name=cos-full-tag-h.png "Center for Open Science")](https://www.cos.io) ** ** # Measuring Research Transparency May 17th, 2022, [Brian Nosek](https://www.cos.io/blog/author/brian-nosek) Posted in: [Transparency](https://www.cos.io/blog/tag/transparency), [Community](https://www.cos.io/blog/tag/community), [TOP Guidelines](https://www.cos.io/blog/tag/top-guidelines), [Open Science](https://www.cos.io/blog/tag/open-science) ![](https://www.cos.io/hubfs/transparency%20blog%20image.png) Measuring the transparency and credibility of research is fundamental to our mission. By having measures of transparency and credibility we can learn about the current state of research practice, we can evaluate the impact of our interventions, we can track progress on culture change, and we can investigate whether adopting transparency behaviors is associated with increasing credibility of findings. Transparency Frameworks To measure transparency, we have to know what it means to do transparent research. The [TOP Guidelines](https://www.cos.io/initiatives/top-guidelines) is a modular framework that is applicable across all types of research. With TOP, we can establish a common language such as "Did you share your data?" with recognition that "data" and how they are shared will vary widely across fields and methods. Other reporting standards such as those cataloged at the [Equator Network](https://www.equator-network.org/) are methodology or field specific definitions that complement TOP by articulating what it means to be transparent for a particular kind of research. Transparency Surveys Dozens of surveys have been conducted in different fields assessing researchers’ past, current, and planned transparency behaviors. The [Open Scholarship Survey](https://www.cos.io/initiatives/open-scholarship-survey) consolidates that work into a single, standardized, modular survey that can be administered to researchers in any field. The advantages of standardization include: more data and investment in validating and improving the specific measures, facilitating comparisons across fields and over time, and lowering the barrier to conducting surveys in new samples with a flexible, off-the-shelf solution. Automated Extraction of Transparency Behavior from Papers Many groups have conducted research projects that manually code a sample of papers from a field to assess current practices. These are useful but highly effortful. If machines can be trained to do the work, we will get much more data, more consistently, and much faster. There are at least three groups that have made meaningful progress creating scalable solutions: [Ripeta](https://ripeta.com/), [SciScore](https://www.sciscore.com/), and [DataSeer](https://dataseer.ai/). These groups are trying to make it possible, accurate, and easy to assess many papers for whether the authors shared data, used reporting standards, identified their conflicts of interest, and other transparency relevant actions. Creating a culture of transparency and openness in research is central to COS’s mission. Effective measurement is essential to advancing that mission. The proliferation of tools and standardization of formats for measuring open practices will inform strategy and impact assessment for all reform-minded organizations and accelerate our collective impact. ### Recent Posts ![Center for Open Science](https://www.cos.io/hubfs/Logos/COS%202024/cos-full-tag-h-w.png) 6218 Georgia Avenue NW, Suite #1, Unit 3189 Washington, DC 20011 Email: [contact@cos.io](mailto:contact@cos.io) - [* *Bluesky](https://bsky.app/profile/cos.io) - [* *Mastodon](https://fosstodon.org/@CenterforOpenScience) - [* *Linkedin](https://www.linkedin.com/company/center-for-open-science/) - [* *YouTube](https://www.youtube.com/@CenterforOpenScience) **Join our mailing list** [![Creative Commons License](https://i.creativecommons.org/l/by/4.0/88x31.png)](http://creativecommons.org/licenses/by/4.0/) Unless otherwise noted, this site is licensed under a [Creative Commons Attribution 4.0 International (CC BY 4.0) License](https://creativecommons.org/licenses/by/4.0/). [Translation Help](https://www.cos.io/how-to-translate) | [Terms of Use](https://github.com/CenterForOpenScience/centerforopenscience.org/blob/master/TERMS_OF_USE.md) | [Privacy Policy](https://github.com/CenterForOpenScience/centerforopenscience.org/blob/master/PRIVACY_POLICY.md) - [**About**](https://www.cos.io/about) - [Team](https://www.cos.io/about/team) - [Board](https://www.cos.io/about/board) - [Partners](https://www.cos.io/about/partnership-framework) - [News](https://www.cos.io/about/news) - [Impact](https://www.cos.io/impact) - [History](https://www.cos.io/timeline) - [Finances](https://www.cos.io/about/finances) - [Compliance and Standards](https://www.cos.io/compliance-and-standards) - [Diversity, Equity & Inclusion](https://www.cos.io/about/diversity-equity-and-inclusion-at-cos) - [Careers](https://www.cos.io/careers) - [**Engage**](https://www.cos.io/engage) - [Tools](https://www.cos.io/tools) - [Training](https://www.cos.io/services/training) - [Community Building](https://www.cos.io/community-building) - [Policy Reform](https://www.cos.io/policy-reform) - **  [Donate](https://www.cos.io/support-cos) - [**Open Science**](https://www.cos.io/open-science) - [Preregistration](https://www.cos.io/initiatives/prereg) - [Registered Reports](https://www.cos.io/initiatives/registered-reports) - [**Research**](https://www.cos.io/services/research) - [SCORE](https://www.cos.io/score) - [RP: Cancer Biology](https://www.cos.io/rpcb) - [RP: Psychology](https://osf.io/ezcuj/wiki/home/) - [Events](https://www.cos.io/events) - [Blog](https://www.cos.io/blog) - [Contact](https://www.cos.io/contact-us) - [Shop](https://www.redbubble.com/people/OpenScience/shop) - [OSF](https://osf.io) - [TOP Guidelines](https://www.cos.io/initiatives/top-guidelines) **Responsible stewards of your support** [![Charity Navigator](https://www.cos.io/hs-fs/hubfs/Logos/charity-navigator.png?width=100&name=charity-navigator.png)](https://www.charitynavigator.org/ein/461496217)[![Platinum Transparency 2023](https://widgets.guidestar.org/TransparencySeal/9294495)](https://www.guidestar.org/profile/46-1496217)[![SOC 2](https://www.cos.io/hs-fs/hubfs/Logos/badge-soc2.png?width=100&name=badge-soc2.png)](https://www.aicpa-cima.com/resources/landing/system-and-organization-controls-soc-suite-of-services) COS has earned top recognition from **[Charity Navigator](https://www.charitynavigator.org/ein/461496217)** and **[Candid](https://www.guidestar.org/profile/46-1496217)** (formerly GuideStar) for our financial transparency and accountability to our mission. COS and the OSF were also awarded SOC2 accreditation in 2023 after an independent assessment of our security and procedures by the **[American Institute of CPAs (AICPA)](https://www.aicpa-cima.com/resources/landing/system-and-organization-controls-soc-suite-of-services)**. We invite all of our sponsors, partners, and members of the community to learn more about how our organization operates, our impact, our financial performance, and our nonprofit status. **Photo Stream** - - - - - - - - - - - -