Open Scholarship Survey Shows Disparities in Open Practices

We continue to be enthusiastic supporters and participants with the OSS. Through the survey results we can better understand our community as benchmarked to the larger research community. Having the expertise of the COS team to perform the study and thoughtfully discuss the results has moved our open science program forward faster and better than we ever would have been able to do on our own.
Emily WhiteEmily White
Managing Director, FUS Partners and Director of Operations, Focused Ultrasound Foundation

Researchers who perceive that open science is the expectation in their fields rather than the exception should be more likely to adopt open science practices themselves. This is borne out in COS’s research from the Open Scholarship Survey (OSS), a standardized, modular survey that assesses researcher norms about open scholarship practices, blockers to adoption, and perceptions about their fields and the scientific literature. COS finds that perceptions of support for an open science practice predicts how often a researcher performs that practice – over and above researchers’ own support.

If researchers’ perceptions of their fields predict their open scholarship engagement, then COS wants to know (a) how researchers perceive themselves relative to their colleagues; and (b) how accurate those perceptions are. The work with the OSS helps answer both questions. First, COS finds that across six open scholarship practices, most researchers perceive themselves to be more favorable than their fields. Conducting replications and reporting null results stand out among the set – in each case, well over 75% of respondents express greater support for the practice than what they perceive among their colleagues.

Researchers perceive themselves as more supportive than their fields

Second, COS find that across each practice, researchers underestimate support for open science practices. Reporting null results again stands out. While over 75% of respondents are supportive of the practice, less than half perceive their colleagues to be in favor. This perception gap stands as a barrier to open scholarship adoption.

Support vs perceived support


Beyond revealing the perception gap, these data give research organizations and institutions direction to help promote open scholarship in the communities they fund and support. The OSS guides conversations with these change agents by revealing barriers that researchers themselves have identified. For example, researchers who have not recently shared data cite the absence of a suitable repository, challenges in anonymizing data, and their lack of familiarity with the process as barriers to the practice. This points to more targeted activities, such as training or offering an OSF Collection, that partner organizations can sponsor and facilitate to close the gap between the open behaviors that researchers support and their actual day-to-day practices, driving culture change.