September 16-18 and 23-25 | Worldwide
There is a long history of research about the scientific process, particularly with fields such as philosophy of science, sociology of science, and science-technology studies contributing unique insights about how science operates. There is also a growing cadre of researchers deploying modem methodologies and big data to investigate the scientific process.
Together, these communities of researchers and stakeholders are the research and development pipeline for improving research practices. The Metascience 2021 meeting is a point of convergence to share knowledge, foster community, and define a roadmap of research and intervention priorities to accelerate science.
October 18, 2021 11am - 12:30pm EST
David Mellor will give an overview of open science practices that will add clarity and rigor to the research workflow. Join us to learn about data sharing, posting preprints, or preregistering your next study.
February 24 - 25 | Charlottesville, Virginia
The 2022 Unconference will be hosted in Charlottesville, Virginia with virtual participation facilitated for general and relevant unconference sessions. Hackathons and workshops will occur in person. Please register above if you plan to participate in person or join the virtual sessions. All registration fees for in-person attendance along with limited grant support will be dedicated to providing travel support for colleagues.
The 2022 unconference will feature participant-led sessions analyzing the current state of open scholarship practice and interactive hackathons seeking solutions to identified problems. Participants will assess barriers to adoption of open scholarship practices unique to the education community and brainstorm strategies for promoting greater awareness.
Additional information about opening and closing plenary speakers will be made available soon. Please also check back for the formal agenda this fall.
In this webinar, a panel discusses licensing options, fundamentals in choosing a license for your research, and answers questions about licensing scholarship. The panel consists of moderator Joanna Schimizzi, Professional Learning Specialist at the Institute for the Study of Knowledge Management in Education, along with panelists Brandon Butler, Director of Information Policy, University of Virginia Library and Becca Neel, Assistant Director for Resource Management & User Experience, University of Southern Indiana for an informative discussion on licensing your research.
In this open call, Center for Open Science Executive Director Brian Nosek and Director of Research Tim Errington discuss new evidence about the effectiveness of Registered Reports in improving research quality and credibility. Together with the attendees, they review the cumulative evidence about Registered Reports and outline a roadmap of research priorities for what needs to be investigated next to clarify its benefits, costs, and impact on research practices.
In this webinar, Olmo van den Akker and Marjan Bakker (Tilburg University), Pam Davis-Kean (University of Michigan), and David Mellor (COS) overview the process of preregistering secondary data analyses. See a demonstration of the Secondary Data Preregistration template on OSF, including examples and best practices for writing up preregistered work.
This applied webinar explores best practices for communicating open educational data with a wide audience. Topics include different methods for encoding data, the use of color and considerations for color blindness, visual perception, common pitfalls, and methods for minimizing cognitive load. Dr. Daniel Anderson, from the University of Oregon, guides the audience through these topics, while also briefly discussing mediums for communication, including data dashboards to reach a larger and more diverse audience.
A 90-minute hackathon on the Registered Reports publishing format hosted by COS and the Declaration to Improve Biomedical and Health Research.
Participants discussed Registered Reports and then collaborated to identify and contact journals to encourage them to consider adopting Registered Reports.
As the science reform movement has gathered momentum to change research culture and behavior relating to openness, rigor, and reproducibility, so has the critical analysis of the reform efforts. This symposium includes five perspectives examining distinct aspects of the reform movement to illuminate and challenge underlying assumptions about the value and impact of changing practices, to identify potential unintended or counterproductive consequences, and to provide a meta perspective of metascience and open science. It's meta, all the way up. Each presenter provides a 15-minute perspective followed by a concluding discussion among the panelists and time spent addressing audience questions.
This webinar demonstrates how using R can advance open science practices in education. We focus on R and RStudio because it is an increasingly widely-used programming language and software environment for data analysis with a large supportive community. We present: a) general strategies for using R to analyze educational data and b) accessing and using data on the Open Science Framework (OSF) with R via the osfr package. This session is for those both new to R and those with R experience looking to learn more about strategies and workflows that can help to make it possible to analyze data in a more transparent, reliable, and trustworthy way.
See participant-led interactive sessions analyzing open scholarship practices in education research. Participants assessed current adoption of open scholarship practices and brainstormed strategies for promoting increased awareness among the community.
Open source infrastructure has paved the way for mission-aligned research stakeholders to create a united vision of interoperable tools and services that accelerate scholarly communication, fill technology gaps, converge solutions, and enable universal access and discoverability.
Hear from a panel of research groups that have taken advantage of interoperable infrastructure to leverage more robust workflows to support rigorous, reproducible research. We also discuss the steps stakeholders and institutions can take to integrate OSF’s open API with existing services to establish streamlined researcher workflows.
In this webinar, Tamarinde Haven provides an overview of the process of preregistration in qualitative research. We review the process of preregistration, how we partnered with a community of qualitative researchers to develop a template for qualitative research through a Delphi study, and a guide to the fields that were included in the final form.
Research funders are requiring or strongly encouraging open and reproducible methods at increased rates, leading researchers to rely on more data management tools while institutions continue to provide services to support them. Research support staff adapt quickly to guide their stakeholders and provide resources, while administrators must find methods to determine adoption and success across the community.
In this webinar, COS Director of Policy David Mellor shares an update on funder expectations like preregistration, data sharing, and open access outputs, as well as strategies to highlight these practices in funding proposals. COS Director of Product Nici Pfeiffer also discusses OSF features that enable researchers to meet and exceed these expectations, as well as provide unique activity insights for administrators, and how COS continues to work with the funder and institution communities to facilitate transparent practices across the lifecycle.
Open Science accelerates the discovery of cures and advances new knowledge by improving the rigor and transparency of research and resusabilty of resulting data, materials, and code. But acceleration requires efficiency in managing the research lifecycle with integrated tools that work together to reduce the burden on investigators to manage, collaborate, and share as they work.
OSF provides the interface for research collaboration, with increased efficiency for the research team through integrated storage provider tools and citation managers.
Get familiar with the OSF project interface, understand how it can accelerate collaboration, transparency, sharing, and reuse of research outputs, and take a deep dive into integrations that connect directly into OSF for efficiency in researcher workflows.
Preregistration of study designs and analysis plans reduces publication bias and clarifies confirmatory and exploratory aspects of research by making all studies on a topic discoverable.
Learn how OSF Registries makes it possible for communities to customize preregistration workflows with templates, metadata, and branding. These customized branded registries can support funders with the infrastructure to implement new open science policies and track compliance, as well as allow communities to demonstrate their adoption of open practices.
The OSF Collections repository platform supports the discoverability and reuse of research by enabling the aggregation of related projects across OSF.
With OSF Collections, any funder, journal, society, or research community can show their commitment to scientific integrity by aggregating the open outputs from their disciplines, grantees, journal articles, or more. Learn how research collections can foster new norms for sharing, collaboration, and reproducibility.
We also provide a demo of how OSF Collections aggregates and hosts your research by discipline, funded outcomes, project type, journal issue, and more.
Many in the research community are adapting to conducting work remotely in 2020. Institutional priorities have shifted in response to our current global reality, and the commitment to supporting researchers with resources and training has evolved to include greater emphasis on tools for effective collaboration and research management. Libraries, offices of research, provosts, and department heads are finding exciting ways to keep their important research moving forward.
Join the OSFI membership community as we explore cases of institutional collaboration from across the globe, including citizen science projects, course management, data management instruction, and more.
Hear from Andrew Foster, editor at the Journal of Development Economics, and Irenaeus Wolff, a guest editor for Experimental Economics, as they discuss their experiences with implementing the Registered Reports format, how it was received by authors, and the trends they noticed after adoption. Aleksandar Bogdanoski of BITSS also joins us to explore pre-results review, how to facilitate the process at journals, and best practices for supporting authors and reviewers.
Openness in research can lead to greater reproducibility, an accelerated pace of discovery, and decreased redundancy of effort. In addition, open research ensures equitable access to knowledge and the ability for any community to assess, interrogate, and build upon prior work. It also requires open infrastructure and distributed access; but few institutions can provide all of these services alone. Providing a trustworthy network for perpetual availability of research data is critical to ensuring reproducibility, transparency, and ongoing inquiry.
Increased attention on the importance of open research and data sharing has led to a proliferation of platforms to store data, materials, etc., with limited technical integration. This can hinder data sharing, but also complicate coordination with local library expertise and services, thus hampering curation and long-term stewardship.
For example, the open source OSF enables researchers to directly create and manage research projects and integrates with other tools researchers use (Google Drive, Dropbox, Box, etc.), but lacks the ability to archive that material locally at a researcher’s institution. Long-term stewardship and preservation requires multiple copies of data archived in different locations, and creating archives seamlessly would be ideal.
COS and IA are working together to address these preservation and stewardship challenges by providing open, cooperative infrastructure to ensure long-term access and connection to research data, and by supporting and promoting adoption of open science practices to enhance research reproducibility as well as data sharing and reuse.
In this webinar, attendees will learn about both the technical and practical aspects of this collaborative project connecting the researcher tool OSF and the preservation system of Internet Archive. We demonstrate how researchers can improve the openness and reproducibility of their research through preregistration, and how those preregistrations are preserved with Internet Archive. We answer questions and explore use cases for how this powerful workflow can support library curation and stewardship of open research.
In our first OSF Institutions webinar, we discuss the Center for Open Science’s ongoing mission to provide community and technical resources to support your commitments to rigorous, transparent research practices, as well as demonstrate the OSF tools available for contributors, labs, centers, and institutions that support stronger collaborations.
We share useful practices like: contributor management, the OSF wiki as an electronic lab notebook, using OSF to manage online courses and syllabi, and more. Finally, we look at how OSF Institutions can provide discovery and intelligence gathering infrastructure so that you can focus on conducting and supporting exceptional research.
The growing adoption of transparent practices is due in large part to the quality of resources assembled by the open research community. However, the discoverability of these materials is in need of significant improvement for the sake of researchers and stakeholders searching for best practices according to their disciplines and research stages.
The Open Scholarship Knowledge Base will centralize and contextualize the vast network of open scholarship training and educational resources in one place. But the initiative relies heavily on the research communities well versed in transparent practice.
In this webinar, learn how you can collaborate with the teams working to curate, review, and contribute resources for the purpose of accessible instruction in open research best practices for all.
Visit cos.io/oskb for more information.
Many in the global research community are adapting to conducting work remotely while exploring the best ways to maintain collaboration with colleagues across teams and institutions.
Join us as we discuss the OSF tools available for contributors, labs, centers, and institutions that support stronger collaborations.
We share demonstrations covering: contributor management, the OSF wiki as an electronic lab notebook, how to affiliate research projects for institution-wide discovery, using OSF to manage online courses and syllabi, and more. Plus, see examples from the research teams optimizing their workflows for inclusive collaboration and efficient data management.
This webinar provides an overview of TOP Factor: its rationale, how it is being used, and how each of the TOP standards relate to individual scores. We also cover how to get involved with TOP Factor by inviting interested community members to suggest journals be added to the database and/or evaluate journal policies for submission.
Read the transcript here.
More researchers are preregistering their studies as a way to combat publication bias and improve the credibility of research findings. Preregistration is at its core designed to distinguish between confirmatory and exploratory results. Both are important to the progress of science, but when they're conflated, problems arise. Join us to discuss the What, Why, and How of preregistration and what it means for the future of science.
Badges are a great way to signal that a journal values transparent research practices. Readers see the papers that have underlying data or methods available, colleagues see that norms are changing within a community and have ample opportunities to emulate better practices, and authors get recognition for taking a step into new techniques. This webinar overviews the workflow of a badging program, eligibility for badge issuance, and the pitfalls to avoid in launching a badging program.
In this webinar, Doctors David Mellor (Center for Open Science) and Stavroula Kousta (Nature Human Behavior) discuss the Registered Reports publishing workflow and the benefits it may bring to funders of research. Dr. Mellor details the workflow and what it is intended to do, and Dr. Kousta discusses the lessons learned at Nature Human Behavior from their efforts to implement Registered Reports as a journal.
This webinar outlines how to use the free Open Science Framework as an Electronic Lab notebook for personal work or private collaborations. Fundamental features covered include how to record daily activity, how to store images or arbitrary data files, how to invite collaborators, how to view old versions of files, and how to connect all this usage to more complex structures that support the full work of a lab across multiple projects and experiments.
“Advancing Science in Indonesia” discusses the fundamental strategies for improving the quality of research outputs in Indonesia, including: mastering basic research skills (for example, literature review skills, analyzing and interpreting data, etc.); encouraging the creation of a research ecosystem whose main focus is on credibility, transparency, and scientific rigor; and more.
Experienced Registered Reports editors and reviewers come together to discuss the format and best practices for handling submissions. Learn more about what editors are looking for from reviewers, practical guidelines for writing a Registered Report, and more.
In this webinar, a panel of experienced policy advocates discuss how to advocate for policy improvements at the institutional level (journals, funders, and universities), while providing you with the tools to do so. Open practice policies are leveling the playing field for how science is conducted, yet advocating for these improvements requires coordinated action.
"Local Grassroots Networks" features insights from international panelists currently nurturing culture change in research among their local communities.
Representatives from the UK Reproducibility Network (UKRN), the Open Science Community Utrecht (OSCU), and the Berkeley Initiative for Transparency in Social Sciences (BITSS) discuss the formation of their respective grassroots networks, the communities involved, and the activities they conduct to foster culture change toward open science and reproducible research practices.
The discussion also highlights opportunities for communication and collaboration across networks and the shared values and goals of networks across geographies and disciplines.
Expectations by funders for transparent and reproducible methods are on the rise. This session covers expectations for preregistration, data sharing, and open access results of three key funders of education research including the Institute of Education Sciences, the National Science Foundation, and Arnold Ventures. Presenters cover practical resources for meeting these requirements such as the Registry for Efficacy and Effectiveness Studies (REES), the Open Science Framework (OSF), and EdArXiv.
Arnold Ventures is a philanthropy dedicated to tackling some of the most pressing problems in the United States. Founded by Laura and John Arnold in 2010, Arnold Ventures’ core mission is to improve lives by investing in evidence-based solutions that maximize opportunity and minimize injustice. Arnold Ventures funds various types of research to understand problems and identify policy solutions. Arnold Ventures LLC manages the giving for the various Arnold entities, including the Laura and John Arnold Foundation (LJAF), Action Now Initiative (ANI), and the Arnolds’ donor-advised fund. Funding from Arnold Ventures (through Laura and John Arnold Foundation) provided the initial funding to launch the Center for Open Science in 2013 and has supported COS operations and provided specific research and programatic support in each of the following years. In 2019 Arnold Ventures has continued its support of COS and its efforts to foster open, reliable, and rigorous scientific research.