The Center for Open Science (COS) was founded as a non-profit technology start-up in 2013 with the goal of improving transparency and reproducibility by connecting the scholarly workflow. COS achieves this goal through the development of a free, open source web application called the Open Science Framework (OSF), providing features like file sharing and citing, persistent urls, provenance tracking, and automated versioning. Initial workflow API connections focused on storage services and included Figshare, GitHub, Amazon S3, Dropbox, and Dataverse. The team is now working to connect other parts of the workflow with services like DMPTool, Databib/re3data, and Databrary. This session will introduce the core architecture and the problems that it solves, and illustrate how connecting services can benefit everyone involved in supporting the research ecosystem. COS is funded through the generosity of grants from the Laura and John Arnold Foundation, the John Templeton Foundation, the Alfred P. Sloan Foundation, the Association of Research Libraries, and others.
Presented at CNI Fall 2014, Washington, DC.
Improving Integrity, Transparency, and Reproducibility Through Connection of the Scholarly Workflow
1. Improving
Integrity,
Transparency,
and
Reproducibility
Through
Connec:on
of
the
Scholarly
Workflow
Andrew
Sallans
Partnerships
Lead
Center
for
Open
Science
2. A
talk
on
the
Open
Science
Framework
1. Free,
open
source
plaHorm
2. Designed
to
add
efficiency
to
workflow
3. Connector
to
other
tools
and
services
4. Challenges: Perceived norms
Norms
Communality
Open Sharing
Universalism
Evaluate research on own merit
Disinterestedness
Motivated by knowledge and discovery
Organized skepticism
Consider all new evidence, even against
one’s prior work
Quality
Counternorms
Secrecy
Closed
Particularlism
Evaluate research by reputation
Self-interestedness
Treat science as a competition
Organized dogmatism
Invest career promoting one’s own
theories, findings
Quantity
6. A
liNle
something
about
COS
• Est.
2013
• Non-‐profit
tech
startup
• 4
leading
founda:on
funders,
>
$14M
• Located
in
CharloNesville,
VA
• Team:
~
25
FT
&
20
interns
• Mostly
so]ware
developers
and
researchers
Mission: Improve openness, integrity, and
reproducibility of research
17. Registering Your Work
Choose the
registration
template
Create a frozen
registered version
18. Sharing Your Work
Create a
view-only link
Describe the
link use
Option to
make
anonymous
Select what parts of the
project to share
19. Unique and permanent IDs
Scientific content must be easy to cite and
annotate
Approach: GUIDs for all content
https://osf.io/e81xl -> RPCB
https://osf.io/alh38 -> Tim Errington
https://osf.io/ibdv8 -> Coding_Study_1.xslx
22. Examples
of
other
connec:ons
Taking
a
data
management
plan
and
conver:ng
it
into
a
living
document.
Providing
a
data
repository
lookup
service
and
checklist
to
assist
with
prepara:on
for
deposit.
Connec:ng
to
a
sensi:ve
video
storage
service.
23. Tools
used:
OPEN SCIENCE FRAMEWORK
osf.io | @OSFramework | #OSFinAction
OSF in the lab
Erica Baranski
Qualtrics,
Dropbox,
Survey
Monkey,
R
Q
What tools do you use in your research?
A
OSF
features
used:
version
control,
collabora:on,
wiki
for
lab
notebook
and
mee:ngs
Q
How do you use the OSF?
24. Tools
used:
next-‐gen
sequencers,
pipeline
so]ware,
custom
so]ware
OSF
features
used:
version
control,
file
sharing,
GitHub
and
Dropbox
integra:on,
public
sharing.
25. Problem
to
solve:
teaching
undergrads
how
to
make
research
reproducible
and
verifiable.
OSF
features
used:
organiza:on
of
documents
and
data,
command
files,
metadata,
and
file
sharing.
27. Want
to
join
the
effort?
• Contribute
content
to
SHARE
or
partner
on
cura:on
of
content
• Serve
as
an
Ambassador
• Coordinate
a
reproducible
sta:s:cs
and
prac:ces
workshop
• Join
the
team
–
hNp://cos.io/jobs