SlideShare a Scribd company logo
1 of 40
ARIADNEplus is funded by the European Commission’s Horizon 2020 Programme
Preferred Formats =
Pre-FAIRed Formats
Valentijn Gilissen, DANS-KNAW
Data Manager
Preservation Officer
valentijn.gilissen@dans.knaw.nl
Institute of
Dutch Academy
and Research
Funding
Organisation
(KNAW & NWO)
since 2005
First predecessor
dates back to
1964 (Steinmetz
Foundation),
Historical Data
Archive 1989
Mission: promote and
provide permanent
access to digital
research resources
https://dans.knaw.nl
DANS
https://easy.dans.knaw.nl
https://dataverse.nl
https://www.narcis.nl
DANS core data services
NARCIS: Gateway to scholarly
information in the Netherlands
DataverseNL for short- and
mid-term data storage
EASY: certified long-term Electronic
Archiving System for self-deposit
http://www.brill.com/rdj
https://data.mendeley.com/
https://datadryad.org
Background Archive
Research Data Journal for the
Humanities and Social Sciences
Training &
Consultancy
http://datasupport.researchdata.nl/
DANS additional services
Ingest via SWORD protocol
(Simple Web-service Offering
Repository Deposit)
Electronic Archiving SYstemEASY
Register Log in
New deposit
BrowseAdvanced search
Search help
Search
Disclaimer
Legal information
Property Rights Statement
How to cite data
https://easy.dans.knaw.nl
CoreTrustSeal/ Nestor Seal 2016
Overview
Cite as
Description
Data files (N)
Electronic Archiving SYstemEASY
2020: 122.000+ datasets of which 67.000+ Archaeology
Self-depositing
Title
Alternative title
Creator /
People &
organisations
Date created
Description
Subject
Identifiers &
Relations
Temporal coverage
Spatial coverage
Language
Upload Data
Qualified Dublin Core metadata
Access rights
Date available
Rightsholder
Publisher
Audience
Date
Licence
Source
Reserve DOI
Archaeology-specific metadata
Archis zaakID
ABR complex
ABR periodPersonal data y/n
OAIS in context
Persistent Identifier Citation
Front-office
Machine to Machine
SWORD
P
R
O
D
U
C
E
R
C
O
N
S
U
M
E
R
OAI-PMH
ARIADNE-portal:
http://portal.ariadne-infrastructure.eu/
=> TGA; RAW; CDR
=> PCX; BMP; PSD
=> JPG; TIF; PNG
Let's save these images in different formats!
Preferred Formats
Before depositing
Metadata
What DANS does
Legal aspects
Quoting data
https://dans.knaw.nl/en
Deposit => Read more about depositing data
File Formats
Documentation
During depositing
After depositing
PARTHENOS, Hollander, Hella, Morselli, Francesca, Uiterwaal, Frank,
Admiraal, Femmy, Trippel, Thorsten, & Di Giorgio, Sara. (2018, December 1).
PARTHENOS Guidelines to FAIRify data management and make data reusable.
Zenodo. http://doi.org/10.5281/zenodo.2668479
Preferred Formats
Preferred Formats
https://dans.knaw.nl/en/about/services/easy/information-about-depositing-data/before-depositing/file-formats
As a general guideline, DANS considers that the file
formats best suited for longtime preservation and
accessibility are file formats which:
-are commonly used
-have open specifications
-are independent of specific software, developers or
suppliers
Preferred Formats
https://dans.knaw.nl/en/about/services/easy/information-about-depositing-data/before-depositing/file-formats
Preferred Formats
Text documents • PDF/A (.pdf)
• ODT (.odt)
• Microsoft Word (.doc)
• Office Open XML (.docx)
• Rich Text File (.rtf)
• PDF other than PDF/A (.pdf)
Geographical
Information (GIS)
• GML (.gml)
• MIF/MID
(.mif/mid)
• Esri Shapefiles (.shp & related files)
• MapInfo (.tab & related files)
• KML (.kml)
• Esri Geodatabase (.gdb)
• Project files/Workspaces (.mxd, .wor,
.qgs)
Spreadsheets • ODS (.ods)
• CSV (.csv)
• Microsoft Excel (.xls)
• Office Open XML Workbook (.xlsx)
• PDF/A (.pdf)
Preferred Format Non-preferred Format
3D • WaveFront Object
(.obj)
• Polygon file
format (.ply)
• X3D (.x3d)
• COLLADA (.dae)
• Autodesk FBX (.fbx)
• Blender (.blend)
• 3D PDF (.pdf)
Preferred Formats
Text documents • PDF/A (.pdf)
• ODT (.odt)
• Microsoft Word (.doc)
• Office Open XML (.docx)
• Rich Text File (.rtf)
• PDF other than PDF/A (.pdf)
Geographical
Information (GIS)
• GML (.gml)
• MIF/MID
(.mif/mid)
• Esri Shapefiles (.shp & related files)
• MapInfo (.tab & related files)
• KML (.kml)
• Esri Geodatabase (.gdb)
• Project files/Workspaces (.mxd, .wor,
.qgs)
Spreadsheets • ODS (.ods)
• CSV (.csv)
• Microsoft Excel (.xls)
• Office Open XML Workbook (.xlsx)
• PDF/A (.pdf)
Preferred Format Non-preferred Format
3D • WaveFront Object
(.obj)
• Polygon file
format (.ply)
• X3D (.x3d)
• COLLADA (.dae)
• Autodesk FBX (.fbx)
• Blender (.blend)
• 3D PDF (.pdf)
Preferred Formats
Text documents • PDF/A (.pdf)
• ODT (.odt)
• Microsoft Word (.doc)
• Office Open XML (.docx)
• Rich Text File (.rtf)
• PDF other than PDF/A (.pdf)
Geographical
Information (GIS)
• GML (.gml)
• MIF/MID
(.mif/mid)
• Esri Shapefiles (.shp & related files)
• MapInfo (.tab & related files)
• KML (.kml)
• Esri Geodatabase (.gdb)
• Project files/Workspaces (.mxd, .wor,
.qgs)
Spreadsheets • ODS (.ods)
• CSV (.csv)
• Microsoft Excel (.xls)
• Office Open XML Workbook (.xlsx)
• PDF/A (.pdf)
Preferred Format Non-preferred Format
3D • WaveFront Object
(.obj)
• Polygon file
format (.ply)
• X3D (.x3d)
• COLLADA (.dae)
• Autodesk FBX (.fbx)
• Blender (.blend)
• 3D PDF (.pdf)
Preferred Formats
Text documents • PDF/A (.pdf)
• ODT (.odt)
• Microsoft Word (.doc)
• Office Open XML (.docx)
• Rich Text File (.rtf)
• PDF other than PDF/A (.pdf)
Geographical
Information (GIS)
• GML (.gml)
• MIF/MID
(.mif/mid)
• Esri Shapefiles (.shp & related files)
• MapInfo (.tab & related files)
• KML (.kml)
• Esri Geodatabase (.gdb)
• Project files/Workspaces (.mxd, .wor,
.qgs)
Spreadsheets • ODS (.ods)
• CSV (.csv)
• Microsoft Excel (.xls)
• Office Open XML Workbook (.xlsx)
• PDF/A (.pdf)
Preferred Format Non-preferred Format
3D • WaveFront Object
(.obj)
• Polygon file
format (.ply)
• X3D (.x3d)
• COLLADA (.dae)
• Autodesk FBX (.fbx)
• Blender (.blend)
• 3D PDF (.pdf)
Preferred Formats
Text documents • PDF/A (.pdf)
• ODT (.odt)
• Microsoft Word (.doc)
• Office Open XML (.docx)
• Rich Text File (.rtf)
• PDF other than PDF/A (.pdf)
Geographical
Information (GIS)
• GML (.gml)
• MIF/MID
(.mif/mid)
• Esri Shapefiles (.shp & related files)
• MapInfo (.tab & related files)
• KML (.kml)
• Esri Geodatabase (.gdb)
• Project files/Workspaces (.mxd, .wor,
.qgs)
Spreadsheets • ODS (.ods)
• CSV (.csv)
• Microsoft Excel (.xls)
• Office Open XML Workbook (.xlsx)
• PDF/A (.pdf)
Preferred Format Non-preferred Format
3D • WaveFront Object
(.obj)
• Polygon file
format (.ply)
• X3D (.x3d)
• COLLADA (.dae)
• Autodesk FBX (.fbx)
• Blender (.blend)
• 3D PDF (.pdf)
Preferred Formats
Text documents • PDF/A (.pdf)
• ODT (.odt)
• Microsoft Word (.doc)
• Office Open XML (.docx)
• Rich Text File (.rtf)
• PDF other than PDF/A (.pdf)
Geographical
Information (GIS)
• GML (.gml)
• MIF/MID
(.mif/mid)
• Esri Shapefiles (.shp & related files)
• MapInfo (.tab & related files)
• KML (.kml)
• Esri Geodatabase (.gdb)
• Project files/Workspaces (.mxd, .wor,
.qgs)
Spreadsheets • ODS (.ods)
• CSV (.csv)
• Microsoft Excel (.xls)
• Office Open XML Workbook (.xlsx)
• PDF/A (.pdf)
Preferred Format Non-preferred Format
3D • WaveFront Object
(.obj)
• Polygon file
format (.ply)
• X3D (.x3d)
• COLLADA (.dae)
• Autodesk FBX (.fbx)
• Blender (.blend)
• 3D PDF (.pdf)
Spreadsheets / Data Tables to CSV
Frankema, Prof. dr. E. (Wageningen University); Woltjer, P. (Wageningen University);
Dalrymple-Smith, A. (Wageningen University); Bulambo, L. (Wageningen University) (2017):
An Introduction to the African Commodity Trade Database, 1730-2010.
DANS. https://doi.org/10.17026/dans-xt9-fzkw
=IF(S8<>"",S8/ToT_regions!$N8*100,"")
Spreadsheets
Frankema, Prof. dr. E. (Wageningen University); Woltjer, P. (Wageningen University);
Dalrymple-Smith, A. (Wageningen University); Bulambo, L. (Wageningen University) (2017):
An Introduction to the African Commodity Trade Database, 1730-2010.
DANS. https://doi.org/10.17026/dans-xt9-fzkw
Preferred Formats
export folder
CSV and PDF/A exportsExcel files
Frankema, Prof. dr. E. (Wageningen University); Woltjer, P. (Wageningen University);
Dalrymple-Smith, A. (Wageningen University); Bulambo, L. (Wageningen University) (2017):
An Introduction to the African Commodity Trade Database, 1730-2010.
DANS. https://doi.org/10.17026/dans-xt9-fzkw
Original Processed
Preferred Formats
3D
3D
Nagel, D (Wildcard); Cocquyt, T. (HuygensING) (2013):
Animated, interactive 3D visualization of a corn mill, after a description by Ramelli.
DANS. https://doi.org/10.17026/dans-zzq-ymge
3D
Trognitz, M. (IANUS); Niven, K. (ADS), Gilissen V. (DANS) (2016):
3D Models in Archaeology: A Guide to Good Practice.
https://guides.archaeologydataservice.ac.uk/g2gp/3d_Toc
Preferred Formats
https://dans.knaw.nl/en/about/services/easy/information-about-depositing-data/before-depositing/file-formats
https://snd.gu.se/en/data-management/guides/file-formats
https://guides.archaeologydataservice.ac.uk/g2gp/
https://www.loc.gov/preservation/resources/rfs/
https://www.loc.gov/preservation/digital/formats/
https://www.ukdataservice.ac.uk/manage-data/format/recommended-formats.aspx
https://www.archivematica.org/en/docs/archivematica-1.10/user-manual/preservation/preservation-planning/
https://wiki.archivematica.org/Significant_characteristics
The PARTHENOS Policy Wizard:
http://www.parthenos-project.eu/portal/wizard
33
Policy
Wizard
DANS
guidelines
ADS
guidelines SND
guidelines
DANS
ADS
SND
Knowledge
Platform
SEADDA /
ARIADNEplus
communities
shared
guidelines
experts
…
Preferred Formats
Knowledge
Platform on
GitHub
- Proof of
Concept
Preferred Formats
https://dans-labs.github.io/formats/ https://github.com/dataformats
Mass migrations and transformations of archived data to new standards.
“Upgrading is compulsory.”
--the Cybermen
Doctor Who, BBC Studios, 1963-2019
Migrations to Preferred Formats
CSV
PDF/AWord, WordPerfect
Access
Migrations to Preferred Formats
File identification
(mediatype)
Selection filter:
visible files
Extraction from
archive (Python)
Checksum
validation Checksum
validation
Checksum
validation
Checksum
validation
Double conversion
(Python)
Adding
provenance
metadata to
file ID’s
Generating
logfiles
Archival
storage
Migrations to Preferred Formats
Preservation Watch
Free to use images from www.pexels.com (Pixabay / T. Malík)
http://doi.org/10.5281/zenodo.2668479
THANK YOU!
ARIADNE is a project funded by the European Commission under the
H2020 Programme, contract no. H2020-INFRAIA-2018-1-823914.
The views and opinions expressed in this presentation are the sole
responsibility of the authors and do not necessarily reflect the views
of the European Commission.
Contact: hella.hollander@dans.knaw.nl
valentijn.gilissen@dans.knaw.nl
julian.richards@york.ac.uk
www.ariadne-infrastructure.eu
www.dans.knaw.nl

More Related Content

What's hot

Oceangraphic data formats
Oceangraphic data formatsOceangraphic data formats
Oceangraphic data formats
Fiddy Prasetiya
 
PoolParty 5.0 - Five more reasons to lean on a world-class semantic platform
PoolParty 5.0 - Five more reasons to lean on a world-class semantic platformPoolParty 5.0 - Five more reasons to lean on a world-class semantic platform
PoolParty 5.0 - Five more reasons to lean on a world-class semantic platform
Semantic Web Company
 

What's hot (7)

Oceangraphic data formats
Oceangraphic data formatsOceangraphic data formats
Oceangraphic data formats
 
OrientDB & Node.js Overview - JS.Everywhere() KW
OrientDB & Node.js Overview - JS.Everywhere() KWOrientDB & Node.js Overview - JS.Everywhere() KW
OrientDB & Node.js Overview - JS.Everywhere() KW
 
culture victoria lodlam lightningtalk
culture victoria lodlam lightningtalkculture victoria lodlam lightningtalk
culture victoria lodlam lightningtalk
 
Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)
Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)
Data Management and Integration with d:swarm (Lightning talk, ELAG 2014)
 
Turning the Page on Digital Content
Turning the Page on Digital ContentTurning the Page on Digital Content
Turning the Page on Digital Content
 
Open data and linked data
Open data and linked dataOpen data and linked data
Open data and linked data
 
PoolParty 5.0 - Five more reasons to lean on a world-class semantic platform
PoolParty 5.0 - Five more reasons to lean on a world-class semantic platformPoolParty 5.0 - Five more reasons to lean on a world-class semantic platform
PoolParty 5.0 - Five more reasons to lean on a world-class semantic platform
 

Similar to Preferred Formats = Pre-FAIRed Formats

NAPSG 2010 Fire/EMS Conference - Data Sharing Basics
NAPSG 2010 Fire/EMS Conference - Data Sharing BasicsNAPSG 2010 Fire/EMS Conference - Data Sharing Basics
NAPSG 2010 Fire/EMS Conference - Data Sharing Basics
pdituri
 
This is not a test: Preserving AutoCAD files at The University of Montana
This is not a test: Preserving AutoCAD files at The University of MontanaThis is not a test: Preserving AutoCAD files at The University of Montana
This is not a test: Preserving AutoCAD files at The University of Montana
samalanmeister
 

Similar to Preferred Formats = Pre-FAIRed Formats (20)

GIS file types
GIS file typesGIS file types
GIS file types
 
Data Analytics using MATLAB and HDF5
Data Analytics using MATLAB and HDF5Data Analytics using MATLAB and HDF5
Data Analytics using MATLAB and HDF5
 
SPD and KEA: HDF5 based file formats for Earth Observation
SPD and KEA: HDF5 based file formats for Earth ObservationSPD and KEA: HDF5 based file formats for Earth Observation
SPD and KEA: HDF5 based file formats for Earth Observation
 
Berlin Hadoop Get Together Apache Drill
Berlin Hadoop Get Together Apache Drill Berlin Hadoop Get Together Apache Drill
Berlin Hadoop Get Together Apache Drill
 
Mobile LBS
Mobile LBSMobile LBS
Mobile LBS
 
Apache Drill
Apache DrillApache Drill
Apache Drill
 
Building 3D content to last
Building 3D content to lastBuilding 3D content to last
Building 3D content to last
 
2009 PLANETS Vienna - MIXED migration to XML
2009 PLANETS Vienna - MIXED migration to XML2009 PLANETS Vienna - MIXED migration to XML
2009 PLANETS Vienna - MIXED migration to XML
 
Scaling the (evolving) web data –at low cost-
Scaling the (evolving) web data –at low cost-Scaling the (evolving) web data –at low cost-
Scaling the (evolving) web data –at low cost-
 
NAPSG 2010 Fire/EMS Conference - Data Sharing Basics
NAPSG 2010 Fire/EMS Conference - Data Sharing BasicsNAPSG 2010 Fire/EMS Conference - Data Sharing Basics
NAPSG 2010 Fire/EMS Conference - Data Sharing Basics
 
Understand Google Drive
Understand Google DriveUnderstand Google Drive
Understand Google Drive
 
Come with an idea - go home with a web map: Tools for sharing maps and vector...
Come with an idea - go home with a web map: Tools for sharing maps and vector...Come with an idea - go home with a web map: Tools for sharing maps and vector...
Come with an idea - go home with a web map: Tools for sharing maps and vector...
 
Open Land Use Map and Smart Points of Interest
Open Land Use Map and Smart Points of InterestOpen Land Use Map and Smart Points of Interest
Open Land Use Map and Smart Points of Interest
 
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
LoCloud Geolocation enrichment tools, Siri Slettvag, Asplan Viak Internet (Av...
 
SDI4Apps - INSPIRE Hackathon
SDI4Apps - INSPIRE HackathonSDI4Apps - INSPIRE Hackathon
SDI4Apps - INSPIRE Hackathon
 
Drill Lightning London Big Data
Drill Lightning London Big DataDrill Lightning London Big Data
Drill Lightning London Big Data
 
Corpus studio Erwin Komen
Corpus studio Erwin KomenCorpus studio Erwin Komen
Corpus studio Erwin Komen
 
2016-07-21-Godil-presentation.pptx
2016-07-21-Godil-presentation.pptx2016-07-21-Godil-presentation.pptx
2016-07-21-Godil-presentation.pptx
 
(Research) Data Management in Archaeology
(Research) Data Management in Archaeology(Research) Data Management in Archaeology
(Research) Data Management in Archaeology
 
This is not a test: Preserving AutoCAD files at The University of Montana
This is not a test: Preserving AutoCAD files at The University of MontanaThis is not a test: Preserving AutoCAD files at The University of Montana
This is not a test: Preserving AutoCAD files at The University of Montana
 

More from ariadnenetwork

Eaa2021 476 norwegian_unimus
Eaa2021 476 norwegian_unimusEaa2021 476 norwegian_unimus
Eaa2021 476 norwegian_unimus
ariadnenetwork
 
Eaa2021 476 ways and capacity in archaeological data management in serbia
Eaa2021 476 ways and capacity in archaeological data management in serbiaEaa2021 476 ways and capacity in archaeological data management in serbia
Eaa2021 476 ways and capacity in archaeological data management in serbia
ariadnenetwork
 
Eaa2021 476 izeta cattaneo idacordig and suquia
 Eaa2021 476 izeta cattaneo idacordig and suquia Eaa2021 476 izeta cattaneo idacordig and suquia
Eaa2021 476 izeta cattaneo idacordig and suquia
ariadnenetwork
 
Eaa2021 476 preserving historic building documentation pakistan
Eaa2021 476 preserving historic building documentation  pakistanEaa2021 476 preserving historic building documentation  pakistan
Eaa2021 476 preserving historic building documentation pakistan
ariadnenetwork
 
Eaa2021 s476 ariadne-seadda
Eaa2021 s476 ariadne-seaddaEaa2021 s476 ariadne-seadda
Eaa2021 s476 ariadne-seadda
ariadnenetwork
 

More from ariadnenetwork (20)

ARIADNE plus - vms workshop.pdf
ARIADNE plus - vms workshop.pdfARIADNE plus - vms workshop.pdf
ARIADNE plus - vms workshop.pdf
 
DANS Data Trail Data Management Tools for Archaeologists
DANS Data Trail Data Management Tools for ArchaeologistsDANS Data Trail Data Management Tools for Archaeologists
DANS Data Trail Data Management Tools for Archaeologists
 
Eaa2021 476 natália botica - from 2_archis to datarepositorium2
Eaa2021 476 natália botica - from 2_archis to datarepositorium2Eaa2021 476 natália botica - from 2_archis to datarepositorium2
Eaa2021 476 natália botica - from 2_archis to datarepositorium2
 
Eaa2021 476 kecheva_nekhrizov_bulgaria
Eaa2021 476 kecheva_nekhrizov_bulgariaEaa2021 476 kecheva_nekhrizov_bulgaria
Eaa2021 476 kecheva_nekhrizov_bulgaria
 
Eaa2021 476 norwegian_unimus
Eaa2021 476 norwegian_unimusEaa2021 476 norwegian_unimus
Eaa2021 476 norwegian_unimus
 
Eaa2021 session 476 abstracts
Eaa2021 session 476 abstractsEaa2021 session 476 abstracts
Eaa2021 session 476 abstracts
 
Eaa2021 476 ways and capacity in archaeological data management in serbia
Eaa2021 476 ways and capacity in archaeological data management in serbiaEaa2021 476 ways and capacity in archaeological data management in serbia
Eaa2021 476 ways and capacity in archaeological data management in serbia
 
Eaa2021 476 izeta cattaneo idacordig and suquia
 Eaa2021 476 izeta cattaneo idacordig and suquia Eaa2021 476 izeta cattaneo idacordig and suquia
Eaa2021 476 izeta cattaneo idacordig and suquia
 
Eaa2021 476 preserving historic building documentation pakistan
Eaa2021 476 preserving historic building documentation  pakistanEaa2021 476 preserving historic building documentation  pakistan
Eaa2021 476 preserving historic building documentation pakistan
 
Eaa2021 s476 ariadne-seadda
Eaa2021 s476 ariadne-seaddaEaa2021 s476 ariadne-seadda
Eaa2021 s476 ariadne-seadda
 
Heeren pan-seadda-leiden-17mrt2020
Heeren pan-seadda-leiden-17mrt2020Heeren pan-seadda-leiden-17mrt2020
Heeren pan-seadda-leiden-17mrt2020
 
D6.1 initial report-innovation-strategy-and-targeted-activities
D6.1 initial report-innovation-strategy-and-targeted-activitiesD6.1 initial report-innovation-strategy-and-targeted-activities
D6.1 initial report-innovation-strategy-and-targeted-activities
 
ARIADNEplus Community Needs Survey - Key Results
ARIADNEplus Community Needs Survey - Key ResultsARIADNEplus Community Needs Survey - Key Results
ARIADNEplus Community Needs Survey - Key Results
 
ARIADNEplus survey-2019-report
ARIADNEplus survey-2019-reportARIADNEplus survey-2019-report
ARIADNEplus survey-2019-report
 
05 caa hasil_novak
05 caa hasil_novak05 caa hasil_novak
05 caa hasil_novak
 
04 ariadn eplus_caa2019_cnrs_open_archaeo_20190424
04 ariadn eplus_caa2019_cnrs_open_archaeo_2019042404 ariadn eplus_caa2019_cnrs_open_archaeo_20190424
04 ariadn eplus_caa2019_cnrs_open_archaeo_20190424
 
03 ariadn eplus_caa_2019_inrap
03 ariadn eplus_caa_2019_inrap03 ariadn eplus_caa_2019_inrap
03 ariadn eplus_caa_2019_inrap
 
02 2019 caa_krakowvg
02 2019 caa_krakowvg02 2019 caa_krakowvg
02 2019 caa_krakowvg
 
01 caa2019 ariadn_eplus_snd_uj_krakow 20190425
01 caa2019 ariadn_eplus_snd_uj_krakow 2019042501 caa2019 ariadn_eplus_snd_uj_krakow 20190425
01 caa2019 ariadn_eplus_snd_uj_krakow 20190425
 
00 jdr introduction caa_ariadn_eplus_2019
00 jdr introduction caa_ariadn_eplus_201900 jdr introduction caa_ariadn_eplus_2019
00 jdr introduction caa_ariadn_eplus_2019
 

Recently uploaded

Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
MarinCaroMartnezBerg
 

Recently uploaded (20)

Sampling (random) method and Non random.ppt
Sampling (random) method and Non random.pptSampling (random) method and Non random.ppt
Sampling (random) method and Non random.ppt
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
 
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
Call Girls in Sarai Kale Khan Delhi 💯 Call Us 🔝9205541914 🔝( Delhi) Escorts S...
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
 
Introduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptxIntroduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptx
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
Zuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptxZuja dropshipping via API with DroFx.pptx
Zuja dropshipping via API with DroFx.pptx
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptx
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFx
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 

Preferred Formats = Pre-FAIRed Formats

  • 1. ARIADNEplus is funded by the European Commission’s Horizon 2020 Programme Preferred Formats = Pre-FAIRed Formats Valentijn Gilissen, DANS-KNAW Data Manager Preservation Officer valentijn.gilissen@dans.knaw.nl
  • 2. Institute of Dutch Academy and Research Funding Organisation (KNAW & NWO) since 2005 First predecessor dates back to 1964 (Steinmetz Foundation), Historical Data Archive 1989 Mission: promote and provide permanent access to digital research resources https://dans.knaw.nl DANS
  • 3. https://easy.dans.knaw.nl https://dataverse.nl https://www.narcis.nl DANS core data services NARCIS: Gateway to scholarly information in the Netherlands DataverseNL for short- and mid-term data storage EASY: certified long-term Electronic Archiving System for self-deposit
  • 4. http://www.brill.com/rdj https://data.mendeley.com/ https://datadryad.org Background Archive Research Data Journal for the Humanities and Social Sciences Training & Consultancy http://datasupport.researchdata.nl/ DANS additional services Ingest via SWORD protocol (Simple Web-service Offering Repository Deposit)
  • 5. Electronic Archiving SYstemEASY Register Log in New deposit BrowseAdvanced search Search help Search Disclaimer Legal information Property Rights Statement How to cite data https://easy.dans.knaw.nl CoreTrustSeal/ Nestor Seal 2016
  • 6. Overview Cite as Description Data files (N) Electronic Archiving SYstemEASY 2020: 122.000+ datasets of which 67.000+ Archaeology
  • 7. Self-depositing Title Alternative title Creator / People & organisations Date created Description Subject Identifiers & Relations Temporal coverage Spatial coverage Language Upload Data Qualified Dublin Core metadata Access rights Date available Rightsholder Publisher Audience Date Licence Source Reserve DOI Archaeology-specific metadata Archis zaakID ABR complex ABR periodPersonal data y/n
  • 8. OAIS in context Persistent Identifier Citation Front-office Machine to Machine SWORD P R O D U C E R C O N S U M E R OAI-PMH ARIADNE-portal: http://portal.ariadne-infrastructure.eu/
  • 9. => TGA; RAW; CDR => PCX; BMP; PSD => JPG; TIF; PNG Let's save these images in different formats!
  • 11. Before depositing Metadata What DANS does Legal aspects Quoting data https://dans.knaw.nl/en Deposit => Read more about depositing data File Formats Documentation During depositing After depositing PARTHENOS, Hollander, Hella, Morselli, Francesca, Uiterwaal, Frank, Admiraal, Femmy, Trippel, Thorsten, & Di Giorgio, Sara. (2018, December 1). PARTHENOS Guidelines to FAIRify data management and make data reusable. Zenodo. http://doi.org/10.5281/zenodo.2668479 Preferred Formats
  • 13. As a general guideline, DANS considers that the file formats best suited for longtime preservation and accessibility are file formats which: -are commonly used -have open specifications -are independent of specific software, developers or suppliers Preferred Formats https://dans.knaw.nl/en/about/services/easy/information-about-depositing-data/before-depositing/file-formats
  • 14. Preferred Formats Text documents • PDF/A (.pdf) • ODT (.odt) • Microsoft Word (.doc) • Office Open XML (.docx) • Rich Text File (.rtf) • PDF other than PDF/A (.pdf) Geographical Information (GIS) • GML (.gml) • MIF/MID (.mif/mid) • Esri Shapefiles (.shp & related files) • MapInfo (.tab & related files) • KML (.kml) • Esri Geodatabase (.gdb) • Project files/Workspaces (.mxd, .wor, .qgs) Spreadsheets • ODS (.ods) • CSV (.csv) • Microsoft Excel (.xls) • Office Open XML Workbook (.xlsx) • PDF/A (.pdf) Preferred Format Non-preferred Format 3D • WaveFront Object (.obj) • Polygon file format (.ply) • X3D (.x3d) • COLLADA (.dae) • Autodesk FBX (.fbx) • Blender (.blend) • 3D PDF (.pdf)
  • 15. Preferred Formats Text documents • PDF/A (.pdf) • ODT (.odt) • Microsoft Word (.doc) • Office Open XML (.docx) • Rich Text File (.rtf) • PDF other than PDF/A (.pdf) Geographical Information (GIS) • GML (.gml) • MIF/MID (.mif/mid) • Esri Shapefiles (.shp & related files) • MapInfo (.tab & related files) • KML (.kml) • Esri Geodatabase (.gdb) • Project files/Workspaces (.mxd, .wor, .qgs) Spreadsheets • ODS (.ods) • CSV (.csv) • Microsoft Excel (.xls) • Office Open XML Workbook (.xlsx) • PDF/A (.pdf) Preferred Format Non-preferred Format 3D • WaveFront Object (.obj) • Polygon file format (.ply) • X3D (.x3d) • COLLADA (.dae) • Autodesk FBX (.fbx) • Blender (.blend) • 3D PDF (.pdf)
  • 16. Preferred Formats Text documents • PDF/A (.pdf) • ODT (.odt) • Microsoft Word (.doc) • Office Open XML (.docx) • Rich Text File (.rtf) • PDF other than PDF/A (.pdf) Geographical Information (GIS) • GML (.gml) • MIF/MID (.mif/mid) • Esri Shapefiles (.shp & related files) • MapInfo (.tab & related files) • KML (.kml) • Esri Geodatabase (.gdb) • Project files/Workspaces (.mxd, .wor, .qgs) Spreadsheets • ODS (.ods) • CSV (.csv) • Microsoft Excel (.xls) • Office Open XML Workbook (.xlsx) • PDF/A (.pdf) Preferred Format Non-preferred Format 3D • WaveFront Object (.obj) • Polygon file format (.ply) • X3D (.x3d) • COLLADA (.dae) • Autodesk FBX (.fbx) • Blender (.blend) • 3D PDF (.pdf)
  • 17. Preferred Formats Text documents • PDF/A (.pdf) • ODT (.odt) • Microsoft Word (.doc) • Office Open XML (.docx) • Rich Text File (.rtf) • PDF other than PDF/A (.pdf) Geographical Information (GIS) • GML (.gml) • MIF/MID (.mif/mid) • Esri Shapefiles (.shp & related files) • MapInfo (.tab & related files) • KML (.kml) • Esri Geodatabase (.gdb) • Project files/Workspaces (.mxd, .wor, .qgs) Spreadsheets • ODS (.ods) • CSV (.csv) • Microsoft Excel (.xls) • Office Open XML Workbook (.xlsx) • PDF/A (.pdf) Preferred Format Non-preferred Format 3D • WaveFront Object (.obj) • Polygon file format (.ply) • X3D (.x3d) • COLLADA (.dae) • Autodesk FBX (.fbx) • Blender (.blend) • 3D PDF (.pdf)
  • 18. Preferred Formats Text documents • PDF/A (.pdf) • ODT (.odt) • Microsoft Word (.doc) • Office Open XML (.docx) • Rich Text File (.rtf) • PDF other than PDF/A (.pdf) Geographical Information (GIS) • GML (.gml) • MIF/MID (.mif/mid) • Esri Shapefiles (.shp & related files) • MapInfo (.tab & related files) • KML (.kml) • Esri Geodatabase (.gdb) • Project files/Workspaces (.mxd, .wor, .qgs) Spreadsheets • ODS (.ods) • CSV (.csv) • Microsoft Excel (.xls) • Office Open XML Workbook (.xlsx) • PDF/A (.pdf) Preferred Format Non-preferred Format 3D • WaveFront Object (.obj) • Polygon file format (.ply) • X3D (.x3d) • COLLADA (.dae) • Autodesk FBX (.fbx) • Blender (.blend) • 3D PDF (.pdf)
  • 19. Preferred Formats Text documents • PDF/A (.pdf) • ODT (.odt) • Microsoft Word (.doc) • Office Open XML (.docx) • Rich Text File (.rtf) • PDF other than PDF/A (.pdf) Geographical Information (GIS) • GML (.gml) • MIF/MID (.mif/mid) • Esri Shapefiles (.shp & related files) • MapInfo (.tab & related files) • KML (.kml) • Esri Geodatabase (.gdb) • Project files/Workspaces (.mxd, .wor, .qgs) Spreadsheets • ODS (.ods) • CSV (.csv) • Microsoft Excel (.xls) • Office Open XML Workbook (.xlsx) • PDF/A (.pdf) Preferred Format Non-preferred Format 3D • WaveFront Object (.obj) • Polygon file format (.ply) • X3D (.x3d) • COLLADA (.dae) • Autodesk FBX (.fbx) • Blender (.blend) • 3D PDF (.pdf)
  • 20. Spreadsheets / Data Tables to CSV Frankema, Prof. dr. E. (Wageningen University); Woltjer, P. (Wageningen University); Dalrymple-Smith, A. (Wageningen University); Bulambo, L. (Wageningen University) (2017): An Introduction to the African Commodity Trade Database, 1730-2010. DANS. https://doi.org/10.17026/dans-xt9-fzkw
  • 21. =IF(S8<>"",S8/ToT_regions!$N8*100,"") Spreadsheets Frankema, Prof. dr. E. (Wageningen University); Woltjer, P. (Wageningen University); Dalrymple-Smith, A. (Wageningen University); Bulambo, L. (Wageningen University) (2017): An Introduction to the African Commodity Trade Database, 1730-2010. DANS. https://doi.org/10.17026/dans-xt9-fzkw
  • 22. Preferred Formats export folder CSV and PDF/A exportsExcel files Frankema, Prof. dr. E. (Wageningen University); Woltjer, P. (Wageningen University); Dalrymple-Smith, A. (Wageningen University); Bulambo, L. (Wageningen University) (2017): An Introduction to the African Commodity Trade Database, 1730-2010. DANS. https://doi.org/10.17026/dans-xt9-fzkw
  • 24. 3D
  • 25. 3D Nagel, D (Wildcard); Cocquyt, T. (HuygensING) (2013): Animated, interactive 3D visualization of a corn mill, after a description by Ramelli. DANS. https://doi.org/10.17026/dans-zzq-ymge
  • 26. 3D Trognitz, M. (IANUS); Niven, K. (ADS), Gilissen V. (DANS) (2016): 3D Models in Archaeology: A Guide to Good Practice. https://guides.archaeologydataservice.ac.uk/g2gp/3d_Toc
  • 33. The PARTHENOS Policy Wizard: http://www.parthenos-project.eu/portal/wizard 33 Policy Wizard DANS guidelines ADS guidelines SND guidelines DANS ADS SND Knowledge Platform SEADDA / ARIADNEplus communities shared guidelines experts … Preferred Formats
  • 34. Knowledge Platform on GitHub - Proof of Concept Preferred Formats https://dans-labs.github.io/formats/ https://github.com/dataformats
  • 35. Mass migrations and transformations of archived data to new standards. “Upgrading is compulsory.” --the Cybermen Doctor Who, BBC Studios, 1963-2019 Migrations to Preferred Formats
  • 37. File identification (mediatype) Selection filter: visible files Extraction from archive (Python) Checksum validation Checksum validation Checksum validation Checksum validation Double conversion (Python) Adding provenance metadata to file ID’s Generating logfiles Archival storage Migrations to Preferred Formats
  • 38. Preservation Watch Free to use images from www.pexels.com (Pixabay / T. Malík)
  • 40. THANK YOU! ARIADNE is a project funded by the European Commission under the H2020 Programme, contract no. H2020-INFRAIA-2018-1-823914. The views and opinions expressed in this presentation are the sole responsibility of the authors and do not necessarily reflect the views of the European Commission. Contact: hella.hollander@dans.knaw.nl valentijn.gilissen@dans.knaw.nl julian.richards@york.ac.uk www.ariadne-infrastructure.eu www.dans.knaw.nl