1. BHL-Europe
Go for a PAS* Museum für Naturkunde
*Preservation & Archive System
Represent Atos Origin in
Roger Essoh BHL-Europe Consortium
Head of Innovation
Biz Dev Manager Acting as Open Source
Open Source Manager and Preservation and
Public Sector - France Archive System consultant
Roger Essoh Deputy in
Lee Namba BHL-Europe Consortium
Chief Architect
Public Sector – France Acting as Preservation and
Archive System consultant
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
2. BHL-Europe
We’ve a PAS* to build !
* Preservation and Archive System Meta-Data is a key success
WP 3 factor of the consumers
satisfaction !
(Taxonomic, Multilanguage's,…)
ENGINE
INGEST STORAGE ACCESS CONSUMERS
PROVIDERS
Compliance with
Europeana Meta-Data
requirements
Europeana
connect API Europeana WP 2 Thank to CASPAR for the nice picture
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
3. Our primary goal BHL-Europe
Prototype for German language
German digital content
ENGINE
INGEST STORAGE ACCESS CONSUMERS
PROVIDERS
Now how to
Europeana build a PAS ?
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
4. Building a PAS : BHL-Europe
Digital Preservation issues
1. How To guarantee a digital information may be accessed and
understood in the future
2. How To guarantee a proper information package management
within and OAIS Archive
3. How To guarantee long-time preservation maintenance of any
information package
4. How To guarantee retrieval of Archival Information
5. How To guarantee intellegibility within heterogeneous Designated
Communities and their digital information
6. How To guarantee preservation actors are informed about change
events
7. How To guarantee an adequate security access with the proper
rights to any resource and functionality within an OAIS Archive
8. How To guarantee an adequate integrity and identity for any
Archival Information
Source – Luigi Briguglio
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
5. BHL-Europe
Ideal approach ???
Maintenance
Integration
Open Community
Source
More risks
Standards
Long-term Partnership D
ROA
BLE
AINA
Work close SUST
Maintenance
Integration
Open By my own
Source
Less possible
Standards
Short-term Not essential BLE
?
AINA
SUST
Not relevant
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
6. BHL-Europe
Long-term ?
Maintenance
Integration
Open Community
Source
More risks
Standards
Long-term Partnership D
ROA
BLE
AINA Share our roadmap
Work close SUST
Setup a process
review to ensure we
Reuse Europeana
assets (quick wins,
stay aligned with the
best practices, communities
standards,…)
Define what we mean Build a B2B (win-win) An Integration project
by Standard regarding our partnership…No reinvent the
Setup an Implementation
requirements ! wheel
methodology and industrialize
Be sure we’re choosing Focus on the BHL System the development platform
the right standards ! maintenance and mutual
interests during the deal
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
7. BHL-Europe
Some integration challenges
Challenge Challenge
Challenge
OAI repository
(descriptive metadata Identity (rights metadata OAIS compliance
catalog) management management)
The SYSTEM
META DATA Policeman RIGHT MEDIATOR HEART
Producer n
Challenge
Users
Producer 3 Pre Ingest Ingest
Rights Easy, simple,
Preser- Adminis- management understanding,
vation tration Multilanguage'
s and
homogeneous
access
Producer 2
Data management Access THE SUCCESS
FACTOR
Storage
Producer 1 Storage Abstraction Service (SAS)
Total
OAIS CORE Performance
Excellence
POWER &
ROBUSTNESS
BHL-Europe - Infrastructure
Challenge
BHL-Europe System
Challenge Challenge
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
8. BHL-Europe
Integration success factors
Drivers Answers
Development & Integration Use Agile approach to manage
strategy & methodology complexity and technical risks
Digital preservation Design a Digital
expertise preservation leader
BHL-Europe Execute Iterative
Stable specifications
ASAP Preservation & benchmarks to
Archive System validate requirements
System integration Design a system
expertise integration leader
Industrialize your Use continuous Integration engine
development platform with a strong issues tracker
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
9. BHL-Europe
Development strategy
Pure Service-oriented design • No Dependencies
guarantees that the component can • Loosely coupled
provide functionality without requiring • Distributed
Self-
Self-Contained + cooperation of other components
Component analysis, design and • Sharing know-how
Well Described + development process is strongly based • Open Specification
on complete – shared – open • Open Source
documentation at any level • Open Documentation
Adaptable +
Design choices and implementation allows • Flexibility
to adapt and configure each component to • Scalability
Replaceable = provide always at least a minimal set of
functionality independently from the
deployment framework and condition
Preservable Design choices and implementation allows • Interoperability
to replace any component in the framework • Mantainability
with compliant one.
Source – Luigi Briguglio
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
10. BHL-Europe
Example of development steps
Pre Ingest Ingest
Adminis
Rights
management
Pre Ingest Preservation Rights Mgt Access
Preser- -tration
vation
• Activity 1 • Activity 1 • Activity 1 • Activity 1
Data management Access
• Activity 2 • Activity 2 • Activity 2 • Activity 2
Storage
• Activity n • Activity n • Activity n • Activity n
Storage Abstraction Service (SAS)
OAIS CORE
BHL-Europe - Infrastructure
Ingest Data Mgt SAS
BHL-Europe System
• Activity 1 • Activity 1 • Activity 1
• Activity 2 • Activity 2 • Activity 2
• Work by module • Activity n • Activity n • Activity n
• Driven by an
Integration strategy Infrastructure Storage Administration
• Based on development • Activity 1 • Activity 1 • Activity 1
by contract • Activity 2 • Activity 2 • Activity 2
• Activity n • Activity n • Activity n
STEP 1
STEP 2
STEP 3
STEP 4
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
11. BHL-Europe
An Agile approach
Ingest Module
Sprint 1 Sprint 2 Sprint 3
Release 1
4 weeks 4 weeks 3 weeks
Storage Module
Sprint 1 Sprint 2 Sprint 3
Release 1
Pre Ingest Preservation Rights Mgt Access
• Activity 1 • Activity 1 • Activity 1 • Activity 1 4 weeks 4 weeks 3 weeks
• Activity 2 • Activity 2 • Activity 2 • Activity 2
• Activity n • Activity n • Activity n • Activity n
Ingest Data Mgt SAS
• Activity 1 • Activity 1 • Activity 1
• Activity 2 • Activity 2 • Activity 2
• Activity n • Activity n • Activity n • Respect implementation
Infrastructure Storage Administration
Integration contract to ensure efficient
• Activity 1 • Activity 1 • Activity 1 integration
• Activity 2 • Activity 2 • Activity 2
• Activity n • Activity n • Activity n
STEP 1
STEP 2
STEP 3
STEP 4
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
12. BHL-Europe
Continuous Integration Engine
Automate integration, Improve release quality, Identify regressions
Release 1 Release 2 Release n Final version
Eclipse / SCM / Hudson Architecture
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
13. BHL-Europe
Ideas for collaboration platform
Centralize Distributed
Development ? Development ?
Timesheet P P
BHL-Europe Wiki
system
P
Synchronized
Dev collaboration platform platform
Hudson platform Technical Wiki P P
(Continuous Integration)
Jtrac
(Issues tracker)
Mercurial ? Mercurial/ JIT
SVN ? (tech)
….
Instant messaging ?
……
Gtalk,…?
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org
14. BHL-Europe
Pre Ingest Ingest
Rights
Adminis-
Preser- management
tration
vation
Data management Access
Storage
Storage Abstraction Service (SAS)
OAIS CORE
BHL-Europe - Infrastructure
BHL-Europe System
Biodiversity Heritage Library for Europe – ECP-2008-DILI-518001 – Kick-off meeting – Berlin – 10-15 May 2009 www.biodiversitylibrary.org