SlideShare a Scribd company logo
ARCHIVER – Project Update
Open Market Consultation
23rd of May 2019 – Stansted, UK
João Fernandes
Project Coordinator
CERN
Pre-Commercial Procurement
07.05.2019 ARCHIVER Project Overview 2
Focus: Archiving and Data Preservation Services using commercial cloud services
Procurement Budget: 3.4M euro
Starting Date: 1st of January 2019
Duration: 36 Months
Coordinating Partner: CERN
Consortium
Includes Buyers and Experts in the preparation, execution and promotion of the Procurement of R&D
07.05.2019 ARCHIVER Project Overview 3
Procurers - Public organisations committing funds to contribute to a joint-procurement
Experts – Partner organisations bringing expertise in requirement assessment and promotion activities, not part of the Buyers Group
Challenge
Data volumes and complexity growing; Communities Growing; Needs of advanced functionality increase
Objective: perform R&D to demonstrate long-term preservation and archiving services for scientific data in the PB range under
F.A.I.R. principles, using commons solutions, while research groups keep total stewardship of their data sets
OAIS, FAIR and European Regulation (GDPR)
European Open Science Cloud (EOSC) integration
Reduce fragmentation expanding existing solutions to several scientific domains
Access through GÉANT network; Federated AAI support
Scalability: PB data volume of multi domain scientific data; High sustained ingest rates (1-10 Gbps)
Cost-effective and transparent business models: range of purchasing and deployment options, stimulating uptake by the wider
research community
07.05.2019 ARCHIVER Project Overview 4
Basic Scientific Data
Archiving & Bit
Preservation
OAIS Reference Model
Relevant Standards
Preservation: ISO 14721/16393, 26324 and related
Infrastructure Services: ISO 27000, ISO 27040, 19086
07.05.2019 ARCHIVER Project Overview 5
Cost-effective
Business Model
Taking into account:
- Scale
- Ingest rates
- Archive lifetime
- # of copies
- Exit strategies
- Portability
- SLAs
Regulation &
Legislation
- Auditing
- Self-assessment
- Data Retention
- GDPR
R&D Challenge
07.05.2019 ARCHIVER Project Overview 6
Data integrity/security; cloud/hybrid deployment; data
volume in the PB range; high, sustained ingest data rates;
ISO certification: 27000, 27040, 19086 and related
Archives connected to the GEANT network.
OAIS conformant services: data readability formats, normalization,
obsolesce monitoring, files fixity, authenticity checks, etc.;
ISO 14721/16393, 26324 and related standards
User services: search, discover, share, indexing, data removal, etc.;
Access under Federated IAM
Layer 1
Storage/Basic Archiving/Secure
backup
Layer 2
Preservation
Layer 3
Baseline user services
Layer 4
Advanced services
High level services: visual representation of data (domain specific),
reproducibility of scientific analyses, etc.;
Minimum
R&D
Objectives
Added
value
R&D
Fundamental aspect
of the challenge
ARCHIVER & European Open Science Cloud (EOSC)
07.05.2019 ARCHIVER Project Overview 7
ARCHIVER Services can be procured
2019 2020 2021 2022 2023
EOSC vision:
To give the European Union a global lead in research data management and ensure that European
scientists reap the full benefits of data-driven science
ARCHIVER Objective: to make resulting services available in the EOSC catalogue
EOSC Rules of Engagement evolving: will be presented during the the project
Market Potential
07.05.2019 ARCHIVER Project Overview 8
ESFRI Landmarks
RIs already implemented or in an advanced Implementation Phase.
ESFRI Projects
RIs in a preparation phase selected for scientific case excellence and maturity.
http://roadmap2018.esfri.eu/media/1049/roadmap18-part3.pdf
ARCHIVER timeline
07.05.2019 ARCHIVER Project Overview 9
Suppliers to sign a framework agreement in order to participate in the call-offs
Goal: Services to be commercialized after the end of the PCPWe are here
Summary of ARCHIVER activities so far
07.05.2019 ARCHIVER Project Overview 10
Open Market Consultation Kick-Off event – 8th of April
07.05.2019 ARCHIVER Project Overview 11
70 participants from 26 companies physically
present
Digital Preservation Experts, Cloud Providers, Software
integrators
42 participants connected remotely (via webcast)
Planning poker to assess Value vs. Risk in a direct
dialogue with companies
All material available at:
https://www.archiver-project.eu/open-market-consultation-kick-event
ARCHIVER in the EOSC-hub week
07.05.2019 ARCHIVER Project Overview 12
EOSC demand side event
Overview of current EOSC activities
Session on role of Procurement in the EOSC context
State-of-the art and landscaping discussions
Early Adopters
A number of organisations have expressed interest
Early Adopters Kit to be made available during May 2019
Open Market Consultation event – 7th of May Barcelona
07.05.2019 ARCHIVER Project Overview 13
40 participants from 17 companies physically
present
Digital Preservation Experts, Cloud Providers,
Software integrators
All material available at:
https://www.archiver-project.eu/open-market-consultation-kick-event
OAIS Webinar – 9th of May
07.05.2019 ARCHIVER Project Overview 14
17 participants
Representatives of the Buyers Group,
Companies and Research Organisations
All material available at:
https://www.archiver-project.eu/all-events
Draft Tender Documents Published (update)
Draft versions of the tender documents are now available during the OMC process,
including:
RfT, Framework Agreement and Functional Specification;
Annex 2 (Selection Criteria); Annex 4 (Award Criteria);
Initial list of Milestones and Deliverables;
Q&A from the OMC also publicly available
You are able to make comments on the technical documents and ask more questions
07.05.2019 ARCHIVER Project Overview 15
https://www.archiver-project.eu/draft-tender-documents
Early Adopters
Objective: Encourage wide deployment outside the Buyers Group of
solutions developed during the project, ARCHIVER will engage with a group
of “Early Adopters”.
Benefits:
Be consulted for feedback on the tender documents before its publication,
scheduled on October 2019
Access parts of the R&D produced by the ARCHIVER Contractors across all phases of
the project
Access to limited capacity made available by the Buyers Group during the pilot
phase to test the services developed
Early Adopters will be listed on the Request for Tender (RfT)
23/05/2019 ARCHIVER Project Overview 16
Preparation of a technical summary for each use case
Problem to solve
Lifecycle and workflow characteristics
Including basic and “bonus” use cases to solve
Authentication and Management
Data and Metadata description
Interface
Reliability, Compliance and Validation requirements
Cost-effectiveness requirements
Some including minimum cost tresholds
23/05/2019 ARCHIVER Project Overview 17
Next Open Market Consultation Event
07.05.2019 ARCHIVER Project Overview 18
Registration open: https://www.archiver-project.eu/all-events
Rest of the Agenda for Today
Tender Process and Requirements, Joshua Luke Davison (CERN)
Deployment Scenarios, Representatives of the Buyers Group
13.00 - 14.00 – Lunch Break
Deployment Scenarios, Representatives of the Buyers Group
GEANT Network connectivity, Vincenzo Capone (GEANT)
15.15 - 15.40 – Coffee Break
Federated Identity Management Overview, Hannah Short (CERN)
Wrapping up and Next Steps, Marion Devouassoux (CERN)
Event ends at 16:40
07.05.2019 ARCHIVER Project Overview 19
Summarizing, what’s in it for you?
07.05.2019 ARCHIVER Project Overview 20
Demonstrate archiving & preservation services for petabyte data volumes, high
ingest sustained data rates (1-10 Gbps per day) for multi-disciplinary scientific data
Diversify your offer and commercialize resulting services by the end of the project
Support the open data movement
Offer services via the European Open Science Cloud (EOSC) Catalogue
Access the public funded European Research Infrastructures (RIs) as a new market
segment
Great thanks to EMBL-EBI for the organization of the event
23/05/2019 ARCHIVER Project Overview 21
##SAISExp1 22

More Related Content

Archiver 3rd omc_project_overview

  • 1. ARCHIVER – Project Update Open Market Consultation 23rd of May 2019 – Stansted, UK João Fernandes Project Coordinator CERN
  • 2. Pre-Commercial Procurement 07.05.2019 ARCHIVER Project Overview 2 Focus: Archiving and Data Preservation Services using commercial cloud services Procurement Budget: 3.4M euro Starting Date: 1st of January 2019 Duration: 36 Months Coordinating Partner: CERN
  • 3. Consortium Includes Buyers and Experts in the preparation, execution and promotion of the Procurement of R&D 07.05.2019 ARCHIVER Project Overview 3 Procurers - Public organisations committing funds to contribute to a joint-procurement Experts – Partner organisations bringing expertise in requirement assessment and promotion activities, not part of the Buyers Group
  • 4. Challenge Data volumes and complexity growing; Communities Growing; Needs of advanced functionality increase Objective: perform R&D to demonstrate long-term preservation and archiving services for scientific data in the PB range under F.A.I.R. principles, using commons solutions, while research groups keep total stewardship of their data sets OAIS, FAIR and European Regulation (GDPR) European Open Science Cloud (EOSC) integration Reduce fragmentation expanding existing solutions to several scientific domains Access through GÉANT network; Federated AAI support Scalability: PB data volume of multi domain scientific data; High sustained ingest rates (1-10 Gbps) Cost-effective and transparent business models: range of purchasing and deployment options, stimulating uptake by the wider research community 07.05.2019 ARCHIVER Project Overview 4 Basic Scientific Data Archiving & Bit Preservation
  • 5. OAIS Reference Model Relevant Standards Preservation: ISO 14721/16393, 26324 and related Infrastructure Services: ISO 27000, ISO 27040, 19086 07.05.2019 ARCHIVER Project Overview 5
  • 6. Cost-effective Business Model Taking into account: - Scale - Ingest rates - Archive lifetime - # of copies - Exit strategies - Portability - SLAs Regulation & Legislation - Auditing - Self-assessment - Data Retention - GDPR R&D Challenge 07.05.2019 ARCHIVER Project Overview 6 Data integrity/security; cloud/hybrid deployment; data volume in the PB range; high, sustained ingest data rates; ISO certification: 27000, 27040, 19086 and related Archives connected to the GEANT network. OAIS conformant services: data readability formats, normalization, obsolesce monitoring, files fixity, authenticity checks, etc.; ISO 14721/16393, 26324 and related standards User services: search, discover, share, indexing, data removal, etc.; Access under Federated IAM Layer 1 Storage/Basic Archiving/Secure backup Layer 2 Preservation Layer 3 Baseline user services Layer 4 Advanced services High level services: visual representation of data (domain specific), reproducibility of scientific analyses, etc.; Minimum R&D Objectives Added value R&D Fundamental aspect of the challenge
  • 7. ARCHIVER & European Open Science Cloud (EOSC) 07.05.2019 ARCHIVER Project Overview 7 ARCHIVER Services can be procured 2019 2020 2021 2022 2023 EOSC vision: To give the European Union a global lead in research data management and ensure that European scientists reap the full benefits of data-driven science ARCHIVER Objective: to make resulting services available in the EOSC catalogue EOSC Rules of Engagement evolving: will be presented during the the project
  • 8. Market Potential 07.05.2019 ARCHIVER Project Overview 8 ESFRI Landmarks RIs already implemented or in an advanced Implementation Phase. ESFRI Projects RIs in a preparation phase selected for scientific case excellence and maturity. http://roadmap2018.esfri.eu/media/1049/roadmap18-part3.pdf
  • 9. ARCHIVER timeline 07.05.2019 ARCHIVER Project Overview 9 Suppliers to sign a framework agreement in order to participate in the call-offs Goal: Services to be commercialized after the end of the PCPWe are here
  • 10. Summary of ARCHIVER activities so far 07.05.2019 ARCHIVER Project Overview 10
  • 11. Open Market Consultation Kick-Off event – 8th of April 07.05.2019 ARCHIVER Project Overview 11 70 participants from 26 companies physically present Digital Preservation Experts, Cloud Providers, Software integrators 42 participants connected remotely (via webcast) Planning poker to assess Value vs. Risk in a direct dialogue with companies All material available at: https://www.archiver-project.eu/open-market-consultation-kick-event
  • 12. ARCHIVER in the EOSC-hub week 07.05.2019 ARCHIVER Project Overview 12 EOSC demand side event Overview of current EOSC activities Session on role of Procurement in the EOSC context State-of-the art and landscaping discussions Early Adopters A number of organisations have expressed interest Early Adopters Kit to be made available during May 2019
  • 13. Open Market Consultation event – 7th of May Barcelona 07.05.2019 ARCHIVER Project Overview 13 40 participants from 17 companies physically present Digital Preservation Experts, Cloud Providers, Software integrators All material available at: https://www.archiver-project.eu/open-market-consultation-kick-event
  • 14. OAIS Webinar – 9th of May 07.05.2019 ARCHIVER Project Overview 14 17 participants Representatives of the Buyers Group, Companies and Research Organisations All material available at: https://www.archiver-project.eu/all-events
  • 15. Draft Tender Documents Published (update) Draft versions of the tender documents are now available during the OMC process, including: RfT, Framework Agreement and Functional Specification; Annex 2 (Selection Criteria); Annex 4 (Award Criteria); Initial list of Milestones and Deliverables; Q&A from the OMC also publicly available You are able to make comments on the technical documents and ask more questions 07.05.2019 ARCHIVER Project Overview 15 https://www.archiver-project.eu/draft-tender-documents
  • 16. Early Adopters Objective: Encourage wide deployment outside the Buyers Group of solutions developed during the project, ARCHIVER will engage with a group of “Early Adopters”. Benefits: Be consulted for feedback on the tender documents before its publication, scheduled on October 2019 Access parts of the R&D produced by the ARCHIVER Contractors across all phases of the project Access to limited capacity made available by the Buyers Group during the pilot phase to test the services developed Early Adopters will be listed on the Request for Tender (RfT) 23/05/2019 ARCHIVER Project Overview 16
  • 17. Preparation of a technical summary for each use case Problem to solve Lifecycle and workflow characteristics Including basic and “bonus” use cases to solve Authentication and Management Data and Metadata description Interface Reliability, Compliance and Validation requirements Cost-effectiveness requirements Some including minimum cost tresholds 23/05/2019 ARCHIVER Project Overview 17
  • 18. Next Open Market Consultation Event 07.05.2019 ARCHIVER Project Overview 18 Registration open: https://www.archiver-project.eu/all-events
  • 19. Rest of the Agenda for Today Tender Process and Requirements, Joshua Luke Davison (CERN) Deployment Scenarios, Representatives of the Buyers Group 13.00 - 14.00 – Lunch Break Deployment Scenarios, Representatives of the Buyers Group GEANT Network connectivity, Vincenzo Capone (GEANT) 15.15 - 15.40 – Coffee Break Federated Identity Management Overview, Hannah Short (CERN) Wrapping up and Next Steps, Marion Devouassoux (CERN) Event ends at 16:40 07.05.2019 ARCHIVER Project Overview 19
  • 20. Summarizing, what’s in it for you? 07.05.2019 ARCHIVER Project Overview 20 Demonstrate archiving & preservation services for petabyte data volumes, high ingest sustained data rates (1-10 Gbps per day) for multi-disciplinary scientific data Diversify your offer and commercialize resulting services by the end of the project Support the open data movement Offer services via the European Open Science Cloud (EOSC) Catalogue Access the public funded European Research Infrastructures (RIs) as a new market segment
  • 21. Great thanks to EMBL-EBI for the organization of the event 23/05/2019 ARCHIVER Project Overview 21