SlideShare a Scribd company logo

EOSC-hub contribution to the EOSC implementation, the Hub concept and engagement with stakeholders

•Download as PPTX, PDF•
•
E
EOSC-hub project

EOSC-hub contribution to the EOSC implementation, the Hub concept and engagement with stakeholders, Tiziana Ferrari, Technical Director, EGI & EOSC-hub Project Coordinator; Per Öster, Director, CSC & EOSC-hub Project Director (EOSC hub week, Malaga, 16 - 20 April 2018)

1 of 26
EOSC-hub receives funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 777536. eosc-hub.eu @EOSC_eu Per Öster & Tiziana Ferrari EOSC-hub contribution to the EOSC implementation, the Hub concept and engagement with stakeholders
• Project overview • Early results • The Hub • Contribution to EOSC implementation roadmap 16 April 2018 2 Outline
EOSC-hub mobilises providers from 20 major digital research infrastructures, EGI, EUDAT CDI and INDIGO-DataCloud jointly offering services, software and data for advanced data-driven research and innovation PART I Project overview and achievements
• European Commission Horizon2020 programme • 100 Partners, 76 beneficiaries (75 funded) • 3874 PMs, 108 FTEs, more than 200 technical and scientific staff involved - Budget: €33,331,18, contributed by: ▪ European Commission: €30,000,000 ▪ EGI Foundation and its participants: €2,155,540 ▪ EGI participants: €1,221,094 • 36 months: Jan 2018 – Dec 2020 The Project in numbers 16 April 2018
5 EOSC-hub Mission The project will create EOSC Hub: a federated integration and management system for EOSC • Data • Applications & tools • Baseline services (storage, compute, connectivity)… • Training, consultants • Marketplace • AAI • Accounting • Monitoring • … • Security regulations, • Compliance to standards, • Terms of use, • FAIR implementation guidelines • … Participation according to Principles of engagement (ref. EOSCpilot) By the consortium and external contributors • Lightweight certification of providers • SLA negotiation • Customer Relationship Management • … Services Federation services Federated operations Processes and policies Based on FitSM 16 April 2018
Project workflow 16 April 2018
4/14/18 Service Providers e-Infra EGI Federation EUDAT CDI Humanities Language and literature (CLARIN) Arts (DARIAH) Engineering Environmental engineering (sea vessels, LNEC) Civil Engineering (Disaster Mitigation) Medical and Health Sciences Biological Sciences (ELIXIR) Structural biology (WeNMR) Natural sciences Generic and general services Physical Sciences • Astronomy (LOFAR) • Fusion (ITER) • High Energy Physics (CMS and VIRGO) • Space Science (EISCAT-3D) Earth Science • EO Pillar • GEO • Climate Research (ENES) • Seismology (ORFEUS, EPOS) Biological Sciences • Marine and freshwater biology (IFREMER) • Biodiversity conservation (LifeWatch) • Ecology (ICOS)
Open Collaboration services Basic infrastructure and added-value services Federation services • Applications Database • Repositories • Accounting • ARGO • Check-in • GGUS • GOCDB • Marketplace • Operations Portal • RC Auth • SPMT • DPMT • B2ACCESS • TTS • SYMON • EGI High-Throughput Compute • EGI Cloud Compute • EGI Cloud Container • DIRAC4EGI • EGI Online storage • EGI DataHub • B2HANDLE • B2FIND • B2DROP • B2SAFE • B2STAGE • B2NOTE • ETDR • Sensitive Data Service • Advanced IaaS • TOSCA for Heat • OPIE Service catalogue https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue WP6WP5 WP5 Thematic services WP7 • ECAS • DARIAH Gateway • OPENCoastS • GEOSS • EO Pillar • WeNMR • DODAS • LifeWatch • CMI From month 19: • IFREMER • EISCAT_3D Portal 16 April 2018
Mapping Services to the research data lifecycle Processing & Analysis Data Management, Curation & Preservation Access, Deposition & Sharing Federation Services ● B2FIND (data) ● Marketplace (Services) ● Applications on Demand ● Federated HTC & Cloud Compute IaaS & PaaS ● Processing of sensitive data ● Jupyter Notebook ● Application DB (software & VM) ● B2DROP (data) ● B2Note (data) ● B2SHARE (data) ● DataHub ● Federated AAI. monitoring, accounting ● SLA and order Management ● Security incident response and policies ● Technical support & Training ● B2HANDLE ● B2SAFE ● European Certified Trusted Repository ● Thematic data analytics ● Scientific Workflow Management, Orchestration (DIRAC, PaaS Orchestrator) 1 2 3 4 Discover & Reuse EOSC-hub service catalogue: https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue 16 April 2018
Early results after 4 months
WP11 – Training and Services for Service operators, Research and Higher Education • T11.2 – Data Management Planning (DMP) - Training event on RDM during the EOSC-hub AHM, April 18, 16:00-17:30 CEST - EOSC-hub/OpenAIRE-Advance joint training webinar on open and FAIR RDM - May 15, 13:00-14:00 CEST • T11.3 – Federated Service Management Training and Certifications - FitSM Foundation training events (co-located with the EOSC-hub KoM and the AHM) - Webinars on Lightweight Service management for Research Infrastructures for the CORBEL and ENVRIplus projects - FitSM process webinars for EOSC-hub task leaders, About 80+ people trained on ITSM based on FitSM standard • T11.4 – Training about common and federated services - Security workshop for users, VM operators and VM endorsers (ISGC2018), ~30 participants • T11.5 – Domain-specific training to data providers and data scientists - INSTRUCT training course: Advanced methods for the integration of diverse structural data, January 2018 - IEEE Workshop on Big Data Governance and Metadata and Management (BDGMM 2018), co-organized by CLARIN, March 2018 - 1st ECAS training event on the use of the ECAS integrated service (March 2018), 30+ participants 16 April 2018
• Update of Check-in ORCID login connector after deprecation of ORCID API v1.2 [DONE] • Draft workplan for RCauth Online CA High Availability Support [DONE] • Initial workplan for integration with OpenAIRE AAI [DONE] • Initial integration of B2ACCESS with Check-in - Harmonisation of user identifiers [DONE] - Harmonisation of group membership information [ONGOING] - Harmonisation of affiliation membership information [ONGOING] - Interconnection of IdP Proxies to allow users to access services across infrastructures [ONGOING] 2/14/2018 12 WP5.1 AAI
● Preparation of production instance ○ Generic and subset of thematic services ● Integration with federated AAI (Check-In) ● In progress - Integration with other backoffice tools ▪ Service configuration management ▪ Service portfolio management ▪ Data management 13 Marketplace status and next steps GOCDB DPMTSPMT Operations Portal EOSC-Hub Service Catalogue Accounting Marketplace Check-in EGI-CMDB EUDAT-CMDB 16 April 2018
Deliverables • D9.1 "1st Stage Business Pilots Overview and Work Plans” (M3 – Mar 2018) – Full report completed and submitted to EC • D3.1 "EOSC-hub Communication & Stakeholder Engagement Plan" (M4 - Apr 2018) – Contribution from WP9 • D9.2 "Joint Digital Innovation Hub Intro and Strategy" (M6 - June 2018) – Outlined ToC; defined an action plan for first draft Project management related responsibilities • Key Exploitable Results, KPIs and metrics defined, including meeting with Innovation Manager • High-level WP9 workplan for PY1, including meeting with AMB co-chairs • Bi-weekly calls being held regularly with all internal management tools set up Analysis • Technical requirements for the business pilots, incl. coordination with WP10 • Available DIH IT platforms for adoption, incl. initial engagement with a DIH (manufacturing) Industry events/collaborations • Digital Innovation Hubs 2nd Working Group meeting (21 Feb 2018) • BDVA Activity Group Meeting (14-15 Mar 2018) / Initiating collaboration between BDVA/iSpace • ICTFOOTPRINT.eu Workshop on “Green ICT – in practice” (20 Mar 2018) • List of future events compiled and prioritization under discussion Joint Digital Innovation Hub (WP9) 1st 3 Months Activity/Results 16 April 2018
An open set of process, policies and support tools for EOSC onboarding of providers and end-users and the human resources to run it PART II Project contribution to “the Hub”
16 The Hub • A European-level contact point for researchers and innovators to discover, access, use and reuse a broad spectrum of resources for advanced data- driven research. - Through the virtual access mechanism, more scientific communities and users have access to services supporting their scientific discovery and collaboration across disciplinary and geographical boundaries. • Open to service providers and end-users - The project will support the integration new thematic services and scientific products from research communities and disciplines. 16 April 2018
• Publish services and products • Define Hub policies and comply to these (general & community-specific) → community labels • e.g. FAIR best practices, access and usage policies, interoperability and standards • Define/Adopt standard-compliant general service management processes with other providers • Exploit tools and for service management • Accounting, monitoring, federated AAI • Incident management, order management, SLA management, IT security management … Providers • Use institutional credentials for access • Discover, compare • Order, get access and support • Request additional services and products End-users 17 Value proposition 16 April 2018
• Manage alignment of services to defined policies and standards • Align services and products metadata to community guidelines (eInfraCentral, OpenAIRE-Advance) • Define/maintain/review service level agreements • Conduct service audits and quality assurance reviews • Manage end-to-end service level management performance retaining overall accountability • Provide the tools for aggregating demand and supply, make services and research artifacts discoverable and accessible at European level etc. • Coordinate IT security operations • Support users with incident management 18 Hub service management system 16 April 2018
19 Marketplace functions Promote and share Discover Order Access 16 April 2018
20 • Open catalogue of services and products - Integrated discovery, order & access management • Service options • Visibility to service provider’s brand • Integrated with AAI (eduGAIN, social IDs, IGTF, etc.), AARC blueprint conformant • First release: July 2018 - https://marketplace.eosc-hub.eu/ Marketplace Compute Storage & Data Identity & Security Platforms Thematic services Professional services 16 April 2018
May 2018: General services accessible through federated AAI (B2ACCESS and Check-In) Service portfolio management process July 2018: Order general services through the EOSC- Hub Marketplace Nov 2018: Accounting and monitoring of all general services Integrated Helpdesk system Dec 2018 Consistent monitoring of all EOSC-Hub services Feb 2019 Majority of Service Management System completed 21 Milestones 16 April 2018
22 Architecture Federating Core General and Thematic services Service management system (process and policies) Data Data products Data analytics tools FAIR guidelines from participating communities Services AAI, accounting, monitoring Helpdesk Service catalogue Access and Interfaces Marketplace AAI Standards roadmap Rules Policies for users Policies for service/product suppliers Governance Service Management System Governance Contribution to the EOSC implementation 16 April 2018
Service/Product providers • Contribute to the catalogue & Integrate • Promote, Train, Exploit • Manage the Hub Early adopters • Pilot • Use • Co-develop Consumers • Credit allocation & exploit • Support • Improve with feedback • technical support, exploit 23 Engage with the Hub! 16 April 2018
24 • OpenAIRE-Advance - Service integration ▪ Consumable data management plans ▪ Interoperability for discovery of data, publications and software ▪ AAI, annotation, data anonymization - Open science scientific impact ▪ guidelines for the measurement and exchange of usage statistics - Communications, engagement, training and support - Strategy Collaborations - e-Infrastructures • eInfraCentral - Guidelines for service profiling and APIs service portfolio information exchange - EOSC portal • EOSCpilot - Validation of architecture, federated service management & service portfolio management - Scientific demonstrators • GÉANT 4.2/3 - Security, trust & identity - Service management - Engagement 16 April 2018
25 • Current and future ESFRI Cluster Projects • Thematic clouds - eROSA, AGRINFRA+ - Blue Cloud • Research collaborations • Virtual Research Environments Collaboration - Research communities • FAIR implementation guidelines • Discovery/Access to community specific scientific products (data, publications, software) through the EOSC-hub marketplace • technical innovation and co-design • Scaling up of data/compute infrastructure • AAI • ... 16 April 2018
eosc-hub.eu @EOSC_eu Thank you for your attention! Questions? Contact contact@mailman.eosc-hub.eu

More Related Content

EOSC-hub contribution to the EOSC implementation, the Hub concept and engagement with stakeholders

  • 1. EOSC-hub receives funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 777536. eosc-hub.eu @EOSC_eu Per Öster & Tiziana Ferrari EOSC-hub contribution to the EOSC implementation, the Hub concept and engagement with stakeholders
  • 2. • Project overview • Early results • The Hub • Contribution to EOSC implementation roadmap 16 April 2018 2 Outline
  • 3. EOSC-hub mobilises providers from 20 major digital research infrastructures, EGI, EUDAT CDI and INDIGO-DataCloud jointly offering services, software and data for advanced data-driven research and innovation PART I Project overview and achievements
  • 4. • European Commission Horizon2020 programme • 100 Partners, 76 beneficiaries (75 funded) • 3874 PMs, 108 FTEs, more than 200 technical and scientific staff involved - Budget: €33,331,18, contributed by: ▪ European Commission: €30,000,000 ▪ EGI Foundation and its participants: €2,155,540 ▪ EGI participants: €1,221,094 • 36 months: Jan 2018 – Dec 2020 The Project in numbers 16 April 2018
  • 5. 5 EOSC-hub Mission The project will create EOSC Hub: a federated integration and management system for EOSC • Data • Applications & tools • Baseline services (storage, compute, connectivity)… • Training, consultants • Marketplace • AAI • Accounting • Monitoring • … • Security regulations, • Compliance to standards, • Terms of use, • FAIR implementation guidelines • … Participation according to Principles of engagement (ref. EOSCpilot) By the consortium and external contributors • Lightweight certification of providers • SLA negotiation • Customer Relationship Management • … Services Federation services Federated operations Processes and policies Based on FitSM 16 April 2018
  • 7. 4/14/18 Service Providers e-Infra EGI Federation EUDAT CDI Humanities Language and literature (CLARIN) Arts (DARIAH) Engineering Environmental engineering (sea vessels, LNEC) Civil Engineering (Disaster Mitigation) Medical and Health Sciences Biological Sciences (ELIXIR) Structural biology (WeNMR) Natural sciences Generic and general services Physical Sciences • Astronomy (LOFAR) • Fusion (ITER) • High Energy Physics (CMS and VIRGO) • Space Science (EISCAT-3D) Earth Science • EO Pillar • GEO • Climate Research (ENES) • Seismology (ORFEUS, EPOS) Biological Sciences • Marine and freshwater biology (IFREMER) • Biodiversity conservation (LifeWatch) • Ecology (ICOS)
  • 8. Open Collaboration services Basic infrastructure and added-value services Federation services • Applications Database • Repositories • Accounting • ARGO • Check-in • GGUS • GOCDB • Marketplace • Operations Portal • RC Auth • SPMT • DPMT • B2ACCESS • TTS • SYMON • EGI High-Throughput Compute • EGI Cloud Compute • EGI Cloud Container • DIRAC4EGI • EGI Online storage • EGI DataHub • B2HANDLE • B2FIND • B2DROP • B2SAFE • B2STAGE • B2NOTE • ETDR • Sensitive Data Service • Advanced IaaS • TOSCA for Heat • OPIE Service catalogue https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue WP6WP5 WP5 Thematic services WP7 • ECAS • DARIAH Gateway • OPENCoastS • GEOSS • EO Pillar • WeNMR • DODAS • LifeWatch • CMI From month 19: • IFREMER • EISCAT_3D Portal 16 April 2018
  • 9. Mapping Services to the research data lifecycle Processing & Analysis Data Management, Curation & Preservation Access, Deposition & Sharing Federation Services ● B2FIND (data) ● Marketplace (Services) ● Applications on Demand ● Federated HTC & Cloud Compute IaaS & PaaS ● Processing of sensitive data ● Jupyter Notebook ● Application DB (software & VM) ● B2DROP (data) ● B2Note (data) ● B2SHARE (data) ● DataHub ● Federated AAI. monitoring, accounting ● SLA and order Management ● Security incident response and policies ● Technical support & Training ● B2HANDLE ● B2SAFE ● European Certified Trusted Repository ● Thematic data analytics ● Scientific Workflow Management, Orchestration (DIRAC, PaaS Orchestrator) 1 2 3 4 Discover & Reuse EOSC-hub service catalogue: https://wiki.eosc-hub.eu/display/EOSC/EOSC-hub+service+catalogue 16 April 2018
  • 11. WP11 – Training and Services for Service operators, Research and Higher Education • T11.2 – Data Management Planning (DMP) - Training event on RDM during the EOSC-hub AHM, April 18, 16:00-17:30 CEST - EOSC-hub/OpenAIRE-Advance joint training webinar on open and FAIR RDM - May 15, 13:00-14:00 CEST • T11.3 – Federated Service Management Training and Certifications - FitSM Foundation training events (co-located with the EOSC-hub KoM and the AHM) - Webinars on Lightweight Service management for Research Infrastructures for the CORBEL and ENVRIplus projects - FitSM process webinars for EOSC-hub task leaders, About 80+ people trained on ITSM based on FitSM standard • T11.4 – Training about common and federated services - Security workshop for users, VM operators and VM endorsers (ISGC2018), ~30 participants • T11.5 – Domain-specific training to data providers and data scientists - INSTRUCT training course: Advanced methods for the integration of diverse structural data, January 2018 - IEEE Workshop on Big Data Governance and Metadata and Management (BDGMM 2018), co-organized by CLARIN, March 2018 - 1st ECAS training event on the use of the ECAS integrated service (March 2018), 30+ participants 16 April 2018
  • 12. • Update of Check-in ORCID login connector after deprecation of ORCID API v1.2 [DONE] • Draft workplan for RCauth Online CA High Availability Support [DONE] • Initial workplan for integration with OpenAIRE AAI [DONE] • Initial integration of B2ACCESS with Check-in - Harmonisation of user identifiers [DONE] - Harmonisation of group membership information [ONGOING] - Harmonisation of affiliation membership information [ONGOING] - Interconnection of IdP Proxies to allow users to access services across infrastructures [ONGOING] 2/14/2018 12 WP5.1 AAI
  • 13. ● Preparation of production instance ○ Generic and subset of thematic services ● Integration with federated AAI (Check-In) ● In progress - Integration with other backoffice tools ▪ Service configuration management ▪ Service portfolio management ▪ Data management 13 Marketplace status and next steps GOCDB DPMTSPMT Operations Portal EOSC-Hub Service Catalogue Accounting Marketplace Check-in EGI-CMDB EUDAT-CMDB 16 April 2018
  • 14. Deliverables • D9.1 "1st Stage Business Pilots Overview and Work Plans” (M3 – Mar 2018) – Full report completed and submitted to EC • D3.1 "EOSC-hub Communication & Stakeholder Engagement Plan" (M4 - Apr 2018) – Contribution from WP9 • D9.2 "Joint Digital Innovation Hub Intro and Strategy" (M6 - June 2018) – Outlined ToC; defined an action plan for first draft Project management related responsibilities • Key Exploitable Results, KPIs and metrics defined, including meeting with Innovation Manager • High-level WP9 workplan for PY1, including meeting with AMB co-chairs • Bi-weekly calls being held regularly with all internal management tools set up Analysis • Technical requirements for the business pilots, incl. coordination with WP10 • Available DIH IT platforms for adoption, incl. initial engagement with a DIH (manufacturing) Industry events/collaborations • Digital Innovation Hubs 2nd Working Group meeting (21 Feb 2018) • BDVA Activity Group Meeting (14-15 Mar 2018) / Initiating collaboration between BDVA/iSpace • ICTFOOTPRINT.eu Workshop on “Green ICT – in practice” (20 Mar 2018) • List of future events compiled and prioritization under discussion Joint Digital Innovation Hub (WP9) 1st 3 Months Activity/Results 16 April 2018
  • 15. An open set of process, policies and support tools for EOSC onboarding of providers and end-users and the human resources to run it PART II Project contribution to “the Hub”
  • 16. 16 The Hub • A European-level contact point for researchers and innovators to discover, access, use and reuse a broad spectrum of resources for advanced data- driven research. - Through the virtual access mechanism, more scientific communities and users have access to services supporting their scientific discovery and collaboration across disciplinary and geographical boundaries. • Open to service providers and end-users - The project will support the integration new thematic services and scientific products from research communities and disciplines. 16 April 2018
  • 17. • Publish services and products • Define Hub policies and comply to these (general & community-specific) → community labels • e.g. FAIR best practices, access and usage policies, interoperability and standards • Define/Adopt standard-compliant general service management processes with other providers • Exploit tools and for service management • Accounting, monitoring, federated AAI • Incident management, order management, SLA management, IT security management … Providers • Use institutional credentials for access • Discover, compare • Order, get access and support • Request additional services and products End-users 17 Value proposition 16 April 2018
  • 18. • Manage alignment of services to defined policies and standards • Align services and products metadata to community guidelines (eInfraCentral, OpenAIRE-Advance) • Define/maintain/review service level agreements • Conduct service audits and quality assurance reviews • Manage end-to-end service level management performance retaining overall accountability • Provide the tools for aggregating demand and supply, make services and research artifacts discoverable and accessible at European level etc. • Coordinate IT security operations • Support users with incident management 18 Hub service management system 16 April 2018
  • 20. 20 • Open catalogue of services and products - Integrated discovery, order & access management • Service options • Visibility to service provider’s brand • Integrated with AAI (eduGAIN, social IDs, IGTF, etc.), AARC blueprint conformant • First release: July 2018 - https://marketplace.eosc-hub.eu/ Marketplace Compute Storage & Data Identity & Security Platforms Thematic services Professional services 16 April 2018
  • 21. May 2018: General services accessible through federated AAI (B2ACCESS and Check-In) Service portfolio management process July 2018: Order general services through the EOSC- Hub Marketplace Nov 2018: Accounting and monitoring of all general services Integrated Helpdesk system Dec 2018 Consistent monitoring of all EOSC-Hub services Feb 2019 Majority of Service Management System completed 21 Milestones 16 April 2018
  • 22. 22 Architecture Federating Core General and Thematic services Service management system (process and policies) Data Data products Data analytics tools FAIR guidelines from participating communities Services AAI, accounting, monitoring Helpdesk Service catalogue Access and Interfaces Marketplace AAI Standards roadmap Rules Policies for users Policies for service/product suppliers Governance Service Management System Governance Contribution to the EOSC implementation 16 April 2018
  • 23. Service/Product providers • Contribute to the catalogue & Integrate • Promote, Train, Exploit • Manage the Hub Early adopters • Pilot • Use • Co-develop Consumers • Credit allocation & exploit • Support • Improve with feedback • technical support, exploit 23 Engage with the Hub! 16 April 2018
  • 24. 24 • OpenAIRE-Advance - Service integration ▪ Consumable data management plans ▪ Interoperability for discovery of data, publications and software ▪ AAI, annotation, data anonymization - Open science scientific impact ▪ guidelines for the measurement and exchange of usage statistics - Communications, engagement, training and support - Strategy Collaborations - e-Infrastructures • eInfraCentral - Guidelines for service profiling and APIs service portfolio information exchange - EOSC portal • EOSCpilot - Validation of architecture, federated service management & service portfolio management - Scientific demonstrators • GÉANT 4.2/3 - Security, trust & identity - Service management - Engagement 16 April 2018
  • 25. 25 • Current and future ESFRI Cluster Projects • Thematic clouds - eROSA, AGRINFRA+ - Blue Cloud • Research collaborations • Virtual Research Environments Collaboration - Research communities • FAIR implementation guidelines • Discovery/Access to community specific scientific products (data, publications, software) through the EOSC-hub marketplace • technical innovation and co-design • Scaling up of data/compute infrastructure • AAI • ... 16 April 2018
  • 26. eosc-hub.eu @EOSC_eu Thank you for your attention! Questions? Contact contact@mailman.eosc-hub.eu