30 November 2017 to 1 December 2017
The Square Meeting Centre
Europe/Brussels timezone
Connecting the building blocks for Open Science

EGI-EUDAT joint access to data and computing resources: an executive report

1 Dec 2017, 11:00
15m
Copper Room (The Square, Brussels Meeting Centre)

Copper Room

The Square, Brussels Meeting Centre

Speaker

Dr Michaela Barth (KTH)

Description

The EGI-EUDAT interoperability collaboration started in 2016 with the goal to harmonise the two e-infrastructures. In order to create seamless access, and pairing data and computing resources together into one perceived infrastructure offering both EGI and EUDAT services, user communities were identified and selected to bring in their requirements on technical interoperability, authentication, authorisation and identity management, policy and operations. After the definition of a universal use case, this end-user driven approach continued and EGI and EUDAT worked closely together with EPOS, ICOS and later also IS-ENES research infrastructures as usecase pilots to test-drive the cross-infrastructure usage of the storage resources managed by EUDAT and the computing resources available through EGI and to finally also validate the results. Throughout the project, priorities were adjusted to match the aspects most important to the user communities: the user communities put much more emphasis on automated approaches and quality of end user documentation than foreseen in the beginning. Involving the user communities in this way also meant a sometimes steep learning curve on the technological understanding and effective communication using the right terms, which presented a major - but necessary - time investment from their side. This time and trust investment had to be properly administered by not misusing them as free beta-users of any not production-ready and largely undocumented new features, that were eagerly put forward. Concrete outcomes of the soon to be finished work include e.g. valuable feedback on data-handling support within the EGI DataHub and testing to use the EGI Federated Cloud with automatic submission, data transfer tests between the VMs and B2STAGE instances using both OneData and EGI DataHub to access a common storage for several VMs and evaluating the new B2STAGE HTTP API. This presentation will show the final established design of the workflows for each of the followed user communities, highlighting the adaption to their specific needs and also the cross-fertilization between them.

Primary authors

Maggie Hellstrom (Lund University (Sweden)) Matthew Viljoen (EGI.eu) Dr Michaela Barth (KTH) Peter Gille (KTH) Ute Karstens (Lund University (SE)) Mr Xavier Pivan (cerfacs)

Presentation materials