11-14 April 2011
Radisson Blu Hotel Lietuva, Vilnius
Europe/Vilnius timezone

EMI-ES: A common interface to ARC, gLite and UNICORE computing elements

11 Apr 2011, 11:30
30m
Lambda (180) (Radisson Blu Hotel Lietuva, Vilnius)

Lambda (180)

Radisson Blu Hotel Lietuva, Vilnius

Oral Presentation DCI - Implementation EMI: Software for Distributed Computing Infrastructures

Speaker

Dr Bernd Schuller (Juelich Supercomputing Centre)

Impact

The EMI Execution service uses the experience from the existing JSDL, OGSA-BES and some related specifications, combining them into a single coherent interface.

The EMI Execution Service will allow transparent job submission to the different middlewares, based on a common web service interface.

Further standardization activities with the relevant OGF groups (PGI, JSDL, BES) are foreseen, in which this agreement between the European players is expected to have a strong impact. Conversely, we foresee future modifications of the specification, both necessitated by external requirements, and through the experience gained from implementing the EMI-ES specification, and doing interoperability testing.

Overview

The EMI Execution Service (EMI-ES) represents an agreement between ARC, gLite and UNICORE for a common web service interface to computing elements. This service deals with the submission and management of single-job activities on a computing element.
It covers important use cases from both high throughput and high performance computing.

Description of the work

The EMI-ES specification has been developed by a team consisting of leading developers from the three Grid middleware systems ARC, gLite and UNICORE.

The specification covers roughly the same space as the existing OGSA-BES and JSDL specifications, i.e. creation and management of single activities on a computing element.
However, there are evolutions and differences as well:
* re-designed activity description XML schema, covering data staging, execution, runtime environments, parallel applications and a simple yet powerful resource description (slots, memory, etc). It can be seen as a merger of the JSDL 1.0 schema and some critical and often-used extensions
* support for bulk operations (e.g. bulk job submission)
* flexible data staging model, synthesizing the capabilities of the involved middlewares
* simple state model
* consistently uses GLUE2 as the information model for resource and activity descriptions

The technical realisation of the interface will be done using standard SOAP web services.

URL

https://twiki.cern.ch/twiki/bin/view/EMI/EmiExecutionService

Conclusions

The Execution Service agreement represents a significant milestone for the EMI project, which will enable transparent job submission to the different middlewares that make up EMI. Initial implementations are expected mid 2011.

Primary authors

Dr Aleksandr Konstantinov (Universitetet i Oslo) Dr Balazs Konya (University of Lund) Dr Bernd Schuller (Juelich Supercomputing Centre) Luigi Zangrando (INFN Padova) Massimo Sgaravatto (INFN Padova)

Co-authors

Eric Frizziero (INFN Padova) Martin Skou Andersen (Niels Bohr Institute Kopenhagen) Dr Oxana Smirnova (University of Lund) Shahbaz Memon (Juelich Supercomputing Centre) Shiraz Memon (Juelich Supercomputing Centre)

Presentation Materials