10–13 Nov 2015
Villa Romanazzi Carducci
Europe/Rome timezone

Opportunistic use of supercomputers: linking with Cloud and Grid platforms

11 Nov 2015, 16:40
20m
Sala A+A1, Giulia centre (Villa Romanazzi Carducci)

Sala A+A1, Giulia centre

Villa Romanazzi Carducci

Speakers

Fernando Aguilar (CSIC) Luis Cabellos (CSIC)

Description

Supercomputers are good candidates for opportunistic use, as a non-negligible fraction of the computing time may stay unused while waiting for a large number of cores to be available for a new parallel job to be executed. In practice this results in a typical occupancy below 90%, leaving yet an interesting 10% of computing time that could be used by short jobs using few cores. Users accessing to supercomputers however may not have such need for short jobs that may be more frequent for users of Cloud or Grid computing platforms. We explore the possibility of automatic back-filling execution in a supercomputer of jobs prepared for a Cloud or a Grid platform. Different options for this integration are presented, as well as its implementation on a top500 supercomputer for different applications. The experience using this schema to support the long-tail of science in biodiversity, providing access to more than 100 users from 20 different countries in the world, will be also described.

Primary author

Jesus Marco de Lucas (CSIC)

Co-authors

Mrs Aida Palacio (IFCA University of Cantabria) Fernando Aguilar (CSIC) Luis Cabellos (CSIC)

Presentation materials