What is the impact of EGI on science and how are researchers' needs transforming scientific computing solutions in the coming decade? The EGI Foundation Director, Dr. Tiziana Ferrari will present the latest status of the EGI Federation and its contribution to EOSC focusing on its scientific impact.
Former EGI.eu Executive Board member, Pierre-Etienne Macchi is the director of the IN2P3 Computing Center, a thematic computing center dedicated to research in high energy physics, nuclear physics and astroparticles.
He acts as the IN2P3 representative at the CNRS e-infrastructures committee and he participates, in close coordination with the IN2P3 management, to the policy definition of the...
Ivan Marić is the Director of University Computing Centre - SRCE, where he began his career in 1990. During his time in SRCE, he played an important role in the creation and
construction of the Croatian academic and research network at the beginning of 1990’s and has since then participated in numerous national initiatives related to building Croatian e-infrastructure. Currently, he leads the...
According to our observation, universities‘ IT service departments either get bogged down by the multiplicity of (valid) demands or simply is unable to fulfil a portion of these demands. On the other hand, users often do not even know about those services that exist. We learned that from a short survey conducted as part of a project. So, IT has to cope with the set union of all users’ demands....
Introduce the methodology used by EGI to support Thematic Services (with technical services and w. Competence Centres)
Modern Science is becoming increasingly data driven and works with a large amount of data, which are heterogeneous, distributed and require special infrastructure for data collection, storage, processing, and visualisation. Science digitalization, likewise industry digitalization, is facilitated by the explosive development of digital technologies and cloud based infrastructure technologies...
Federated authentication and authorization management represented by AARC Blueprint Architecture is naturally stressing out the importance of the part represented by the proxy component. Indeed, the proxy component has an essential role because it handles the connection to the home IdP or other authentication sources and processes all the attributes, which are consequently passed...
Speaker bio: https://www.lip.pt/?section=about&page=person-details&details&id=839
Over the past decades, the scientific domain has seen an exponential growth of data generation. As expected, the storage, management and analysis requirements are growing proportionally, with a direct impact on the scientific output. Certain scientific communities like the astronomical one, have already organised and standardised computational workflows, whereas others can benefit from modern...
The presentation will provide insights on the first iteration of new e-IRG White Paper 2021 that is entitled "Good practices of coordination within and across e-Infrastructures and thematic Research Infrastructures (RIs)", while the overall White Paper (with more iterations planned later in 2021) is entitled "Vision for an inclusive and holistic e‑Infrastructure ecosystem for the European...
Speaker bio: https://www.linkedin.com/in/agnesmika/
In the current era of the digital revolution, the impact of new technologies and ICTs on scientific research is clearly significant. The radical transformation that the use of technology has determined in science urges a rethinking of the way science is done: the emergence of the Open Science paradigm is a step in this direction. Open Science does not only aim at promoting the openness of...
Incident Response in complex governance environments requires an additional level of responsibility awareness and clear agreements on the roles in Incident Response.
We will look at two scenarios to illustrate the problem.
1. Multiple layers of Service-User-Relations in cloud environments. Here we have the Resource Center providing the virtualization enabling technologies as a service, the...
In recent years, multiple EC funded projects are contributing to the adoption of cloud services in the European research sector. Helix Nebula Science Cloud (HNSciCloud) pioneered the development of a hybrid cloud model linking commercial cloud service providers and research organisations on-premises resources through the GÉANT network. Currently, projects like the Open Clouds for Research...
EOSC will become Europe’s virtual environment for all researchers to store, manage, analyse and re-use data for research, innovation and educational purposes. EOSC is intended to set off the ground by federating existing scientific data infrastructures and digital infrastructures for data exploitation that are now spread across disciplines and EU member states. This will make access to...
In this demonstration we will present Governify (governify.io), a service agreement management framework that boosts the service governance by supporting audits in an automated way. It is composed of a set of integrated components that can be combined to create configurable architectures that adapt to each scenario. The governance platforms built with Governify gather evidences from multiple...
EOSC-Performance is a search-and-compare platform partially developed within the EOSC-Synergy project.
Users and service providers can upload, search, and visually compare results from benchmarks for very diverse computing resources including cloud and HPC. This allows universities and computing centers to increase their visibility and scientists to identify the ideal provider for...
Everybody talks about Innovation.. but what does it really mean? Everybody has a definition for innovation and quite often there is no commonality between these varied definitions. So it becomes even more difficult to put into practice Innovation Management which is the systematic promotion of innovations in organizations through planning, organization, management and control. To make it more...
Cloud technologies are key enablers to unleash the potential of the European data economy and ensure its industrial competitiveness. The current cloud ecosystem needs to be reinforced and enlarged to embrace initiatives and efforts beyond the core European Cloud Computing community for aligning on a common strategy, while coordinating on its implementation.
Roadmapping, outreach and...
OpenAIRE (www.openaire.eu) aims to establish an open and sustainable scholarly communication infrastructure responsible for the overall management, analysis, manipulation, provision, monitoring and cross-linking of all research outcomes. One of the contributions of OpenAIRE to the European Open Science Cloud (EOSC) is its research graph (https://graph.openaire.eu), one of the largest open...
Background
OpenID Connect (OIDC) is the technological basis of many modern Authentication and Authorisation Infrastructures, which are currently being used and established in multiple European projects. Also, the non-academic sector (e.g. Microsoft, Google, Apple, IBM) moved to OIDC.
Despite OIDC being mostly used within web browser based applications, support for the command line and...
DIGITbrain – a new approach to deliver Digital Twin technologies
The goal of the DIGITbrain Project (funded by the EC, grant Nr. 952071) is to enable
customised Industrial Products, means manufacturing machines and processes, and facilitate
cost-effective distributed and localised production for manufacturing SMEs by applying
modelling, simulation, optimisation, analytics, and machine...
The new EGI’s flagship project started in January 2021 proposes to deliver the European Open Science Cloud Compute Platform and expand the supply-side, contribute to the implementation of the EU Data Strategy and the EOSC Data Commons to support the Green Deal, Health, Fundamental Research and Social Sciences and Humanities data spaces, integrate the EOSC Compute Platform in the EOSC Portal...
Data Science became famous in main stream about a decade ago: after Harvard Business Review article which coined Data Scientist as “The Sexiest Job of the 21st Century”. In business it is defined as “using data to increase competitive advantage”.
[ScienceMesh][1], developed in [CS3MESH4EOSC][2] project, creates the Federated Scientific Mesh providing federated sharing of data across...
Data-intensive complex applications, which include microservices, computationally intensive batch jobs, and sophisticated interaction with the external environment, demand for heterogeneous computational infrastructures that range from (public, private, and federated) Cloud to HPC and Edge. In this context, a crucial problem is to facilitate the work of DevOps teams in 1) the conception of the...
This session provides an overview of the computing services of EGI that deliver a distributed federated cloud infrastructure to perform any kind of data analytics for research and innovation.
The EGI service portfolio provides you various computing solutions to match your needs: Virtual Machine based computing for long-running services and for data analytics platforms; container...
The EGI Digital Innovation Hub (“EGI DIH”) is a virtual space where companies and technical service providers meet to test solutions before investing, offering different services on advanced computing to help companies in digitalization and improving productivity. The main focus of the DIH is the coordination and development of both human and technical support for business-oriented pilots and...
This session will provide an overview of the EGI Federation Registry tool that allows service providers to manage the connection of their OpenID Connect and SAML based services to Check-in, the authentication, authorisation and user management service for the EGI infrastructure. The EGI Federation Registry provides a web interface which covers the whole service lifecycle, including the initial...
In this presentation, we will introduce you EC3, a tool able to deploy virtual elastic clusters (i.e. Kubernetes or SLURM clusters, among others) on top of the EGI Cloud Compute. You will know more details about the tool, its main capabilities, its interfaces (both CLI and Web portal) and how to start using it. Don't miss the session!
T-Systems was able to collect various experience working with the science community through e.g. Helix Nebula, Indigo-Datacloud, Copernicus and currently the OCRE framework.
The presentation will share some interesting findings and lessons learned, what is required to make good use of and in which scenarios science can benefit from commercial clouds.
emGORA workspace – a community-based approach to deliver software services for manufacturing engineering
In the past 10 years, the community-based approach is enjoying increasing popularity. The European Single Market offers many opportunities for large companies that are well
equipped with financial and human resources, but where small and individual players unfortunately fall by the...
Prof. Antonio Zoccoli will walk us through 70 years of discoveries in Physics with INFN, the Italian National Institute of High Energy Physics, member of the EGI Federation. With Antonio we will learn how innovation in ICT from broadband communications to distributed computing have been key enablers of scientific excellence.
Stefano Bagnasco is a senior Technology Researcher with the Istituto Nazionale di Fisica Nucleare in Torino, Italy. He has 20 years of experience in designing, maintaining and operating large-scale distributed infrastructures for scientific computing, first for HEP experiments and now in the field of Gravitational Waves research. He is currently serving as Computing and Data Processing...
Green Computing is dedicated to the reduction of energy and material consumption in information and communication technologies. Although serious energy-saving measures are put in place already today, they are being overtaken by accelerated advances of digitization.
The steady rise of the Internet of Things (IoT) results in a drastic grow of the number of sensors. In the same way, the...
Funders, publishers and scientific organizations have highly endorsed the adoption of FAIR principles (Findable, Accessible, Interoperable, and Reusable) to promote research data reusability and reproducibility.
However, FAIR principles are high-level guidelines without explicit requirements for their implementation. Several aspects should be taken into account to translate the principles...
The amount of companies and DataCenters that handle large volumes of data using Computer Information Systems are constantly growing. Besides, the computing infrastructures become more complex integrating different types of architecture (HPC, Cloud Computing, GPU, low-latency networking, etc). In addition, hundreds or thousands of users sharing the same resources make the systems more...
OpenID Connect (OIDC) is an identity layer on top of the OAuth 2.0 protocol. Relying on OIDC for identity and access management can significantly simplify the process of providing access to users, especially for non-web applications where the management of typically used SSH keys is often laborious and error-prone.
This project aims to provide client-side support for OIDC access tokens for...
EGI-ACE federates together a distributed set of 16 hosting centres that bring compute and storage capacity for data processing, hosting research data and tools and scale up data analytics environments, scientific gateways and other added value services. Over the 30 months of the project, the hosting sites will provide more than 82 M CPU hours and 250 K GPU hours, as well as 45 PB/month...
Collaborative Computational Project Number 4 in Protein Crystallography (CCP4 UK), founded in 1979, has a mission to produce, maintain and distribute a world-leading, integrated suite of programs for the determination of biological macromolecular structures in 3d by means of X-ray crystallography and other biophysical techniques. Today, CCP4 Software Suite, used by estimated 25,000 researchers...
Planning Research Data Management (RDM) activities is crucial as it effectively lays the foundations for successful research conduct according to Research, Technology and Development (RTD) best practices and requirements. Additionally, it leads to validated and quality research outcomes at the end of the scientific project / endeavour. Data Management Plans (DMPs) implement RDM policies and...
fedcloudclient is a command-line client and high-level Python package for interaction with EGI Federated Cloud. The client will allow users to perform the various OpenStack operations in EGI Federated Cloud. Executing any OpenStack command on any site with fedcloudclient is very simple: it requires only three options: site, VO and the command. For example:
- Listing images in...
Nowadays, more and more services are dynamically deployed in Cloud environments. Usually, the services hosted on virtual machines in Cloud are accessible only via IP addresses or pre-configured hostnames given by the target Cloud providers, making it difficult to provide them with meaningful domain names.
The Dynamic DNS service provides a unified, federation-wide Dynamic DNS support for...
This demonstration will provide users with a step-by-step tutorial for accessing data via the EGI Data Services and analyzing it with MATLAB on the EGI’s Notebooks Service.
Users can connect with their own MATLAB licenses to analyze available datasets on the EGI’s DataHub in the cloud on EGI resources. MATLAB live scripts allow users to build computational notebooks combining text, images,...
Research infrastructures play an increasingly essential role in scientific research. They provide rich data sources for scientists, such as services and software packages, via catalog and virtual research environments. However, such research infrastructures are typically domain-specific and often not connected. Accordingly, researchers and practitioners face fundamental challenges introduced...
Nowadays, artificial intelligence (AI), machine learning, deep learning and data science are an essential part of the scientific research toolbox in most disciplines. These are also present in a number of projects, research initiatives and infrastructures. These new tools are also changing the traditional research ICT landscape. The EGI Federation as an international infrastructure - that...
Aims
The StairwAI project aims to create a bridge between users in a low-tech level to the higher-level AI resources. The project will do this by facilitating low-tech users' engagement on the AI on-demand Platform. This will be achieved through a new service layer enriching the functionalities of the on-demand platform and containing:
(1) a multi-lingual interaction layer enabling...
AI4PublicPolicy is a joint effort of policy makers and Cloud/AI experts to unveil AI's potential for automated, transparent and citizen-centric development of public policies. To this end, the project will deliver, validate, demonstrate and promote a novel Open Cloud platform (i.e. AI4PublicPolicy platform) for automated, scalable, transparent and citizen-centric policy management based on...
Aim of the LETHE project is to create a personalized prediction and intervention model for early detection and reduction of risk factors causing dementia, based on artificial intelligence (AI) and distributed machine learning (ML).
The roots of LETHE project are deep and based on the result of research, studies and clinical data collected over the past 10 years. Memento, PredictND and the...
Europe's AI4EU community brings together all individuals and organisations that are interested in using or benefitting from today's AI capabilities. Researchers, developers, entrepreneurs, citizens, civil servants and AI experts are invited to engage with the AI Ecosystem stakeholders and access multiple resources and solutions.
Some of the ongoing projects under the AI4EU initiative are...
The main purpose of the EGI Software Vulnerability Group can be summarized as "To minimize the risk of security incidents due to software vulnerabilities."
The EGI SVG and its predecessors have been active since 2006, helping sites and VOs avoid incidents due to software vulnerabilities across the distributed computing infrastructure in a consistent manner.
Initially the focus was on Grid...
In today’s world, more and more data are constantly being generated, resulting in changing the nature of computing, with an increasing number of data-intensive critical applications.
As the Council adopted a regulation on establishing the European High Performance Computing Joint Undertaking (EuroHPC) in July 2021, the regulation paves the way for the development within Europe of the next...
Digitisation and big data are revolutionising the way we live, think and make decisions. With the constant proliferation of devices and networks, more and more of the data being created from a variety of sources is able to be stored, transmitted and processed efficiently in large amounts. Increasingly, cloud environments, big data and other innovative data-driven approaches are enabling policy...
Blue-Cloud is the thematic EOSC for the marine domain supporting FAIR and Open Science by developing a web-based environment to provide scientists & researchers with enhanced analytical capabilities and cloud-computing resources, underpinned by simplified access to a wealth of multidisciplinary and interoperable marine data services.
The project builds on existing European marine data...
The usage of EFSS (Enterprise File Sync&Share) platforms for sharing files is increasing, with a global market expected to reach $17 billion by 2025. Within the research and education sector, the Cloud Storage Services for Synchronisation and Sharing (CS3) community brings together vendors, service providers and users of EFSS platforms. CS3 provides services that are indispensable for the...
Abstract:
The goal of this poster is to contribute to a common understanding of the concept of "Open Science".
Indeed, it is widely recognized nowadays that there is no single, accepted, unified definition of Open Science. This motivates our proposal of an Open Science definition as a political and legal framework where research outputs are shared and disseminated in order ...
WORSICA (Water Monitoring Sentinel Cloud Platform) is a one-stop-shop service that integrates remote sensing (Copernicus) and in-situ data for the determination of water presence in coastal and inland areas, applicable to a range of purposes from the determination of flooded areas (from rainfall, storms, hurricanes or tsunamis) to the detection of large water leaks in major water distribution...
The vast amounts of data generated by scientific research pose enormous challenges for capturing, managing and processing this data. Many trials have been made in different projects (such as HNSciCloud and OCRE), but today, commercial cloud services do not yet play a major role in the production computing environments of the publicly funded research sector in Europe. Funded by the Next...
Federated Identity Management, as modelled in the AARC blueprint architecture, has established itself as a de-facto standard for authentication and authorisation in research infrastructures.
Yet, federated access to shell-based services comes with a number of challenges, since it typically requires local identities that need prior provisioning, as well as deprovisioning when no longer...
Sylvie Joussaume is an expert in climate modelling within CNRS. She has been involved in several assessment reports of the Intergovernmental Panel on Climate. Change. She coordinates since 2009 the European infrastructure project, IS-ENES, which integrates the European climate models in a common research infrastructure dealing with models, model data and high-performance computing for climate...
The CESNET grid site prague_cesnet_lcg2 supports several virtual organisations. These VOs use computing resources mostly intermittently and there were periods when CPUs were idle. We considered to add support to some LHC VOs, which submit jobs almost continuously. Since the size of resources is relatively small (1200 cores after the last upgrade) and the fraction for LHC VOs would be small...
EGI-ACE aims at providing interoperability guidelines for HPC systems with the EOSC Cloud Compute platform. Four scientific pilot use cases with combined cloud and HPC needs will be used for exploring and identifying how HPC systems should be exposed to the EOSC portal and how users should interact with them.
This session will provide a status update with presentations from the scientific...
Considering the landscape in which EGI services sit, and how it is evolving through EOSC and other intitiatives.
Hakan Bayindir (Male) is working as a senior researcher at TUBITAK ULAKBIM since 2006. He has worked in many European Projects such as EGI, EGI-InSpire, EOSC-hub, and EGI-ACE. He has many hats ranging from system administration to managing projects themselves and has experience in cluster and cloud system design & administration, high performance programming, development of simulation systems,...
Introducing the wider services from the EGI federation being drawn into the broader EGI Portfolio
The Virtual Imaging Platform (VIP, https://vip.creatis.insa-lyon.fr) is a web portal for medical simulation and image data analysis. It has been running for more than 10 years and has grown over the years to provide more and better services to researchers worldwide by leveraging the computing and storage resources of the EGI federation within the biomed Virtual Organization. On the internal...
udocker is a tool to enable execution of Linux containers in user space. Distinctively from other tools, udocker is meant for easy deployment, and provides multiple execution engines to cope with different host environments. udocker does not require privileges and can execute containers with or without Linux namespaces making it suitable to execute containers across a wide range of Linux...
Scientific challenges (competitions) bring together numerous research teams who work on solving a common scientific hard problem. During the challenge, their solutions are evaluated on a given set of data according to the guidelines given by the organizers.
The automatic segmentation of tissus, structures and lesions in MRI brain scans is a challenging task for improving medical decision...
Introducing the new Service Strategy draft and the breakouts
The talk will provide information about the activities going on at INFN to leverage some HPC compute clusters: Cineca, CNAF and ReCaS-Bari. There will be few details about which approach, solutions and technologies are used currently to include also HPC resources in the Compute Infrastructure used at INFN
There will be 4 breakout sessions to discuss 4 draft strategic objectives for the EGI Service Strategy.
Breakout session 1:
Facilitator: Gergely Sipos
SO1: Federate and deliver a compute continuum from edge, through cloud and cluster to HPC together
Breakout session 2:
Facilitator: Mark Dietrich
SO2: Implement and deliver research ‘Data Spaces’ as a joint effort with Research...
This presentation will show progress on benchmarking, containerization, and investigations on data access performed over the past months to enable heterogeneous support for HEP workloads at HPC sites.
The deluge of data started at the beginning of this century has caused a profound transformation in the way scientific discovery is carried out. In several domains, such as climate science, scientific advances now rely on technologies and software solutions from both the HPC and Big Data landscapes. However, being able to efficiently exploit HPC infrastructures for running scientific data...
The study of many scientific problems concerning environmental challenges sets significant computational demands, such as large data volumes, advanced modeling techniques, and distributed computing facilitates. To conduct such investigations, a researcher often has to reuse virtual assets, e.g., observational data or images, AI models, operational workflows, and infrastructure services from...
OSCAR is an open-source platform to support serverless computing for compute-intensive data-processing applications. OSCAR runs on dynamically provisioned auto-scaled Kubernetes clusters deployed through the Infrastructure Manager (IM), an open-source Infrastructure as Code (IaC) tool. These Kubernetes clusters include support for MinIO, an open-source object storage, which fires events in...
The DIRAC Interware Project provides a software framework and develops ready to use components to build distributed computing systems of arbitrary complexity. The solution is universal and covers both workload and data management tasks. The Project was originally developed for LHCb – one of the 4 experiments at the LHC collider which stays its principal user. Therefore, a special care is taken...
The EGI Grid Infrastructure Workload Manager Service (EGI-WMS) is based on the DIRAC Interware distributed computing framework. It allows, through pilot jobs, to provide diverse scientific communities with a generic access to heterogeneous computing and storage resources.
This presentation will describe the service platform and the hosting site migration that was performed at the beginning...
The WeNMR Collaboration is a virtual research community which brings together several research teams in structural biology providing a common platform for data analysis and modelling. WeNMR is one of the most active users of the EGI Workload Manager service. User tasks prepared by the WeNMR application portals are submitted to the Workload Manager service which then dispatches them to the...
The biomed Virtual Organization (VO) is a large scale international and multi-disciplinary VO supporting communities from the Life Sciences sector, with three main thematic groups: medical image analysis, bioinformatics and drug discovery. The VO is operated on the EGI infrastructure and supported by more than 50 sites, delivering access to a large number of heterogeneous resources.
The...
In this contribution we will make a demonstration of typical user tasks when working with the EGI Workload Manager service. This is an interactive session when all the necessary explanations will be given and user’s questions will be answered.
In this presentation Helmut will present the development and achievements of the CESNET from NREN to national e-infrastructure provider through the past 25 years.
Helmut Sverenyák, Research and Development Manager – has a Dipl. Ing. (1991) from the Faculty of Nuclear Sciences and Physical Engineering at the Czech Technical University in Prague. He joined CESNET in 1998 as a member of the...
The EGI Conference gives the voice to research communities, technology and infrastructure providers to steer the evolution of scientific computing and the EGI Federation in Europe.
Gergely Sipos, Head of Services Solutions and Support at the EGI Foundation, will summarize the conference outcomes with the help of rapporteurs.
This session will review the GOSC objectives and report on existing activities in CODATA GOSC Working Groups and selected Case Study Groups. It will be the first time for them getting together to share group discussions and activities.
This session invites global digital Infrastructures and Cloud resources in different countries, regions, and continents including, ARDC (Australia), OSG(US), CSTCloud(China), MOSP(Malaysia), AOSP (Africa), in order to discuss potential collaborations. This will be an extension of EOSC discussion that is the main focus of the conference, and a unique opportunity to review the global open...
It is often said that Creativity is not innate and that it can be cultivated like skill. That it is like a muscle, the more you train the stronger it becomes. But how do you train yourself to become more creative? Moreover, the COVID-19 virtual world has even made it difficult to develop and harness team and group creativity.
Drawing inspiration from the Innovator's DNA - a book by Clayton...
This session will present the status and technical roadmaps of the EGI Federation tools and services. These underpin the federated compute platforms of EGI, as well as serve in the EOSC Core. The presentations will detail the upcoming features that these will implement in the coming year.
The following services will be covered: Accounting, Configuration DB, Monitoring and Messaging services,...
This session focuses on the presentation of the EGI Technical Annual Plan that includes all the planned activities related to the innovation of existing EGI services and the piloting of new services and solutions. The EGI Technical Annual Plan is developed by the Technical Solution Team in collaboration with technology providers and research & innovation projects for technology scouting and...
The EGI Workload Manager service provides an easy access to the EGI computing and storage resources for users from various scientific domains. It helps to increase the efficiency of grid and cloud computations for individual users with moderate requirements as well as for large user communities needing a powerful workflow management system.
The Service is built with the software provided by...
The project EOSC-Synergy is pushing the state-of-the-art to facilitate the adoption of EOSC for infrastructure managers and scientific application developers in a way that supports EOSC Core interoperability guidelines, fosters the development of quality software, and provides a comprehensive environment for Thematic Services to become a part of the EOSC Exchange ecosystem.
Our strategy to...
Public authorities need innovative tools to develop better evidence-based policies. Citizens and Business should be involved in this process to better inform policy-making and to increase the trust in the authorities and the policies acceptance. Shared data, analytics and cloud improve policy making at all levels, national and local.
The main objective of this session is to bring together the...
The session presents the current state of the art of Digital Earth Observation by presenting the existing open platforms for processing Copernicus and other Earth Observation. The opportunities and limitations related to these Big Data solutions are discussed as background motivation of the federated C-SCALE approach that will help EOSC to play a role in the EO Digital Transformation. The...
This session will cover solutions to replace DPM with support of DPM coming to an end, for example dCache, EOS and StoRM. It will also cover experiences from communities who have migrated from DPM to other solutions.
