EGI2024

Session

Maximizing Data Efficiency and Availablity: Innovations in Data Management Platforms

2 Oct 2024, 11:00

San Martino (Hilton Garden Inn)

Conveners

Maximizing Data Efficiency and Availablity: Innovations in Data Management Platforms

• Michal Orzechowski (CYFRONET)

Description

This session will explore cutting-edge technologies and strategies that enhance data management and access to federated data sources currently developed in the context of EU projects The session will inclide as well example of usages and integrations of those platforms by scientific communities

18. Why does document structuring still matter and struggle in the era of GenAI and Large Language Models?

Dr Mohamed Khemakhem (MandaNetwork)

02/10/2024, 11:00

Short Talk

Document structuring is a fundamental aspect of information management, involving the categorization and organization of documents into logical and physical structures. This presentation explores the benefits and challenges associated with document structuring, focusing on the distinctions between physical and logical structures, metadata and content, as well as addressing the implications for...

68. BEACON - High performance data access supporting marine data lakes

Tjerk Krijger (MARIS)

02/10/2024, 11:15

Short Talk

In many of the societal and scientific challenges, such as Digital Twins of the Oceans and virtual research environments, fast access to a large number of multidisciplinary data resources is key. However, achieving performance is a major challenge as original data is in many cases organised in millions of observation files which makes it hard to achieve fast responses. Next to this, data from...

109. Blue-Cloud 2026 – a Federated Data Discovery and Access Service

Tjerk Krijger (MARIS)

02/10/2024, 11:30

Short Talk

The Blue-Cloud 2026 HE project aims at a further evolution of the pilot Blue-Cloud open science infrastructure into a Federated European Ecosystem to deliver FAIR & Open data and analytical services, instrumental for deepening research of oceans, EU seas, coastal & inland waters. It also strives to become a major data and analytical component for the Digital Twins of the Oceans (DTO’s) as well...

98. STAC at CEDA - a scalable, standards-based search system

Rhys Evans

02/10/2024, 11:45

Short Talk

The Centre for Environmental Data Analysis (CEDA) stores over 20 Petabytes of atmospheric and Earth observation data. Sources for the CEDA Archive include aircraft campaigns, satellites, automatic weather stations and climate models, amongst many others. The data mainly consists of well-described formats such as netCDF files but we also hold historical data where the format cannot be easily...

112. Leveraging Federated Data Infrastructure for a European Open Web Index

Mr Mohamad Hayek (Leibniz Supercomputing Centre)

02/10/2024, 12:00

Short Talk

In an era where web search serves as a cornerstone driving the global digital economy, the necessity for an impartial and transparent web index has reached unprecedented levels, not only in Europe but also worldwide. Presently, the landscape is dominated by a select few gatekeepers who provide their web search services with minimal scrutiny from the general populace. Moreover, web data has...

85. Sunet Drive - An Academic Toolbox for FAIR Data Storage, Analysis and Publication

Richard Freitag (SUNET)

02/10/2024, 12:15

Long Talk

Sunet Drive is a national file storage infrastructure for universities and research institutions in Sweden. It is based on a Nextcloud setup and is comprised of 54 nodes, one prepared and provisioned for each institution. The aim of Sunet Drive is to become an Academic Toolbox capable of collecting, storing, analyzing, and publishing research data, supporting FAIR principles. We present...