Meeting with EISCAT-3D

Europe/Amsterdam
Description
Third meeting of EGI ENVRI Study Case with EISCAT-3D (Ingemar Haggstrom).

A study case was set up to identify existing services and solutions from EGI that could address the data pre-processing, post-processing, publishing needs of these two ESFRI projects. The outcome of the pilot is expected to be directly applicable to EISCAT_3D and EURO-ARGO, and indirectly by other ESFRIs of ENVRI. In cooperation with EISCAT-3D and EURO-ARGO representatives in ENVRI, EGI.eu will try to find best suitable solutions for data pre-processing of primary data and post-processing toward publishing.

More: https://wiki.egi.eu/wiki/EGI_ENVRI
We have Ville from CSC, Ingemar from EISCAT, Paul from Edinburgh data intensive research group, and Yin from Cardiff Uni in today's discussion. To update with our EGI colleagues I record the meeting as follows: (Please correct me Ville, Ingemar and Paul, if I misunderstand you or miss out important issues)
 
Dear Gergely and EGI colleagues, an important output from today's discussion is that it is turn out that all presenting organisations have good appetite to grow bigger. I hope we do not suprise you too much and you also agree with us -- to develop the pilot project into an EU proposal.  
 
We considered it would be good to have face to face meeting in Lancaster starting to shape the proposal. In today's discussion, each organisation representer expressed the research interesting as follows:
 
Ville, representing CSC and EUDAT:
  • CSC has been involved in building Finish national EISCAT-3D infrastructure, and would like to support this activity;
  • EUDAT would be interested in providing common services for supports of big data, e.g., data staging, data management etc.  
  • It would be able to involve LoFAR. Ville will introduce people from LoFAR. LoFAR will present in the Lancaster meeting, it will be good to discuss with them. (Yin: similar to ENVRI, we can analysis common requirements and identify common challenging issues of managing and handling big data, to provide, e.g., a Reference Model for Big Data Management and Processing )
Ingemar, representing EISCAT:
  • searching will be the main requirements from EISCAT-3D
  • it will be good to collabrate with LoFAR, which is very similar project, we can learn existing experiences and to advance them.  
Paul, representing Edinburgh Data intensive group:
  • only join the discussion today, still catching up 
  • probably more about workflow, services aspects
  • will discuss with Malcolm 
Yin, representing Cardiff:
  • will support EISCAT-3D to provide searching facility, and to generalise these technology in order to support other big data system  
  • to investigate advance searching technology, e.g., similarity searching, pattern-based data discovery etc.  (Ville: this presumably very challenging )
  • to investigate approach to improve the performance of searching big data 
  • Alun is interested in establishing registry of common application store based on the ENVRI Reference Model for data scientists training
EGI:
  • We need the inputs from our EGI colleagues here ...
 
We will soon have another Skype meeting next week to merge the ideas and assemble the presentation. Slides more explicitly describing these ideas will be provided by each organisation by next Skype call.
 
Actions:
1) each organisation to give 2 slides of research idea/directions 
2) each organisation to give 1 slide of requirements to be collected/discussion topics 
3) have another meeting soon next week to assemble the idea 
4) Ville to introduce LoFAR people
5) Please register to the EISCAT meeting
There are minutes attached to this event. Show them.