HBP/EGI Collaboration meeting

Tuesday 14 Jun 2016, 10:30 → 11:30 Europe/Amsterdam

GoToMeeting

Matthew Viljoen (EGI.eu)

https://global.gotomeeting.com/join/543867125

You can also dial in using your phone.

Netherlands : +31 (0) 207 941 375

Access Code: 543-867-125

Present - Michaël Dupont (MD), Björn Hagemeier (BH), Christian Bernardt
(CB), Matthew Viljoen (MV)

Apologies - Lukasz Dutka (LD), Jeffrey Muller (JM)

EGI STATUS REPORTS

CB said that DESY is preparing for production in implementing site level
internal monitoring.  Also a re-sync was started as one of the datasets
(Goldi rat) wasn't visible for some reason.  CB said that DESY are
considering moving from F5 to NGINX as this would make configuration
easier (especially AAI) as NGINX is used elsewhere in the service.

BH said that all datasets were available at FZJ and the SSL-enabled
enpoint was ready for testing.  BH mentioned that further work was being
done in optimizing performance, but the first time the connector was
contacted there was always a longer time for the images to be served.  MV
said that he'd observed this at other sites as well.  BH said he'd
increase the caching time to 1 week to see if this improves the lag.

HBP REPORT

MD had setup an HBP-hosted NGINX load balancer across HBP data hosting
research centres.  This should help with performance and resiliency in
case an RC is down.

SLA REPORT

MV said that OLA negotiations were ongoing.  1GBit/s is now the required
speed which tests have shown is sufficient for serving 100 concurrent
users.  No more stipulation of the maximum data transfer from RCs.  SLA
level monitoring will be done by EGI - this still needs to be implemented.

-> Implement SLA level monitoring (MV)

DEVELOPMENT ROADMAP

MV said that the Federated Data virutal team had met on 6 June to discuss
HBP development priorities list.  AAI is progressing with HBP and
regarding large data pipelines including syncing data across sites and
checksum verification of data, OneData and Globus Online technologies were
discussed.  Technical requirements are believed by EGI to be as follows:

- checksum verification upon transfer
- easy way of syncing data across sites, i.e. automatable/scritable; our
  current manual approach is both time consuming and error prone
- needs to support current storage technologies: OneData, dCache, SWIFT
  (although Björn noted that FZJ may move away from SWIFT in the future)
- ease of use for HBP people (e.g. GUI interface for managing data)

HBP team should consider whether there are other requirements

-> Review list of requirements (HBP team)

AAI

MD said that authenticated access would happen when a datasite under the
path: /hbp_only/.  BH said he'd copy a sample dataset to this path so
HBP can test AAI against FZJ.

Outstanding actions:

-> Send latest ALTASVisualization tool to EGI team (HBP team)
-> Enable authenticated endpoint (LD, CB)

DONM: 28 Jun at 10:30 CEST