Conveners
Training: Data management with FTS and RUCIO
- Andrea Manzi (EGI.eu)
- Tim Noble (STFC)
- Rose Cooper
Description
FTS allows scientists to move data files asynchronously from one storage to another. The service includes dedicated interfaces to display statistics of on-going transfers and manage storage resource parameters. FTS is ideal to move large amounts of files AND very large files as the service has mechanisms to verify checksums and ensure automatic retry in case of failures.
Rucio allows policy based management of data with expressive statements. You to say what you want with the files, and Rucio will figure out the details of how to do it. For example, three copies of my file on different continents with a backup on tape. Or to automatically remove copies of data after a set period or once its access popularity drops.
FTS and Rucio power some of the largest scientific data taking and analysis experiments of the world, such as the Large Hadron Collider.
The EGI federation, based in its partners STFC and CERN offers FTS and Rucio services for scientific communities.
Target audience: This tutorial is designed for scientific communities who want to build scalable, reliable and sustainable data management infrastructures.
Agenda
Rucio (45’) - Timothy Noble
- Intro + future plans
- Admin commands
- User command
- Demo
- Instructions for users
FTS (45’) - Rose Cooper
- Intro + future plans
- Transfer commands
- Monitoring interface
- Demo Transfer + monitoring
- Instructions for users
