19–23 Sept 2011
Lyon Conference Centre
Europe/Amsterdam timezone

DPM/LFC: Standards, Status and Plans

19 Sept 2011, 11:45
15m
Rhone 2 (75) (Lyon Conference Centre)

Rhone 2 (75)

Lyon Conference Centre

Lyon Conference Centre, Lyon, France

Speakers

Ricardo Rocha Ricardo Rocha (CERN)

Description

The Disk Pool Manager (DPM) is a lightweight solution for disk storage management. It provides an easy way to manage and configure disk pools, and exposes multiple interfaces for data access and control. It is used in production in more than 200 sites, serving communities like HEP and Biomed, among many others. In the last months we have made a big effort to provide standards compliant data access, with the goal of simplifying both the client and server side setups - no clients, simpler firewall settings, much simpler library dependencies. For POSIX access we have chosen NFS 4.1/pNFS, a very significant improvement over previous versions of the NFS protocol. It adds sessions and bulk operations for scalable access over the WAN, strong security, distributed data access, among many other new features. For download/upload style access, we have developed a new HTTP/WebDAV frontend. With it we get DPM data available in virtually any platform or setup - via web browsers, graphical filesystem browsers or command line tools like wget or curl - in a very high performance setup. +C3In this talk we will summarize the status of these components, the benefits for both clients and system administrators, and early performance measurements with comparison to existing protocols. We will describe how this work also benefits the LCG File Catalog (LFC), which now also exposes a HTTP/WebDAV frontend. Finally, we will also talk about other improvements we have done to the core of the DPM system, like filesystem weights, improved drain performance or third party copies.

Presentation materials