Minutes of TF Federated Clouds Accounting Meeting 23 Apr 2012

1. The cloud accounting client for OpenNebula
This has been written by Pablo from Cesga and is for OpenNebula version 3.2, it has some fields/terms in Spanish so will be translated and provided for testing to any other Resource Providers who are deploying OpenNebula 3.x.

The script successfully accumulates information about running VMs by referencing the "seq" value which is incremented every time there has been a change in status for a VM.  The accumulated data about each VM at the site will be managed by the cloud accounting client at the Resource Provider therefore and an update sent to the cloud accounting server at STFC once per day, the latest record
for a VM then replaces any existing record for that VM on the STFC server.  In this way we will be keeping a summary of information at the Cloud Accounting server.

Actions for this item:
 * Albaro to provide translated script to Task Force Resource Providers
 * Alison to save current contents of Cloud Accounting database, and allow testing from Cesga only initially to check use of new script version.
 * Alison to inform Resource Providers running OpenNebula 3.x when we are ready to also receive their records.  (Other publishing from other versions will still be restricted at this time.)

2. Cloud Accounting client for other resource providers
Mattieu has successfully retrieved cloud accounting information from OpenStack using the
OpenStack API.  He will endeavour to retrieve the same information as the Cesga team have from
their OpenNebula implementation. 

We do not have cloud accounting  clients for WNodes, StratusLab and Okeanos.
Actions for this item:
 * Mattieu to send his host DN certificate information to Alison and set up SSM to test publishing.
 * Matteo to investigate current status of cloud accounting client development for WNodes, StratusLab and Okeanos.
 
3. Integration with EGI accounting production infrastructure.
The EGI Accounting portal team are able to provide some effort to receive cloud accounting records
and provide view of this data.  The infrastructure and teams are already in place at STFC/Cesga to implement this, so we expect this to be the most efficient way to provide Cloud Accounting summary data.  This allows us to focus on the questions we wish to ask of the Cloud Accounting  data.    Matteo is looking for output from this work in the next 6 months.   

Matteo introduced a list of metrics for the TF that have been discussed within EGI, they are:
a)  Total compute capacity ( this is the total number of cores offered across the federated testbed
resource providers).
b) Total Storage Capacity
c) Total number of VMs - from marketplace
d) Total number of images offered - from marketplace
e) Status
f) Total number of federated resource providers
g) Total number of user communities
h) Number of instantiated VMs across all resource providers, e.g. in a 24 hour period how many used?

Of these metrics we agreed that the one related to accounting is:

h) Number of instantiated VMs across all resource providers, e.g. in a 24 hour period how many used?

and that it might be useful to derive something like:

i) Total number of VMs ever run
j) Total number of VMs running at the moment.

All the other metrics (a - g) are not related to the accounting work group. 

Members from the group to work on this area:
Alison Packer
Alvaro Simon
Ivan Diaz Alvarez
Matteo Turilli
Will Rogers

Actions from this item:
 * Alison  to arrange a meeting of this sub group to work on this.

4. AoB
 * x509 authentication - we discussed this issue, we can not yet use x509 authentication and we are
not yet able to identify who the user communities using the VMs are.  Bjorn is also monitoring
work in this area.

Actions: 
Bjorn to check status of work to authenticate using x509 with GWDG
Matteo to contact Andy Edmonds (from ??) regarding implementation of OCCI interface to OpenStack.

 * Action on Alison to investigate information re: NIST to integrate with our work.